2023-10-14T12:06:00.558 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T12:06:00.559 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304 --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --owner scheduled_rishabh@teuthology --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/orig.config.yaml 2023-10-14T12:06:00.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:06:00.694 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304 branch: rishabh-2023oct13 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7425304' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T12:06:00.694 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T12:06:00.695 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T12:06:00.695 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T12:06:00.697 INFO:teuthology.task.internal:Checking packages... 2023-10-14T12:06:00.724 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T12:06:00.725 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T12:06:00.725 INFO:teuthology.packaging:ref: None 2023-10-14T12:06:00.725 INFO:teuthology.packaging:tag: None 2023-10-14T12:06:00.726 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T12:06:00.726 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:06:00.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T12:06:00.948 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T12:06:00.948 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T12:06:00.955 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T12:06:00.955 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T12:06:00.979 INFO:teuthology.task.internal:Saving configuration 2023-10-14T12:06:00.996 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T12:06:01.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:06:01.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:00:42.514040', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:06:01.053 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:00:42.512854', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:06:01.053 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T12:06:01.059 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T12:06:01.060 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T12:06:01.060 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T12:06:01.148 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f261618eb80>, signals=[15]) 2023-10-14T12:06:01.149 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T12:06:01.156 INFO:teuthology.task.internal:Opening connections... 2023-10-14T12:06:01.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:06:01.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:06:01.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:06:01.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:06:01.297 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T12:06:01.303 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-10-14T12:06:01.325 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-10-14T12:06:01.326 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-14T12:06:01.386 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T12:06:01.386 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T12:06:01.386 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-10-14T12:06:01.387 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-10-14T12:06:01.387 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-10-14T12:06:01.387 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-10-14T12:06:01.387 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T12:06:01.387 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-10-14T12:06:01.388 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T12:06:01.388 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T12:06:01.388 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T12:06:01.388 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T12:06:01.388 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:06:01.389 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T12:06:01.389 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T12:06:01.389 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T12:06:01.389 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T12:06:01.390 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-14T12:06:01.418 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-14T12:06:01.441 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-14T12:06:01.441 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-14T12:06:01.499 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T12:06:01.499 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T12:06:01.500 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-10-14T12:06:01.500 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-10-14T12:06:01.500 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-10-14T12:06:01.500 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-14T12:06:01.500 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T12:06:01.501 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-14T12:06:01.501 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T12:06:01.501 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T12:06:01.501 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T12:06:01.502 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T12:06:01.502 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:06:01.502 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T12:06:01.502 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T12:06:01.502 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T12:06:01.503 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T12:06:01.503 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-14T12:06:01.526 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T12:06:01.536 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T12:06:01.555 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T12:06:01.555 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2023-10-14T12:06:01.558 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-10-14T12:06:01.577 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T12:06:01.584 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T12:06:01.584 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2023-10-14T12:06:01.618 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-10-14T12:06:01.643 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T12:06:01.705 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T12:06:01.719 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T12:06:01.720 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-14T12:06:01.721 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-14T12:06:01.721 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T12:06:01.722 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T12:06:01.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:06:01.741 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-10-14T12:06:01.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:06:01.743 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-10-14T12:06:01.801 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:01.801 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:01.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-10-14T12:06:01.803 INFO:teuthology.orchestra.run.smithi032.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:01.804 INFO:teuthology.task.kernel:Running kernel on smithi032: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:01.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum install -y kernel 2023-10-14T12:06:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-10-14T12:06:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:Unable to read consumer identity 2023-10-14T12:06:03.007 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-14T12:06:03.007 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-10-14T12:06:04.355 INFO:teuthology.orchestra.run.smithi032.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-14T12:06:04.441 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-14T12:06:05.398 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-14T12:06:05.492 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-14T12:06:09.042 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 340 kB/s | 24 kB 00:00 2023-10-14T12:06:09.206 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-10-14T12:06:09.719 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T12:06:09.770 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-14T12:06:09.772 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-10-14T12:06:09.772 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-14T12:06:09.881 DEBUG:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2023-10-14T12:06:09.959 INFO:teuthology.orchestra.run.smithi032.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T12:06:10.016 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-10-14T12:06:10.017 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2023-10-14T12:06:10.017 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-10-14T12:06:10.138 DEBUG:teuthology.orchestra.run.smithi032:> echo no | sudo yum reinstall kernel || true 2023-10-14T12:06:10.249 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-14T12:06:10.249 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-10-14T12:06:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 12:06:08 PM UTC. 2023-10-14T12:06:10.528 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-10-14T12:06:10.528 INFO:teuthology.orchestra.run.smithi032.stdout:Unable to read consumer identity 2023-10-14T12:06:10.555 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:06:10.595 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-10-14T12:06:10.642 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2023-10-14T12:06:10.806 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 12:06:09 PM UTC. 2023-10-14T12:06:10.853 INFO:teuthology.orchestra.run.smithi032.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:06:10.893 INFO:teuthology.orchestra.run.smithi032.stderr:Error: No packages marked for reinstall. 2023-10-14T12:06:10.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum reinstall -y kernel || true 2023-10-14T12:06:10.968 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-14T12:06:10.969 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-10-14T12:06:11.223 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:03 ago on Sat 14 Oct 2023 12:06:08 PM UTC. 2023-10-14T12:06:11.262 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:06:11.286 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-10-14T12:06:11.290 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-10-14T12:06:11.290 INFO:teuthology.orchestra.run.smithi032.stdout:Unable to read consumer identity 2023-10-14T12:06:11.331 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T12:06:11.411 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:11.411 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:11.412 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T12:06:11.412 DEBUG:teuthology.parallel:result is None 2023-10-14T12:06:11.558 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 12:06:09 PM UTC. 2023-10-14T12:06:11.600 INFO:teuthology.orchestra.run.smithi032.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:06:11.625 INFO:teuthology.orchestra.run.smithi032.stderr:Error: No packages marked for reinstall. 2023-10-14T12:06:11.671 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T12:06:11.754 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:11.754 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:06:11.754 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T12:06:11.755 DEBUG:teuthology.parallel:result is None 2023-10-14T12:06:11.755 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T12:06:11.762 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T12:06:11.763 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T12:06:11.766 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T12:06:11.784 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T12:06:11.918 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T12:06:11.947 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T12:06:11.948 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T12:06:11.951 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T12:06:11.981 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T12:06:11.989 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T12:06:11.989 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T12:06:12.019 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T12:06:12.055 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:06:12.074 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:06:12.083 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:06:12.094 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:06:12.096 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T12:06:12.104 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T12:06:12.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T12:06:12.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T12:06:12.145 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T12:06:12.154 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T12:06:12.155 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T12:06:12.186 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T12:06:12.203 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:06:12.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:06:12.350 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:06:12.395 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:06:12.437 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:06:12.437 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T12:06:12.504 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:06:12.548 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:06:12.597 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:06:12.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:06:12.723 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:06:12.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T12:06:12.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2023-10-14T12:06:12.793 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-10-14T12:06:12.882 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:06:12.890 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:06:13.304 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T12:06:13.313 INFO:teuthology.task.internal:Starting timer... 2023-10-14T12:06:13.313 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T12:06:13.342 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T12:06:13.358 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T12:06:13.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo service auditd rotate 2023-10-14T12:06:13.425 INFO:teuthology.orchestra.run.smithi032.stdout:Rotating logs: 2023-10-14T12:06:13.427 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-10-14T12:06:13.485 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-10-14T12:06:13.487 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T12:06:13.487 DEBUG:teuthology.orchestra.run.smithi032:> /usr/sbin/getenforce 2023-10-14T12:06:13.511 INFO:teuthology.orchestra.run.smithi032.stdout:Permissive 2023-10-14T12:06:13.512 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-10-14T12:06:13.532 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-10-14T12:06:13.532 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi032.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2023-10-14T12:06:13.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:06:13.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:06:13.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:06:13.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:06:13.607 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T12:06:13.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo /usr/sbin/setenforce permissive 2023-10-14T12:06:13.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-10-14T12:06:13.689 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T12:06:13.699 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-14T12:06:13.704 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-14T12:06:13.844 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T12:06:13.860 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T12:06:13.861 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T12:15:37.906 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2023-10-14T12:15:37.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-14T12:15:37.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:15:37.979 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-10-14T12:15:38.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-14T12:15:38.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T12:15:38.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:15:38.123 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-14T12:15:38.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T12:15:38.148 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T12:15:38.162 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T12:15:38.162 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T12:15:38.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:15:38.165 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T12:15:38.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:15:38.200 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T12:15:38.217 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T12:15:38.220 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T12:15:38.234 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T12:15:38.287 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: ntpd: command not found 2023-10-14T12:15:38.298 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-10-14T12:15:38.300 INFO:teuthology.orchestra.run.smithi032.stdout:506 Cannot talk to daemon 2023-10-14T12:15:38.309 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-10-14T12:15:38.315 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T12:15:38.324 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T12:15:38.330 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T12:15:38.338 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T12:15:38.408 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-14T12:15:38.410 INFO:teuthology.orchestra.run.smithi032.stderr:bash: ntpq: command not found 2023-10-14T12:15:38.412 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:15:38.412 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-14T12:15:38.412 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.412 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.413 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.413 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.415 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:15:38.415 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2023-10-14T12:15:38.415 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.415 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.415 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.416 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:15:38.416 INFO:teuthology.run_tasks:Running task install... 2023-10-14T12:15:38.425 DEBUG:teuthology.task.install:project ceph 2023-10-14T12:15:38.425 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T12:15:38.426 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T12:15:38.426 INFO:teuthology.task.install:Using flavor: default 2023-10-14T12:15:38.432 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T12:15:38.433 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T12:15:38.433 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T12:15:38.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:15:38.436 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T12:15:38.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:15:38.584 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T12:15:38.585 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T12:15:38.685 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T12:15:38.685 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T12:15:38.809 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T12:15:38.809 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:15:38.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T12:15:38.837 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T12:15:38.838 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T12:15:38.905 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T12:15:38.923 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T12:15:38.923 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:15:38.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T12:15:38.957 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T12:15:38.958 DEBUG:teuthology.orchestra.run.smithi032:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T12:15:38.982 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T12:15:39.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T12:15:39.048 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-10-14T12:15:39.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-10-14T12:15:39.112 DEBUG:teuthology.orchestra.run.smithi032:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T12:15:39.180 INFO:teuthology.orchestra.run.smithi032.stdout:check_obsoletes = 1 2023-10-14T12:15:39.182 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum clean all 2023-10-14T12:15:39.421 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-14T12:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-10-14T12:15:39.672 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-10-14T12:15:39.718 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T12:15:39.809 INFO:teuthology.orchestra.run.smithi032.stdout:44 files removed 2023-10-14T12:15:39.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T12:15:40.047 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-10-14T12:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-10-14T12:15:40.755 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 217 kB/s | 81 kB 00:00 2023-10-14T12:15:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:ceph packages for x86_64 207 kB/s | 81 kB 00:00 2023-10-14T12:15:41.160 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-14T12:15:41.485 INFO:teuthology.orchestra.run.smithi032.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-10-14T12:15:41.564 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-14T12:15:41.715 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-14T12:15:41.778 INFO:teuthology.orchestra.run.smithi032.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-10-14T12:15:41.936 INFO:teuthology.orchestra.run.smithi032.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-14T12:15:42.545 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-14T12:15:43.207 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-14T12:15:46.288 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 412 kB/s | 24 kB 00:00 2023-10-14T12:15:46.641 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 573 kB/s | 24 kB 00:00 2023-10-14T12:15:47.223 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-14T12:15:47.534 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-10-14T12:15:55.526 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-14T12:15:55.573 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-10-14T12:16:06.648 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:16:06.649 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:16:06.664 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T12:16:06.665 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T12:16:06.666 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T12:16:06.667 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T12:16:06.669 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T12:16:06.673 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T12:16:06.674 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T12:16:06.803 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-14T12:16:06.816 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-14T12:16:06.816 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-14T12:16:06.816 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-14T12:16:06.817 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-14T12:16:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T12:16:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T12:16:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T12:16:06.817 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T12:16:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T12:16:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T12:16:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T12:16:06.818 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T12:16:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T12:16:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T12:16:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T12:16:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T12:16:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T12:16:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T12:16:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T12:16:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T12:16:06.820 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T12:16:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T12:16:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T12:16:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T12:16:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T12:16:06.821 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T12:16:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T12:16:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T12:16:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T12:16:06.822 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T12:16:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T12:16:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T12:16:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T12:16:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T12:16:06.823 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T12:16:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T12:16:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T12:16:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T12:16:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T12:16:06.824 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T12:16:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T12:16:06.825 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-14T12:16:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T12:16:06.825 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:16:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:16:06.826 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-14T12:16:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T12:16:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T12:16:06.826 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T12:16:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T12:16:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T12:16:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T12:16:06.827 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T12:16:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T12:16:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T12:16:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T12:16:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T12:16:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T12:16:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T12:16:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T12:16:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T12:16:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T12:16:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T12:16:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T12:16:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T12:16:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T12:16:06.830 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T12:16:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T12:16:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T12:16:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T12:16:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T12:16:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T12:16:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T12:16:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T12:16:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T12:16:06.832 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T12:16:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T12:16:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T12:16:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T12:16:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T12:16:06.833 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T12:16:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T12:16:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T12:16:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T12:16:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T12:16:06.834 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T12:16:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T12:16:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T12:16:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T12:16:06.835 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T12:16:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T12:16:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T12:16:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T12:16:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T12:16:06.836 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T12:16:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T12:16:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T12:16:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T12:16:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T12:16:06.837 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:16:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T12:16:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T12:16:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T12:16:06.838 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T12:16:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T12:16:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T12:16:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T12:16:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T12:16:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T12:16:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T12:16:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T12:16:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T12:16:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T12:16:06.840 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T12:16:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T12:16:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T12:16:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T12:16:06.841 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T12:16:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:16:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T12:16:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T12:16:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T12:16:06.842 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T12:16:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T12:16:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T12:16:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T12:16:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T12:16:06.843 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T12:16:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T12:16:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T12:16:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T12:16:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T12:16:06.844 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T12:16:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T12:16:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T12:16:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T12:16:06.845 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T12:16:06.846 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-10-14T12:16:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql 10 2023-10-14T12:16:06.846 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:16:06.846 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-14T12:16:06.846 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-10-14T12:16:06.847 INFO:teuthology.orchestra.run.smithi092.stdout:Install 128 Packages 2023-10-14T12:16:06.847 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 3 Packages 2023-10-14T12:16:06.847 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:16:06.848 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 209 M 2023-10-14T12:16:06.849 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-14T12:16:06.992 INFO:teuthology.orchestra.run.smithi092.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-10-14T12:16:07.225 INFO:teuthology.orchestra.run.smithi092.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 3.8 MB/s | 918 kB 00:00 2023-10-14T12:16:07.309 INFO:teuthology.orchestra.run.smithi092.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.0 MB/s | 167 kB 00:00 2023-10-14T12:16:07.415 INFO:teuthology.orchestra.run.smithi032.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:16:07.417 INFO:teuthology.orchestra.run.smithi032.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:16:07.431 INFO:teuthology.orchestra.run.smithi032.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T12:16:07.432 INFO:teuthology.orchestra.run.smithi032.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T12:16:07.434 INFO:teuthology.orchestra.run.smithi032.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T12:16:07.435 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T12:16:07.437 INFO:teuthology.orchestra.run.smithi032.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T12:16:07.441 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T12:16:07.442 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T12:16:07.588 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-10-14T12:16:07.601 INFO:teuthology.orchestra.run.smithi032.stdout:=========================================================================================================================== 2023-10-14T12:16:07.602 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2023-10-14T12:16:07.602 INFO:teuthology.orchestra.run.smithi032.stdout:=========================================================================================================================== 2023-10-14T12:16:07.603 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2023-10-14T12:16:07.603 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T12:16:07.603 INFO:teuthology.orchestra.run.smithi032.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T12:16:07.603 INFO:teuthology.orchestra.run.smithi032.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T12:16:07.603 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T12:16:07.604 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T12:16:07.604 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T12:16:07.604 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T12:16:07.604 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T12:16:07.604 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T12:16:07.605 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T12:16:07.605 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T12:16:07.605 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T12:16:07.605 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T12:16:07.605 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T12:16:07.606 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T12:16:07.606 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T12:16:07.606 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T12:16:07.606 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T12:16:07.607 INFO:teuthology.orchestra.run.smithi032.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T12:16:07.607 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T12:16:07.607 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T12:16:07.607 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T12:16:07.607 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T12:16:07.608 INFO:teuthology.orchestra.run.smithi032.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T12:16:07.608 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T12:16:07.608 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T12:16:07.608 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T12:16:07.608 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T12:16:07.609 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T12:16:07.609 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T12:16:07.609 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T12:16:07.609 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T12:16:07.610 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T12:16:07.610 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T12:16:07.610 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T12:16:07.610 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T12:16:07.610 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T12:16:07.611 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2023-10-14T12:16:07.611 INFO:teuthology.orchestra.run.smithi032.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T12:16:07.611 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:16:07.611 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:16:07.611 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2023-10-14T12:16:07.612 INFO:teuthology.orchestra.run.smithi032.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T12:16:07.612 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T12:16:07.612 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T12:16:07.612 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T12:16:07.613 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T12:16:07.613 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T12:16:07.613 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T12:16:07.613 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T12:16:07.613 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T12:16:07.614 INFO:teuthology.orchestra.run.smithi032.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T12:16:07.614 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T12:16:07.614 INFO:teuthology.orchestra.run.smithi032.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T12:16:07.614 INFO:teuthology.orchestra.run.smithi032.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T12:16:07.614 INFO:teuthology.orchestra.run.smithi032.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T12:16:07.615 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T12:16:07.615 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T12:16:07.615 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T12:16:07.615 INFO:teuthology.orchestra.run.smithi032.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T12:16:07.615 INFO:teuthology.orchestra.run.smithi032.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T12:16:07.616 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T12:16:07.616 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T12:16:07.616 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T12:16:07.616 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T12:16:07.617 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T12:16:07.617 INFO:teuthology.orchestra.run.smithi032.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T12:16:07.617 INFO:teuthology.orchestra.run.smithi032.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T12:16:07.617 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T12:16:07.617 INFO:teuthology.orchestra.run.smithi032.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T12:16:07.617 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T12:16:07.618 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T12:16:07.618 INFO:teuthology.orchestra.run.smithi032.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T12:16:07.618 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T12:16:07.618 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T12:16:07.618 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T12:16:07.619 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T12:16:07.619 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T12:16:07.619 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T12:16:07.619 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T12:16:07.620 INFO:teuthology.orchestra.run.smithi032.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T12:16:07.620 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T12:16:07.620 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T12:16:07.620 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T12:16:07.621 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T12:16:07.621 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T12:16:07.621 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T12:16:07.621 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T12:16:07.621 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T12:16:07.622 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T12:16:07.622 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T12:16:07.622 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T12:16:07.622 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T12:16:07.623 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T12:16:07.623 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T12:16:07.623 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:16:07.623 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T12:16:07.623 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T12:16:07.624 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T12:16:07.624 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T12:16:07.624 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T12:16:07.624 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T12:16:07.624 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T12:16:07.625 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T12:16:07.625 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T12:16:07.625 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T12:16:07.625 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T12:16:07.625 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T12:16:07.626 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T12:16:07.626 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T12:16:07.626 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T12:16:07.626 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T12:16:07.627 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T12:16:07.627 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T12:16:07.627 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:16:07.627 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T12:16:07.628 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T12:16:07.628 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T12:16:07.628 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T12:16:07.628 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T12:16:07.629 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T12:16:07.629 INFO:teuthology.orchestra.run.smithi032.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T12:16:07.629 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T12:16:07.629 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T12:16:07.629 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T12:16:07.630 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T12:16:07.630 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T12:16:07.630 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T12:16:07.630 INFO:teuthology.orchestra.run.smithi032.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T12:16:07.630 INFO:teuthology.orchestra.run.smithi032.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T12:16:07.631 INFO:teuthology.orchestra.run.smithi032.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T12:16:07.631 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T12:16:07.631 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T12:16:07.631 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling module streams: 2023-10-14T12:16:07.631 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql 10 2023-10-14T12:16:07.632 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:16:07.632 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-10-14T12:16:07.632 INFO:teuthology.orchestra.run.smithi032.stdout:=========================================================================================================================== 2023-10-14T12:16:07.632 INFO:teuthology.orchestra.run.smithi032.stdout:Install 128 Packages 2023-10-14T12:16:07.632 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 3 Packages 2023-10-14T12:16:07.633 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:16:07.633 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 209 M 2023-10-14T12:16:07.634 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2023-10-14T12:16:07.826 INFO:teuthology.orchestra.run.smithi092.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-10-14T12:16:08.191 INFO:teuthology.orchestra.run.smithi032.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-10-14T12:16:08.343 INFO:teuthology.orchestra.run.smithi092.stdout:(5/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 15 MB/s | 23 MB 00:01 2023-10-14T12:16:08.510 INFO:teuthology.orchestra.run.smithi092.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 2.4 MB/s | 1.6 MB 00:00 2023-10-14T12:16:08.557 INFO:teuthology.orchestra.run.smithi032.stdout:(2/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 9.1 MB/s | 5.4 MB 00:00 2023-10-14T12:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 1.8 MB/s | 167 kB 00:00 2023-10-14T12:16:08.860 INFO:teuthology.orchestra.run.smithi092.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 8.9 MB/s | 4.6 MB 00:00 2023-10-14T12:16:08.935 INFO:teuthology.orchestra.run.smithi092.stdout:(8/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 2.6 MB/s | 5.4 MB 00:02 2023-10-14T12:16:08.975 INFO:teuthology.orchestra.run.smithi032.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 7.1 MB/s | 2.3 MB 00:00 2023-10-14T12:16:09.027 INFO:teuthology.orchestra.run.smithi092.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 265 kB/s | 24 kB 00:00 2023-10-14T12:16:09.050 INFO:teuthology.orchestra.run.smithi032.stdout:(5/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-14T12:16:09.367 INFO:teuthology.orchestra.run.smithi032.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 4.1 MB/s | 1.6 MB 00:00 2023-10-14T12:16:10.527 INFO:teuthology.orchestra.run.smithi092.stdout:(10/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 8.3 MB/s | 14 MB 00:01 2023-10-14T12:16:10.628 INFO:teuthology.orchestra.run.smithi092.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.6 MB/s | 261 kB 00:00 2023-10-14T12:16:10.736 INFO:teuthology.orchestra.run.smithi092.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 286 kB/s | 31 kB 00:00 2023-10-14T12:16:11.003 INFO:teuthology.orchestra.run.smithi092.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 3.1 MB/s | 839 kB 00:00 2023-10-14T12:16:11.086 INFO:teuthology.orchestra.run.smithi092.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.2 MB/s | 184 kB 00:00 2023-10-14T12:16:11.208 INFO:teuthology.orchestra.run.smithi092.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.1 MB/s | 139 kB 00:00 2023-10-14T12:16:11.512 INFO:teuthology.orchestra.run.smithi092.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 1.7 MB/s | 518 kB 00:00 2023-10-14T12:16:11.850 INFO:teuthology.orchestra.run.smithi032.stdout:(7/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 5.8 MB/s | 23 MB 00:03 2023-10-14T12:16:12.851 INFO:teuthology.orchestra.run.smithi032.stdout:(8/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 1.2 MB/s | 4.6 MB 00:03 2023-10-14T12:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 225 kB/s | 24 kB 00:00 2023-10-14T12:16:13.251 INFO:teuthology.orchestra.run.smithi032.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 4.6 MB/s | 18 MB 00:03 2023-10-14T12:16:13.320 INFO:teuthology.orchestra.run.smithi092.stdout:(17/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 3.7 MB/s | 18 MB 00:04 2023-10-14T12:16:13.393 INFO:teuthology.orchestra.run.smithi032.stdout:(11/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 9.0 MB/s | 14 MB 00:01 2023-10-14T12:16:13.412 INFO:teuthology.orchestra.run.smithi092.stdout:(18/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 3.6 MB/s | 6.9 MB 00:01 2023-10-14T12:16:13.418 INFO:teuthology.orchestra.run.smithi032.stdout:(12/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.5 MB/s | 261 kB 00:00 2023-10-14T12:16:13.438 INFO:teuthology.orchestra.run.smithi092.stdout:(19/131): python3-ceph-argparse-18.0.0-6730.g4b 383 kB/s | 45 kB 00:00 2023-10-14T12:16:13.460 INFO:teuthology.orchestra.run.smithi032.stdout:(13/131): libcephfs-devel-18.0.0-6730.g4ba8a190 466 kB/s | 31 kB 00:00 2023-10-14T12:16:13.463 INFO:teuthology.orchestra.run.smithi092.stdout:(20/131): python3-ceph-common-18.0.0-6730.g4ba8 2.4 MB/s | 126 kB 00:00 2023-10-14T12:16:13.497 INFO:teuthology.orchestra.run.smithi092.stdout:(21/131): python3-cephfs-18.0.0-6730.g4ba8a190. 3.3 MB/s | 197 kB 00:00 2023-10-14T12:16:13.527 INFO:teuthology.orchestra.run.smithi032.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.7 MB/s | 184 kB 00:00 2023-10-14T12:16:13.555 INFO:teuthology.orchestra.run.smithi092.stdout:(22/131): python3-rados-18.0.0-6730.g4ba8a190.e 4.0 MB/s | 371 kB 00:00 2023-10-14T12:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout:(15/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 5.8 MB/s | 839 kB 00:00 2023-10-14T12:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout:(16/131): librados-devel-18.0.0-6730.g4ba8a190. 2.7 MB/s | 139 kB 00:00 2023-10-14T12:16:13.614 INFO:teuthology.orchestra.run.smithi092.stdout:(23/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 3.1 MB/s | 365 kB 00:00 2023-10-14T12:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 5.1 MB/s | 518 kB 00:00 2023-10-14T12:16:13.671 INFO:teuthology.orchestra.run.smithi092.stdout:(24/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 917 kB/s | 107 kB 00:00 2023-10-14T12:16:13.697 INFO:teuthology.orchestra.run.smithi092.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.1 MB/s | 94 kB 00:00 2023-10-14T12:16:13.712 INFO:teuthology.orchestra.run.smithi032.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 891 kB/s | 45 kB 00:00 2023-10-14T12:16:13.773 INFO:teuthology.orchestra.run.smithi092.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.3 MB/s | 179 kB 00:00 2023-10-14T12:16:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.3 MB/s | 126 kB 00:00 2023-10-14T12:16:13.891 INFO:teuthology.orchestra.run.smithi032.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.3 MB/s | 197 kB 00:00 2023-10-14T12:16:13.923 INFO:teuthology.orchestra.run.smithi092.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 155 kB/s | 23 kB 00:00 2023-10-14T12:16:14.015 INFO:teuthology.orchestra.run.smithi092.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.4 MB/s | 132 kB 00:00 2023-10-14T12:16:14.021 INFO:teuthology.orchestra.run.smithi032.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.7 MB/s | 371 kB 00:00 2023-10-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi032.stdout:(22/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 12 MB/s | 6.9 MB 00:00 2023-10-14T12:16:14.197 INFO:teuthology.orchestra.run.smithi032.stdout:(23/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.0 MB/s | 365 kB 00:00 2023-10-14T12:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout:(24/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 747 kB/s | 107 kB 00:00 2023-10-14T12:16:14.349 INFO:teuthology.orchestra.run.smithi092.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 5.3 MB/s | 1.8 MB 00:00 2023-10-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi032.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 487 kB/s | 94 kB 00:00 2023-10-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi092.stdout:(30/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 4.7 MB/s | 3.6 MB 00:00 2023-10-14T12:16:14.481 INFO:teuthology.orchestra.run.smithi032.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-14T12:16:14.556 INFO:teuthology.orchestra.run.smithi032.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 308 kB/s | 23 kB 00:00 2023-10-14T12:16:14.591 INFO:teuthology.orchestra.run.smithi092.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 1.6 MB/s | 242 kB 00:00 2023-10-14T12:16:14.615 INFO:teuthology.orchestra.run.smithi032.stdout:(28/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 12 MB/s | 3.6 MB 00:00 2023-10-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi032.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.5 MB/s | 132 kB 00:00 2023-10-14T12:16:14.667 INFO:teuthology.orchestra.run.smithi092.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 632 kB/s | 47 kB 00:00 2023-10-14T12:16:14.750 INFO:teuthology.orchestra.run.smithi092.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 180 kB/s | 15 kB 00:00 2023-10-14T12:16:14.791 INFO:teuthology.orchestra.run.smithi032.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 10 MB/s | 1.8 MB 00:00 2023-10-14T12:16:14.834 INFO:teuthology.orchestra.run.smithi092.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 3.1 MB/s | 261 kB 00:00 2023-10-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi032.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.4 MB/s | 242 kB 00:00 2023-10-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi092.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.8 MB/s | 192 kB 00:00 2023-10-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi032.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 814 kB/s | 47 kB 00:00 2023-10-14T12:16:14.959 INFO:teuthology.orchestra.run.smithi092.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 311 kB/s | 18 kB 00:00 2023-10-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi032.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 225 kB/s | 15 kB 00:00 2023-10-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi032.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.8 MB/s | 261 kB 00:00 2023-10-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi032.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.3 MB/s | 192 kB 00:00 2023-10-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi032.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 241 kB/s | 18 kB 00:00 2023-10-14T12:16:15.676 INFO:teuthology.orchestra.run.smithi032.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 7.2 MB/s | 7.4 MB 00:01 2023-10-14T12:16:15.693 INFO:teuthology.orchestra.run.smithi092.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-10-14T12:16:15.701 INFO:teuthology.orchestra.run.smithi032.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 707 kB/s | 306 kB 00:00 2023-10-14T12:16:15.718 INFO:teuthology.orchestra.run.smithi092.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 404 kB/s | 306 kB 00:00 2023-10-14T12:16:15.777 INFO:teuthology.orchestra.run.smithi032.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-10-14T12:16:15.885 INFO:teuthology.orchestra.run.smithi092.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 450 kB/s | 75 kB 00:00 2023-10-14T12:16:15.952 INFO:teuthology.orchestra.run.smithi032.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-10-14T12:16:15.977 INFO:teuthology.orchestra.run.smithi032.stdout:(41/131): liboath-2.6.2-3.el8.x86_64.rpm 196 kB/s | 59 kB 00:00 2023-10-14T12:16:16.027 INFO:teuthology.orchestra.run.smithi032.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2023-10-14T12:16:16.103 INFO:teuthology.orchestra.run.smithi032.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 440 kB/s | 33 kB 00:00 2023-10-14T12:16:16.128 INFO:teuthology.orchestra.run.smithi032.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-14T12:16:16.204 INFO:teuthology.orchestra.run.smithi032.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-10-14T12:16:16.220 INFO:teuthology.orchestra.run.smithi032.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-14T12:16:16.297 INFO:teuthology.orchestra.run.smithi032.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-14T12:16:16.329 INFO:teuthology.orchestra.run.smithi032.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-14T12:16:16.344 INFO:teuthology.orchestra.run.smithi092.stdout:(40/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 6.7 MB/s | 49 MB 00:07 2023-10-14T12:16:16.369 INFO:teuthology.orchestra.run.smithi092.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 984 kB/s | 476 kB 00:00 2023-10-14T12:16:16.371 INFO:teuthology.orchestra.run.smithi032.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-14T12:16:16.405 INFO:teuthology.orchestra.run.smithi032.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-10-14T12:16:16.480 INFO:teuthology.orchestra.run.smithi032.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2023-10-14T12:16:16.519 INFO:teuthology.orchestra.run.smithi092.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-14T12:16:16.564 INFO:teuthology.orchestra.run.smithi032.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 705 kB/s | 59 kB 00:00 2023-10-14T12:16:16.639 INFO:teuthology.orchestra.run.smithi032.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 804 kB/s | 60 kB 00:00 2023-10-14T12:16:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-10-14T12:16:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:(44/131): liboath-2.6.2-3.el8.x86_64.rpm 60 kB/s | 59 kB 00:00 2023-10-14T12:16:16.731 INFO:teuthology.orchestra.run.smithi032.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-10-14T12:16:16.791 INFO:teuthology.orchestra.run.smithi092.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 112 kB/s | 16 kB 00:00 2023-10-14T12:16:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-10-14T12:16:16.815 INFO:teuthology.orchestra.run.smithi032.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-10-14T12:16:16.837 INFO:teuthology.orchestra.run.smithi092.stdout:(46/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 89 kB/s | 44 kB 00:00 2023-10-14T12:16:16.865 INFO:teuthology.orchestra.run.smithi032.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 504 kB/s | 34 kB 00:00 2023-10-14T12:16:16.891 INFO:teuthology.orchestra.run.smithi032.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-14T12:16:16.941 INFO:teuthology.orchestra.run.smithi032.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 855 kB/s | 64 kB 00:00 2023-10-14T12:16:16.954 INFO:teuthology.orchestra.run.smithi092.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2023-10-14T12:16:16.958 INFO:teuthology.orchestra.run.smithi032.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-10-14T12:16:16.979 INFO:teuthology.orchestra.run.smithi092.stdout:(48/131): python3-cheroot-8.5.2-1.el8.noarch.rp 558 kB/s | 173 kB 00:00 2023-10-14T12:16:17.008 INFO:teuthology.orchestra.run.smithi032.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 358 kB/s | 24 kB 00:00 2023-10-14T12:16:17.025 INFO:teuthology.orchestra.run.smithi032.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 437 kB/s | 29 kB 00:00 2023-10-14T12:16:17.071 INFO:teuthology.orchestra.run.smithi092.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-14T12:16:17.075 INFO:teuthology.orchestra.run.smithi032.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 411 kB/s | 27 kB 00:00 2023-10-14T12:16:17.096 INFO:teuthology.orchestra.run.smithi092.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 314 kB/s | 81 kB 00:00 2023-10-14T12:16:17.122 INFO:teuthology.orchestra.run.smithi092.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 123 kB/s | 18 kB 00:00 2023-10-14T12:16:17.151 INFO:teuthology.orchestra.run.smithi032.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-14T12:16:17.226 INFO:teuthology.orchestra.run.smithi032.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-10-14T12:16:17.243 INFO:teuthology.orchestra.run.smithi032.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 668 kB/s | 61 kB 00:00 2023-10-14T12:16:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 324 kB/s | 49 kB 00:00 2023-10-14T12:16:17.294 INFO:teuthology.orchestra.run.smithi092.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 342 kB/s | 59 kB 00:00 2023-10-14T12:16:17.302 INFO:teuthology.orchestra.run.smithi032.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-14T12:16:17.318 INFO:teuthology.orchestra.run.smithi032.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-10-14T12:16:17.344 INFO:teuthology.orchestra.run.smithi032.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-14T12:16:17.356 INFO:teuthology.orchestra.run.smithi092.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 4.1 MB/s | 1.2 MB 00:00 2023-10-14T12:16:17.406 INFO:teuthology.orchestra.run.smithi092.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 380 kB/s | 60 kB 00:00 2023-10-14T12:16:17.473 INFO:teuthology.orchestra.run.smithi092.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-14T12:16:17.532 INFO:teuthology.orchestra.run.smithi092.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-10-14T12:16:17.549 INFO:teuthology.orchestra.run.smithi092.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 237 kB/s | 34 kB 00:00 2023-10-14T12:16:17.600 INFO:teuthology.orchestra.run.smithi092.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-14T12:16:17.666 INFO:teuthology.orchestra.run.smithi092.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 479 kB/s | 64 kB 00:00 2023-10-14T12:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 41 MB/s | 14 MB 00:00 2023-10-14T12:16:17.683 INFO:teuthology.orchestra.run.smithi092.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 140 kB/s | 19 kB 00:00 2023-10-14T12:16:17.708 INFO:teuthology.orchestra.run.smithi092.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 219 kB/s | 24 kB 00:00 2023-10-14T12:16:17.711 INFO:teuthology.orchestra.run.smithi032.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-10-14T12:16:17.745 INFO:teuthology.orchestra.run.smithi032.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-10-14T12:16:17.789 INFO:teuthology.orchestra.run.smithi032.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.8 MB/s | 259 kB 00:00 2023-10-14T12:16:17.809 INFO:teuthology.orchestra.run.smithi092.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 206 kB/s | 29 kB 00:00 2023-10-14T12:16:17.825 INFO:teuthology.orchestra.run.smithi092.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 193 kB/s | 27 kB 00:00 2023-10-14T12:16:17.831 INFO:teuthology.orchestra.run.smithi032.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-10-14T12:16:17.851 INFO:teuthology.orchestra.run.smithi092.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.8 MB/s | 255 kB 00:00 2023-10-14T12:16:17.873 INFO:teuthology.orchestra.run.smithi032.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-10-14T12:16:17.923 INFO:teuthology.orchestra.run.smithi032.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 422 kB/s | 39 kB 00:00 2023-10-14T12:16:17.965 INFO:teuthology.orchestra.run.smithi032.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 8.0 MB/s | 688 kB 00:00 2023-10-14T12:16:17.968 INFO:teuthology.orchestra.run.smithi092.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-10-14T12:16:17.985 INFO:teuthology.orchestra.run.smithi092.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 385 kB/s | 61 kB 00:00 2023-10-14T12:16:17.999 INFO:teuthology.orchestra.run.smithi032.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-10-14T12:16:18.010 INFO:teuthology.orchestra.run.smithi092.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 538 kB/s | 85 kB 00:00 2023-10-14T12:16:18.024 INFO:teuthology.orchestra.run.smithi032.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-14T12:16:18.027 INFO:teuthology.orchestra.run.smithi092.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-14T12:16:18.049 INFO:teuthology.orchestra.run.smithi032.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-14T12:16:18.083 INFO:teuthology.orchestra.run.smithi032.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-14T12:16:18.085 INFO:teuthology.orchestra.run.smithi092.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-10-14T12:16:18.125 INFO:teuthology.orchestra.run.smithi032.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 636 kB/s | 27 kB 00:00 2023-10-14T12:16:18.136 INFO:teuthology.orchestra.run.smithi092.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-10-14T12:16:18.167 INFO:teuthology.orchestra.run.smithi032.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-14T12:16:18.177 INFO:teuthology.orchestra.run.smithi092.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-14T12:16:18.219 INFO:teuthology.orchestra.run.smithi092.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-14T12:16:18.228 INFO:teuthology.orchestra.run.smithi032.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 724 kB/s | 44 kB 00:00 2023-10-14T12:16:18.291 INFO:teuthology.orchestra.run.smithi092.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.4 MB/s | 323 kB 00:00 2023-10-14T12:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-14T12:16:18.337 INFO:teuthology.orchestra.run.smithi092.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 862 kB/s | 39 kB 00:00 2023-10-14T12:16:18.351 INFO:teuthology.orchestra.run.smithi032.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-14T12:16:18.387 INFO:teuthology.orchestra.run.smithi092.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-10-14T12:16:18.393 INFO:teuthology.orchestra.run.smithi032.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-14T12:16:18.460 INFO:teuthology.orchestra.run.smithi032.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-10-14T12:16:18.485 INFO:teuthology.orchestra.run.smithi032.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 697 kB/s | 64 kB 00:00 2023-10-14T12:16:18.511 INFO:teuthology.orchestra.run.smithi032.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-14T12:16:18.528 INFO:teuthology.orchestra.run.smithi032.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 477 kB/s | 20 kB 00:00 2023-10-14T12:16:18.537 INFO:teuthology.orchestra.run.smithi092.stdout:(77/131): python3-scipy-1.0.0-21.module+el8.5.0 27 MB/s | 14 MB 00:00 2023-10-14T12:16:18.553 INFO:teuthology.orchestra.run.smithi032.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-10-14T12:16:18.587 INFO:teuthology.orchestra.run.smithi032.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-14T12:16:18.587 INFO:teuthology.orchestra.run.smithi092.stdout:(78/131): thrift-0.13.0-2.el8.x86_64.rpm 2.9 MB/s | 1.7 MB 00:00 2023-10-14T12:16:18.613 INFO:teuthology.orchestra.run.smithi092.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-10-14T12:16:18.620 INFO:teuthology.orchestra.run.smithi032.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 5.8 MB/s | 198 kB 00:00 2023-10-14T12:16:18.646 INFO:teuthology.orchestra.run.smithi092.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.0 MB/s | 538 kB 00:00 2023-10-14T12:16:18.672 INFO:teuthology.orchestra.run.smithi092.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-10-14T12:16:18.714 INFO:teuthology.orchestra.run.smithi092.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 7.3 MB/s | 713 kB 00:00 2023-10-14T12:16:18.737 INFO:teuthology.orchestra.run.smithi032.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 26 MB/s | 4.9 MB 00:00 2023-10-14T12:16:18.739 INFO:teuthology.orchestra.run.smithi092.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 397 kB/s | 27 kB 00:00 2023-10-14T12:16:18.779 INFO:teuthology.orchestra.run.smithi032.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-14T12:16:18.797 INFO:teuthology.orchestra.run.smithi092.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 3.7 MB/s | 320 kB 00:00 2023-10-14T12:16:18.823 INFO:teuthology.orchestra.run.smithi092.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 525 kB/s | 44 kB 00:00 2023-10-14T12:16:18.854 INFO:teuthology.orchestra.run.smithi032.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-10-14T12:16:18.873 INFO:teuthology.orchestra.run.smithi092.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-10-14T12:16:18.888 INFO:teuthology.orchestra.run.smithi032.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-10-14T12:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-10-14T12:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout:(100/131): postgresql-server-10.21-2.module+el8 26 MB/s | 5.1 MB 00:00 2023-10-14T12:16:19.089 INFO:teuthology.orchestra.run.smithi032.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-14T12:16:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 701 kB/s | 47 kB 00:00 2023-10-14T12:16:19.140 INFO:teuthology.orchestra.run.smithi032.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-10-14T12:16:19.165 INFO:teuthology.orchestra.run.smithi032.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 844 kB/s | 43 kB 00:00 2023-10-14T12:16:19.174 INFO:teuthology.orchestra.run.smithi092.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 751 kB/s | 225 kB 00:00 2023-10-14T12:16:19.191 INFO:teuthology.orchestra.run.smithi032.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-14T12:16:19.216 INFO:teuthology.orchestra.run.smithi032.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-10-14T12:16:19.258 INFO:teuthology.orchestra.run.smithi032.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-10-14T12:16:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 8.0 MB/s | 3.7 MB 00:00 2023-10-14T12:16:19.283 INFO:teuthology.orchestra.run.smithi032.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 639 kB/s | 43 kB 00:00 2023-10-14T12:16:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 510 kB/s | 64 kB 00:00 2023-10-14T12:16:19.308 INFO:teuthology.orchestra.run.smithi032.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-14T12:16:19.334 INFO:teuthology.orchestra.run.smithi032.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-14T12:16:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:(90/131): python3-babel-2.5.1-7.el8.noarch.rpm 6.7 MB/s | 4.8 MB 00:00 2023-10-14T12:16:19.383 INFO:teuthology.orchestra.run.smithi092.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 239 kB/s | 20 kB 00:00 2023-10-14T12:16:19.408 INFO:teuthology.orchestra.run.smithi092.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 879 kB/s | 126 kB 00:00 2023-10-14T12:16:19.434 INFO:teuthology.orchestra.run.smithi092.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-10-14T12:16:19.467 INFO:teuthology.orchestra.run.smithi092.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-10-14T12:16:19.492 INFO:teuthology.orchestra.run.smithi092.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-14T12:16:19.534 INFO:teuthology.orchestra.run.smithi092.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-14T12:16:19.542 INFO:teuthology.orchestra.run.smithi032.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.3 MB/s | 560 kB 00:00 2023-10-14T12:16:19.586 INFO:teuthology.orchestra.run.smithi092.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-14T12:16:19.652 INFO:teuthology.orchestra.run.smithi032.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 59 kB/s | 19 kB 00:00 2023-10-14T12:16:19.668 INFO:teuthology.orchestra.run.smithi092.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-10-14T12:16:19.677 INFO:teuthology.orchestra.run.smithi032.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2023-10-14T12:16:19.710 INFO:teuthology.orchestra.run.smithi032.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.4 MB/s | 559 kB 00:00 2023-10-14T12:16:19.727 INFO:teuthology.orchestra.run.smithi032.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-10-14T12:16:19.761 INFO:teuthology.orchestra.run.smithi032.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-10-14T12:16:19.775 INFO:teuthology.orchestra.run.smithi092.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-10-14T12:16:19.786 INFO:teuthology.orchestra.run.smithi032.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-14T12:16:19.819 INFO:teuthology.orchestra.run.smithi092.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.3 MB/s | 808 kB 00:00 2023-10-14T12:16:19.836 INFO:teuthology.orchestra.run.smithi032.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-14T12:16:19.861 INFO:teuthology.orchestra.run.smithi092.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-14T12:16:19.895 INFO:teuthology.orchestra.run.smithi032.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 17 MB/s | 2.3 MB 00:00 2023-10-14T12:16:19.903 INFO:teuthology.orchestra.run.smithi092.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-14T12:16:19.920 INFO:teuthology.orchestra.run.smithi032.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 989 kB/s | 83 kB 00:00 2023-10-14T12:16:19.928 INFO:teuthology.orchestra.run.smithi092.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-14T12:16:19.937 INFO:teuthology.orchestra.run.smithi032.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-14T12:16:19.945 INFO:teuthology.orchestra.run.smithi092.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-14T12:16:19.962 INFO:teuthology.orchestra.run.smithi092.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.4 MB/s | 220 kB 00:00 2023-10-14T12:16:19.963 INFO:teuthology.orchestra.run.smithi032.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-10-14T12:16:19.979 INFO:teuthology.orchestra.run.smithi092.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.4 MB/s | 48 kB 00:00 2023-10-14T12:16:19.979 INFO:teuthology.orchestra.run.smithi032.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.4 MB/s | 58 kB 00:00 2023-10-14T12:16:19.996 INFO:teuthology.orchestra.run.smithi032.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-10-14T12:16:20.004 INFO:teuthology.orchestra.run.smithi092.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-14T12:16:20.021 INFO:teuthology.orchestra.run.smithi092.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-10-14T12:16:20.039 INFO:teuthology.orchestra.run.smithi032.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-14T12:16:20.046 INFO:teuthology.orchestra.run.smithi092.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-10-14T12:16:20.064 INFO:teuthology.orchestra.run.smithi032.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-14T12:16:20.072 INFO:teuthology.orchestra.run.smithi092.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-10-14T12:16:20.090 INFO:teuthology.orchestra.run.smithi032.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-14T12:16:20.105 INFO:teuthology.orchestra.run.smithi092.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-10-14T12:16:20.131 INFO:teuthology.orchestra.run.smithi092.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 320 kB/s | 19 kB 00:00 2023-10-14T12:16:20.156 INFO:teuthology.orchestra.run.smithi092.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-14T12:16:20.223 INFO:teuthology.orchestra.run.smithi092.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.9 MB/s | 5.1 MB 00:00 2023-10-14T12:16:20.278 INFO:teuthology.orchestra.run.smithi092.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 146 kB/s | 18 kB 00:00 2023-10-14T12:16:20.315 INFO:teuthology.orchestra.run.smithi092.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.0 MB/s | 559 kB 00:00 2023-10-14T12:16:20.340 INFO:teuthology.orchestra.run.smithi092.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.8 MB/s | 238 kB 00:00 2023-10-14T12:16:20.374 INFO:teuthology.orchestra.run.smithi092.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-10-14T12:16:20.399 INFO:teuthology.orchestra.run.smithi092.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-14T12:16:20.425 INFO:teuthology.orchestra.run.smithi092.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-14T12:16:20.450 INFO:teuthology.orchestra.run.smithi092.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-14T12:16:20.475 INFO:teuthology.orchestra.run.smithi092.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-14T12:16:20.500 INFO:teuthology.orchestra.run.smithi092.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-14T12:16:20.526 INFO:teuthology.orchestra.run.smithi092.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-10-14T12:16:20.548 INFO:teuthology.orchestra.run.smithi032.stdout:(128/131): librados2-18.0.0-6730.g4ba8a190.el8. 7.7 MB/s | 3.7 MB 00:00 2023-10-14T12:16:20.559 INFO:teuthology.orchestra.run.smithi092.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-14T12:16:20.585 INFO:teuthology.orchestra.run.smithi092.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-14T12:16:20.598 INFO:teuthology.orchestra.run.smithi032.stdout:(129/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 7.3 MB/s | 3.7 MB 00:00 2023-10-14T12:16:20.610 INFO:teuthology.orchestra.run.smithi092.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-14T12:16:20.634 INFO:teuthology.orchestra.run.smithi032.stdout:(130/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 9.4 MB/s | 798 kB 00:00 2023-10-14T12:16:20.669 INFO:teuthology.orchestra.run.smithi092.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-10-14T12:16:20.728 INFO:teuthology.orchestra.run.smithi092.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-14T12:16:21.069 INFO:teuthology.orchestra.run.smithi092.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 7.7 MB/s | 3.7 MB 00:00 2023-10-14T12:16:21.177 INFO:teuthology.orchestra.run.smithi092.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 6.5 MB/s | 3.7 MB 00:00 2023-10-14T12:16:21.182 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:16:21.182 INFO:teuthology.orchestra.run.smithi092.stdout:Total 15 MB/s | 209 MB 00:14 2023-10-14T12:16:22.017 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-14T12:16:22.138 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-14T12:16:22.138 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-14T12:16:23.273 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-14T12:16:23.277 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-14T12:16:23.966 INFO:teuthology.orchestra.run.smithi032.stdout:(131/131): ceph-test-18.0.0-6730.g4ba8a190.el8. 4.4 MB/s | 49 MB 00:11 2023-10-14T12:16:23.973 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:16:23.973 INFO:teuthology.orchestra.run.smithi032.stdout:Total 13 MB/s | 209 MB 00:16 2023-10-14T12:16:24.830 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2023-10-14T12:16:24.961 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2023-10-14T12:16:24.962 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2023-10-14T12:16:26.148 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2023-10-14T12:16:26.152 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2023-10-14T12:16:28.521 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-14T12:16:28.713 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T12:16:28.882 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T12:16:29.096 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T12:16:29.298 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:16:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:16:29.623 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:16:30.065 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:16:30.348 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:16:30.741 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:16:30.939 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:16:31.066 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:16:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2023-10-14T12:16:31.273 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:16:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T12:16:31.374 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:16:31.510 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T12:16:31.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:16:31.733 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T12:16:31.842 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T12:16:31.907 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:16:32.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T12:16:32.048 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:16:32.472 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T12:16:32.651 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:16:32.688 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T12:16:32.841 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:16:32.881 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:16:32.975 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:16:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:16:33.260 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:16:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:16:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:16:33.432 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:16:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:16:33.567 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:16:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:16:33.791 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:16:33.890 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:16:34.108 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:16:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:16:34.357 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T12:16:34.464 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:16:34.553 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T12:16:34.988 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T12:16:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:16:35.198 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T12:16:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:16:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:16:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:16:35.615 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:16:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:16:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:16:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:16:36.307 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:16:36.460 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T12:16:36.688 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T12:16:36.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T12:16:36.964 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:16:37.102 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T12:16:37.107 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:16:37.318 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T12:16:37.531 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T12:16:37.712 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T12:16:37.738 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:16:37.832 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T12:16:37.915 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:16:38.664 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:16:38.727 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T12:16:38.922 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T12:16:39.068 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T12:16:39.156 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T12:16:39.348 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T12:16:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T12:16:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T12:16:39.617 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T12:16:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T12:16:39.821 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:16:39.946 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T12:16:40.105 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T12:16:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T12:16:41.154 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T12:16:41.455 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T12:16:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:16:41.838 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T12:16:41.872 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T12:16:42.087 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T12:16:42.090 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T12:16:42.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T12:16:42.289 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:16:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T12:16:42.632 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T12:16:42.788 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T12:16:42.963 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T12:16:43.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T12:16:43.306 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T12:16:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T12:16:43.732 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T12:16:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T12:16:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:16:44.331 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T12:16:44.484 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T12:16:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T12:16:44.670 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T12:16:44.790 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T12:16:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T12:16:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T12:16:45.033 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T12:16:45.160 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T12:16:45.314 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T12:16:45.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T12:16:45.483 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T12:16:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T12:16:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T12:16:45.769 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T12:16:45.781 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T12:16:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T12:16:46.007 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T12:16:46.183 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T12:16:46.215 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T12:16:46.389 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T12:16:46.552 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T12:16:46.740 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T12:16:46.827 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T12:16:47.007 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T12:16:47.050 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T12:16:47.257 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T12:16:47.282 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T12:16:47.462 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T12:16:47.492 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T12:16:47.693 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T12:16:47.765 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T12:16:47.837 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T12:16:48.022 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T12:16:48.027 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:16:48.099 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:16:48.211 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T12:16:48.320 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T12:16:48.407 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T12:16:48.555 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T12:16:48.623 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T12:16:48.719 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:16:48.794 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T12:16:48.795 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:16:49.033 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T12:16:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T12:16:49.194 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T12:16:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T12:16:49.368 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T12:16:49.547 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T12:16:49.572 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T12:16:49.755 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T12:16:49.846 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T12:16:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T12:16:50.067 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T12:16:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T12:16:50.198 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T12:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:16:50.337 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T12:16:50.563 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T12:16:50.567 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T12:16:50.755 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T12:16:50.776 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T12:16:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:16:50.936 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T12:16:51.000 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:16:51.113 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T12:16:51.222 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T12:16:51.266 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T12:16:51.357 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T12:16:51.464 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T12:16:51.515 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T12:16:51.688 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T12:16:51.721 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T12:16:51.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T12:16:51.960 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T12:16:52.196 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T12:16:52.196 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T12:16:52.344 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T12:16:52.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T12:16:52.501 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T12:16:52.599 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T12:16:52.693 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T12:16:52.798 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T12:16:52.895 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T12:16:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T12:16:53.233 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T12:16:53.378 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T12:16:53.572 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T12:16:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T12:16:53.905 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T12:16:53.961 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T12:16:54.171 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T12:16:54.230 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T12:16:54.401 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T12:16:54.430 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T12:16:54.606 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T12:16:54.693 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T12:16:54.838 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T12:16:54.992 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T12:16:55.185 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T12:16:55.969 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T12:16:56.042 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T12:16:56.217 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:16:56.227 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T12:16:56.280 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:16:56.440 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T12:16:56.459 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T12:16:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T12:16:57.014 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T12:16:57.179 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T12:16:58.028 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T12:16:58.171 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:16:58.261 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:16:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T12:17:00.191 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:17:00.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:17:01.037 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:17:01.333 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:17:01.414 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:17:01.557 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:17:02.380 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:17:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:17:03.200 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:17:03.500 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:17:03.583 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:17:03.712 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:17:20.252 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:17:20.252 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-10-14T12:17:20.253 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-10-14T12:17:20.253 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-14T12:17:20.253 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-10-14T12:17:20.253 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-10-14T12:17:20.253 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-10-14T12:17:20.254 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-10-14T12:17:20.254 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-10-14T12:17:20.254 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-10-14T12:17:20.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:20.595 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:17:22.181 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:17:22.386 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:17:22.606 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:17:22.795 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:17:23.031 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:17:23.031 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /sys 2023-10-14T12:17:23.031 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /proc 2023-10-14T12:17:23.032 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /dev 2023-10-14T12:17:23.032 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /run 2023-10-14T12:17:23.032 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /mnt 2023-10-14T12:17:23.032 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /var/tmp 2023-10-14T12:17:23.032 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /home 2023-10-14T12:17:23.033 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /tmp 2023-10-14T12:17:23.033 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /dev 2023-10-14T12:17:23.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:23.254 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:17:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:17:23.436 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:17:23.454 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:17:25.050 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:17:25.085 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:17:25.197 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:17:25.297 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:17:25.417 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T12:17:25.429 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:17:25.559 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:17:25.601 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T12:17:25.802 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:17:26.023 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:17:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:17:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:17:26.252 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:17:26.335 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:17:27.295 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:17:27.452 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:17:27.542 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:17:27.940 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T12:17:28.023 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:17:28.119 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:17:28.153 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:17:28.241 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:17:28.365 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T12:17:28.368 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:17:28.379 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:17:28.536 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T12:17:28.692 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:17:28.920 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:17:29.229 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:17:29.708 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T12:17:29.909 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:17:29.943 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:17:30.094 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:17:30.135 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:17:30.251 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:17:30.327 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:17:30.375 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:17:30.471 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:17:30.697 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:17:30.835 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:17:30.848 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T12:17:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:17:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:17:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:17:31.245 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:17:32.658 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T12:17:32.853 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:17:32.888 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:17:33.017 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:17:33.060 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:17:33.240 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:17:33.631 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:17:33.767 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:17:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:17:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T12:17:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:17:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:17:37.025 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T12:17:37.353 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T12:17:37.545 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T12:17:37.712 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:17:37.878 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T12:17:38.042 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:17:38.865 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:17:39.155 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T12:17:39.316 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:17:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:17:40.226 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:17:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T12:17:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:17:40.533 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:17:40.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T12:17:40.791 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T12:17:40.939 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T12:17:41.007 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T12:17:41.103 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:17:41.262 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T12:17:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T12:17:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:17:41.626 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T12:17:41.774 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:17:41.783 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:17:42.013 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T12:17:42.190 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:17:42.274 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:17:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:17:42.495 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:17:42.495 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:17:42.701 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:17:42.702 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:17:42.963 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:17:43.147 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:17:43.652 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:17:43.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T12:17:43.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T12:17:43.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T12:17:43.652 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T12:17:43.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T12:17:43.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:17:43.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:17:43.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:17:43.653 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:17:43.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T12:17:43.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T12:17:43.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T12:17:43.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T12:17:43.654 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T12:17:43.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T12:17:43.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T12:17:43.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T12:17:43.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T12:17:43.655 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T12:17:43.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T12:17:43.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T12:17:43.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T12:17:43.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T12:17:43.656 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T12:17:43.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T12:17:43.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T12:17:43.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T12:17:43.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T12:17:43.657 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T12:17:43.658 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T12:17:43.667 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T12:17:43.667 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T12:17:43.667 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T12:17:43.668 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T12:17:43.668 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T12:17:43.668 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T12:17:43.668 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T12:17:43.668 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T12:17:43.669 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T12:17:43.669 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T12:17:43.669 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T12:17:43.669 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T12:17:43.669 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T12:17:43.669 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T12:17:43.670 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T12:17:43.670 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T12:17:43.670 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T12:17:43.670 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T12:17:43.670 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T12:17:43.671 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T12:17:43.671 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T12:17:43.671 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T12:17:43.671 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T12:17:43.672 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T12:17:43.672 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T12:17:43.672 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T12:17:43.672 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T12:17:43.673 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T12:17:43.673 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T12:17:43.673 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T12:17:43.673 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T12:17:43.673 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T12:17:43.674 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T12:17:43.674 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T12:17:43.674 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T12:17:43.674 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T12:17:43.674 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T12:17:43.675 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T12:17:43.675 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T12:17:43.675 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T12:17:43.675 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T12:17:43.675 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T12:17:43.676 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T12:17:43.676 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T12:17:43.676 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T12:17:43.676 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T12:17:43.676 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T12:17:43.677 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T12:17:43.677 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T12:17:43.677 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T12:17:43.677 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T12:17:43.677 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T12:17:43.677 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T12:17:43.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T12:17:43.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T12:17:43.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T12:17:43.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T12:17:43.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T12:17:43.679 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T12:17:43.679 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T12:17:43.679 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T12:17:43.679 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T12:17:43.679 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T12:17:43.680 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T12:17:43.680 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T12:17:43.680 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T12:17:43.680 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T12:17:43.680 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T12:17:43.680 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T12:17:43.681 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T12:17:43.681 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T12:17:43.681 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T12:17:43.681 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T12:17:43.681 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T12:17:43.682 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T12:17:43.682 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T12:17:43.682 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T12:17:43.682 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T12:17:43.682 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T12:17:43.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T12:17:43.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T12:17:43.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T12:17:43.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T12:17:43.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T12:17:43.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T12:17:43.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T12:17:43.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T12:17:43.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T12:17:43.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T12:17:43.684 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:17:43.685 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T12:17:43.685 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:17:43.685 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T12:17:43.685 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T12:17:43.685 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T12:17:43.686 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T12:17:43.686 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T12:17:43.686 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:17:43.686 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T12:17:43.686 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T12:17:43.687 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T12:17:43.687 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:17:43.687 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T12:17:43.774 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:17:44.007 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:17:44.025 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:17:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T12:17:44.441 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T12:17:44.748 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T12:17:45.050 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T12:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:17:45.216 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:17:45.406 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T12:17:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:17:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:17:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:17:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:17:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:17:46.093 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:17:46.093 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:17:46.301 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:17:46.415 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:17:46.415 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Oct 2023 12:15:55 PM UTC. 2023-10-14T12:17:46.473 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:17:46.998 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:17:46.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T12:17:46.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T12:17:46.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T12:17:46.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T12:17:46.999 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T12:17:47.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:17:47.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:17:47.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:17:47.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:17:47.000 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T12:17:47.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T12:17:47.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T12:17:47.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T12:17:47.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T12:17:47.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T12:17:47.001 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T12:17:47.002 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T12:17:47.002 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T12:17:47.002 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T12:17:47.002 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T12:17:47.002 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T12:17:47.003 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T12:17:47.003 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T12:17:47.003 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T12:17:47.003 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T12:17:47.004 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T12:17:47.004 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T12:17:47.004 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T12:17:47.004 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T12:17:47.004 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T12:17:47.005 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T12:17:47.005 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T12:17:47.005 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T12:17:47.005 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T12:17:47.005 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T12:17:47.006 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T12:17:47.006 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T12:17:47.006 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T12:17:47.006 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T12:17:47.007 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T12:17:47.007 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T12:17:47.007 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T12:17:47.007 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T12:17:47.008 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T12:17:47.008 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T12:17:47.008 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T12:17:47.009 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T12:17:47.009 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T12:17:47.010 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T12:17:47.010 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T12:17:47.010 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T12:17:47.011 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T12:17:47.012 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T12:17:47.012 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T12:17:47.012 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T12:17:47.013 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T12:17:47.013 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T12:17:47.014 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T12:17:47.014 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T12:17:47.014 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T12:17:47.014 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T12:17:47.015 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T12:17:47.015 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T12:17:47.015 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T12:17:47.015 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T12:17:47.016 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T12:17:47.017 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T12:17:47.017 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T12:17:47.017 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T12:17:47.018 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T12:17:47.018 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T12:17:47.018 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T12:17:47.018 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T12:17:47.019 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T12:17:47.019 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T12:17:47.019 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T12:17:47.019 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T12:17:47.019 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T12:17:47.020 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T12:17:47.020 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T12:17:47.020 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T12:17:47.020 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T12:17:47.021 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T12:17:47.023 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T12:17:47.023 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T12:17:47.024 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T12:17:47.024 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T12:17:47.024 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T12:17:47.024 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T12:17:47.024 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T12:17:47.024 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T12:17:47.025 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T12:17:47.025 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T12:17:47.025 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T12:17:47.025 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T12:17:47.025 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T12:17:47.026 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T12:17:47.026 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T12:17:47.026 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T12:17:47.026 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T12:17:47.026 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T12:17:47.027 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T12:17:47.027 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T12:17:47.027 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T12:17:47.027 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T12:17:47.027 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T12:17:47.028 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T12:17:47.028 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T12:17:47.028 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T12:17:47.028 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T12:17:47.028 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T12:17:47.029 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T12:17:47.029 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T12:17:47.029 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T12:17:47.029 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T12:17:47.029 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T12:17:47.030 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T12:17:47.030 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T12:17:47.030 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T12:17:47.030 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:17:47.030 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T12:17:47.030 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:17:47.031 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T12:17:47.031 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T12:17:47.031 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T12:17:47.031 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T12:17:47.031 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T12:17:47.032 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:17:47.032 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T12:17:47.032 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T12:17:47.032 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T12:17:47.032 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:17:47.033 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T12:17:48.953 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-10-14T12:17:49.180 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:49.181 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-14T12:17:49.181 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T12:17:49.181 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.181 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.182 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-14T12:17:49.182 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T12:17:49.182 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T12:17:49.182 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T12:17:49.182 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.185 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.186 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.187 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:49.187 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T12:17:49.187 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T12:17:49.187 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T12:17:49.187 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T12:17:49.188 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-3.el8.x86_64 2023-10-14T12:17:49.188 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T12:17:49.188 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T12:17:49.188 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T12:17:49.188 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.189 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.189 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.189 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T12:17:49.189 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:17:49.189 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T12:17:49.189 INFO:teuthology.orchestra.run.smithi092.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T12:17:49.190 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:17:49.190 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T12:17:49.190 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.190 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.190 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T12:17:49.191 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.191 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T12:17:49.191 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T12:17:49.191 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T12:17:49.191 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T12:17:49.192 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T12:17:49.192 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T12:17:49.192 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T12:17:49.192 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T12:17:49.192 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T12:17:49.193 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T12:17:49.193 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T12:17:49.193 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T12:17:49.193 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T12:17:49.193 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T12:17:49.194 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:17:49.195 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:17:49.195 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:17:49.195 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T12:17:49.195 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T12:17:49.195 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T12:17:49.196 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T12:17:49.196 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T12:17:49.196 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.196 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.196 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.197 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T12:17:49.197 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T12:17:49.197 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T12:17:49.197 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T12:17:49.197 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T12:17:49.198 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T12:17:49.198 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T12:17:49.198 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T12:17:49.198 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T12:17:49.198 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T12:17:49.199 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T12:17:49.199 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T12:17:49.199 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T12:17:49.199 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T12:17:49.199 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T12:17:49.200 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T12:17:49.200 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T12:17:49.200 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T12:17:49.200 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T12:17:49.200 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T12:17:49.200 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T12:17:49.201 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T12:17:49.201 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T12:17:49.201 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T12:17:49.201 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T12:17:49.201 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T12:17:49.202 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T12:17:49.202 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T12:17:49.202 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T12:17:49.202 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T12:17:49.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T12:17:49.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.203 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T12:17:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T12:17:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T12:17:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T12:17:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T12:17:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T12:17:49.204 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T12:17:49.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T12:17:49.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T12:17:49.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T12:17:49.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T12:17:49.205 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T12:17:49.206 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T12:17:49.206 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.206 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.206 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:49.206 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T12:17:49.207 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T12:17:49.207 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T12:17:49.207 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T12:17:49.207 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T12:17:49.208 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T12:17:49.208 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:49.208 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-14T12:17:49.450 DEBUG:teuthology.parallel:result is None 2023-10-14T12:17:49.638 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:17:49.639 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:01:54 ago on Sat 14 Oct 2023 12:15:55 PM UTC. 2023-10-14T12:17:52.250 INFO:teuthology.orchestra.run.smithi032.stdout:Installed products updated. 2023-10-14T12:17:52.500 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:52.500 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2023-10-14T12:17:52.501 INFO:teuthology.orchestra.run.smithi032.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T12:17:52.501 INFO:teuthology.orchestra.run.smithi032.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.502 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.503 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2023-10-14T12:17:52.503 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T12:17:52.503 INFO:teuthology.orchestra.run.smithi032.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T12:17:52.504 INFO:teuthology.orchestra.run.smithi032.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T12:17:52.504 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.505 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.505 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.505 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.506 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.506 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.506 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.507 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.507 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.507 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.508 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.508 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.508 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.508 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.508 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.509 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.509 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.509 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.509 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.510 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.510 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.510 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.510 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:17:52.511 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T12:17:52.511 INFO:teuthology.orchestra.run.smithi032.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T12:17:52.511 INFO:teuthology.orchestra.run.smithi032.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T12:17:52.512 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T12:17:52.512 INFO:teuthology.orchestra.run.smithi032.stdout: jq-1.6-3.el8.x86_64 2023-10-14T12:17:52.512 INFO:teuthology.orchestra.run.smithi032.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T12:17:52.513 INFO:teuthology.orchestra.run.smithi032.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T12:17:52.513 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T12:17:52.513 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.514 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.514 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.514 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T12:17:52.514 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:17:52.514 INFO:teuthology.orchestra.run.smithi032.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T12:17:52.515 INFO:teuthology.orchestra.run.smithi032.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T12:17:52.515 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:17:52.515 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T12:17:52.515 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.516 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.516 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T12:17:52.516 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.516 INFO:teuthology.orchestra.run.smithi032.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T12:17:52.516 INFO:teuthology.orchestra.run.smithi032.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T12:17:52.517 INFO:teuthology.orchestra.run.smithi032.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T12:17:52.517 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T12:17:52.517 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T12:17:52.517 INFO:teuthology.orchestra.run.smithi032.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T12:17:52.517 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T12:17:52.518 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T12:17:52.518 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T12:17:52.518 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T12:17:52.518 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T12:17:52.519 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T12:17:52.519 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T12:17:52.519 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T12:17:52.519 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:17:52.520 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:17:52.520 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:17:52.520 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T12:17:52.520 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T12:17:52.521 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T12:17:52.521 INFO:teuthology.orchestra.run.smithi032.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T12:17:52.521 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T12:17:52.521 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.521 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.522 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.522 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T12:17:52.522 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T12:17:52.522 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T12:17:52.522 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T12:17:52.523 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T12:17:52.523 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T12:17:52.523 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T12:17:52.523 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T12:17:52.523 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T12:17:52.524 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T12:17:52.524 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T12:17:52.524 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T12:17:52.524 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T12:17:52.524 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T12:17:52.525 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T12:17:52.525 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T12:17:52.525 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T12:17:52.525 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T12:17:52.525 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T12:17:52.526 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T12:17:52.526 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T12:17:52.526 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T12:17:52.526 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T12:17:52.526 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T12:17:52.527 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T12:17:52.527 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T12:17:52.527 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T12:17:52.527 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T12:17:52.528 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T12:17:52.528 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.528 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.528 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T12:17:52.528 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T12:17:52.529 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.529 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T12:17:52.529 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T12:17:52.530 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T12:17:52.530 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T12:17:52.530 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T12:17:52.530 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T12:17:52.531 INFO:teuthology.orchestra.run.smithi032.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T12:17:52.531 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T12:17:52.531 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T12:17:52.531 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T12:17:52.532 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T12:17:52.532 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T12:17:52.532 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T12:17:52.532 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.533 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.533 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:17:52.533 INFO:teuthology.orchestra.run.smithi032.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T12:17:52.533 INFO:teuthology.orchestra.run.smithi032.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T12:17:52.534 INFO:teuthology.orchestra.run.smithi032.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T12:17:52.534 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T12:17:52.534 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T12:17:52.535 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T12:17:52.535 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:52.535 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-10-14T12:17:53.020 DEBUG:teuthology.parallel:result is None 2023-10-14T12:17:53.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:17:53.193 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T12:17:53.222 INFO:teuthology.orchestra.run.smithi032.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T12:17:53.223 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T12:17:53.223 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T12:17:53.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:17:53.376 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T12:17:53.408 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T12:17:53.408 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T12:17:53.409 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T12:17:53.409 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T12:17:53.409 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:53.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T12:17:53.458 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:53.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T12:17:53.509 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T12:17:53.509 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:53.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T12:17:53.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T12:17:53.612 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:53.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T12:17:53.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T12:17:53.717 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T12:17:53.718 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:53.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T12:17:53.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T12:17:53.815 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:53.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T12:17:53.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T12:17:53.913 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T12:17:53.914 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:53.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T12:17:53.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T12:17:54.009 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:54.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T12:17:54.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T12:17:54.107 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T12:17:54.176 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T12:17:54.177 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2023-10-14T12:17:54.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-10-14T12:17:54.207 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T12:17:54.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T12:17:54.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T12:17:54.274 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T12:17:54.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T12:17:54.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T12:17:54.348 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T12:17:54.349 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T12:17:54.349 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T12:17:54.350 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:54.350 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T12:17:54.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T12:17:54.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T12:17:54.579 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:54.579 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T12:17:54.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T12:17:54.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T12:17:54.767 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T12:17:54.768 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T12:17:54.768 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304', 'branch': 'rishabh-2023oct13', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7425304', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T12:17:54.769 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T12:17:54.773 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T12:17:54.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T12:17:54.829 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T12:17:54.885 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:54.885 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T12:17:54.914 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T12:17:54.914 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2023-10-14T12:17:54.971 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T12:17:54.972 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:54.972 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 384792 Links: 1 2023-10-14T12:17:54.972 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:54.972 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:54.973 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-14 12:17:46.675284085 +0000 2023-10-14T12:17:54.973 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-14 12:15:09.336964558 +0000 2023-10-14T12:17:54.973 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-14 12:15:09.336964558 +0000 2023-10-14T12:17:54.973 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-14T12:17:54.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T12:17:55.038 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-14T12:17:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-14T12:17:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000131545 s, 3.9 MB/s 2023-10-14T12:17:55.040 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T12:17:55.098 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2023-10-14T12:17:55.156 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T12:17:55.156 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:55.156 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 396363 Links: 1 2023-10-14T12:17:55.156 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:55.157 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:55.157 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-14 12:17:46.675284085 +0000 2023-10-14T12:17:55.157 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-14 12:15:09.869953811 +0000 2023-10-14T12:17:55.157 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-14 12:15:09.869953811 +0000 2023-10-14T12:17:55.158 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-14T12:17:55.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T12:17:55.222 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-14T12:17:55.222 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-14T12:17:55.222 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 9.5732e-05 s, 5.3 MB/s 2023-10-14T12:17:55.223 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T12:17:55.281 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2023-10-14T12:17:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T12:17:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:55.339 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 396495 Links: 1 2023-10-14T12:17:55.339 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:55.339 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:55.339 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-14 12:17:46.675284085 +0000 2023-10-14T12:17:55.340 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-14 12:15:10.394943226 +0000 2023-10-14T12:17:55.340 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-14 12:15:10.394943226 +0000 2023-10-14T12:17:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-14T12:17:55.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T12:17:55.403 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-14T12:17:55.404 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-14T12:17:55.404 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000109243 s, 4.7 MB/s 2023-10-14T12:17:55.405 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T12:17:55.464 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2023-10-14T12:17:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T12:17:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:55.522 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 393493 Links: 1 2023-10-14T12:17:55.522 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:55.522 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:55.522 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-14 12:17:46.675284085 +0000 2023-10-14T12:17:55.522 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-14 12:15:10.908932862 +0000 2023-10-14T12:17:55.523 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-14 12:15:10.908932862 +0000 2023-10-14T12:17:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-14T12:17:55.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T12:17:55.586 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-14T12:17:55.587 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-14T12:17:55.587 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000110984 s, 4.6 MB/s 2023-10-14T12:17:55.588 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T12:17:55.646 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:17:55.646 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:55.646 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T12:17:55.667 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T12:17:55.667 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-10-14T12:17:55.728 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T12:17:55.728 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:55.728 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 388934 Links: 1 2023-10-14T12:17:55.729 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:55.729 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:55.729 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 12:17:43.357207054 +0000 2023-10-14T12:17:55.729 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 12:14:43.703849696 +0000 2023-10-14T12:17:55.729 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 12:14:43.703849696 +0000 2023-10-14T12:17:55.730 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-14T12:17:55.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T12:17:55.798 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T12:17:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T12:17:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000309427 s, 1.7 MB/s 2023-10-14T12:17:55.800 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T12:17:55.862 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-10-14T12:17:55.923 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T12:17:55.923 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:55.923 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 382834 Links: 1 2023-10-14T12:17:55.923 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:55.924 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:55.924 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 12:17:43.357207054 +0000 2023-10-14T12:17:55.924 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 12:14:44.238834733 +0000 2023-10-14T12:17:55.924 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 12:14:44.238834733 +0000 2023-10-14T12:17:55.924 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-14T12:17:55.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T12:17:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T12:17:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T12:17:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000336758 s, 1.5 MB/s 2023-10-14T12:17:55.995 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T12:17:56.056 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-10-14T12:17:56.117 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T12:17:56.117 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:56.117 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 390632 Links: 1 2023-10-14T12:17:56.118 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:56.118 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:56.118 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 12:17:43.357207054 +0000 2023-10-14T12:17:56.118 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 12:14:44.738820749 +0000 2023-10-14T12:17:56.118 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 12:14:44.738820749 +0000 2023-10-14T12:17:56.119 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-14T12:17:56.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T12:17:56.187 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T12:17:56.187 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T12:17:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000240655 s, 2.1 MB/s 2023-10-14T12:17:56.189 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T12:17:56.251 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-10-14T12:17:56.311 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T12:17:56.311 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:17:56.312 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 382973 Links: 1 2023-10-14T12:17:56.312 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:17:56.312 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:17:56.313 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 12:17:43.357207054 +0000 2023-10-14T12:17:56.313 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 12:14:45.267805953 +0000 2023-10-14T12:17:56.313 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 12:14:45.267805953 +0000 2023-10-14T12:17:56.314 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-10-14T12:17:56.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T12:17:56.381 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T12:17:56.381 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T12:17:56.381 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000220002 s, 2.3 MB/s 2023-10-14T12:17:56.382 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T12:17:56.443 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:17:56.443 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T12:17:56.444 INFO:tasks.ceph:Generating config... 2023-10-14T12:17:56.445 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T12:17:56.445 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T12:17:56.445 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T12:17:56.446 INFO:tasks.ceph:[client] pid file = 2023-10-14T12:17:56.446 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T12:17:56.446 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T12:17:56.446 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T12:17:56.447 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T12:17:56.447 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T12:17:56.447 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T12:17:56.447 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T12:17:56.448 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T12:17:56.448 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T12:17:56.448 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T12:17:56.449 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T12:17:56.449 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T12:17:56.449 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T12:17:56.449 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-14T12:17:56.450 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-14T12:17:56.450 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T12:17:56.450 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T12:17:56.451 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T12:17:56.451 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T12:17:56.451 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T12:17:56.452 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T12:17:56.452 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T12:17:56.452 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T12:17:56.452 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T12:17:56.453 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T12:17:56.453 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T12:17:56.453 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-14T12:17:56.453 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-14T12:17:56.454 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T12:17:56.454 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T12:17:56.454 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-14T12:17:56.454 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T12:17:56.455 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T12:17:56.455 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T12:17:56.455 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T12:17:56.455 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T12:17:56.456 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T12:17:56.456 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T12:17:56.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T12:17:56.518 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T12:17:56.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T12:17:56.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:17:56.599 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.92'), ('mon.c', '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]')] 2023-10-14T12:17:56.600 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T12:17:56.601 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:56.601 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T12:17:56.658 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.92 --addv c '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:17:56.748 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:17:56.748 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid 9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed 2023-10-14T12:17:56.748 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = pacific 2023-10-14T12:17:56.749 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2023-10-14T12:17:56.749 INFO:teuthology.orchestra.run.smithi032.stdout:fsid 9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed 2023-10-14T12:17:56.749 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2023-10-14T12:17:56.747991+0000 2023-10-14T12:17:56.749 INFO:teuthology.orchestra.run.smithi032.stdout:created 2023-10-14T12:17:56.747991+0000 2023-10-14T12:17:56.749 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 16 (pacific) 2023-10-14T12:17:56.750 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2023-10-14T12:17:56.750 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2023-10-14T12:17:56.750 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2023-10-14T12:17:56.750 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] mon.c 2023-10-14T12:17:56.750 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T12:17:56.752 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T12:17:56.769 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed... 2023-10-14T12:17:56.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T12:17:56.811 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T12:17:56.855 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2023-10-14T12:17:56.856 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2023-10-14T12:17:56.856 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T12:17:56.856 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2023-10-14T12:17:56.856 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.856 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2023-10-14T12:17:56.857 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.857 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2023-10-14T12:17:56.857 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.857 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2023-10-14T12:17:56.857 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2023-10-14T12:17:56.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.858 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2023-10-14T12:17:56.858 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2023-10-14T12:17:56.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.858 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T12:17:56.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2023-10-14T12:17:56.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.859 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T12:17:56.859 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T12:17:56.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.860 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2023-10-14T12:17:56.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2023-10-14T12:17:56.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2023-10-14T12:17:56.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2023-10-14T12:17:56.861 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2023-10-14T12:17:56.861 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2023-10-14T12:17:56.861 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2023-10-14T12:17:56.861 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2023-10-14T12:17:56.861 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T12:17:56.862 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T12:17:56.862 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2023-10-14T12:17:56.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.863 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T12:17:56.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.863 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2023-10-14T12:17:56.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.863 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2023-10-14T12:17:56.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2023-10-14T12:17:56.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2023-10-14T12:17:56.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2023-10-14T12:17:56.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2023-10-14T12:17:56.865 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on skipped message = False 2023-10-14T12:17:56.865 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = 9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed 2023-10-14T12:17:56.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.865 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2023-10-14T12:17:56.865 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2023-10-14T12:17:56.866 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.866 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2023-10-14T12:17:56.866 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2023-10-14T12:17:56.866 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2023-10-14T12:17:56.866 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.867 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2023-10-14T12:17:56.867 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2023-10-14T12:17:56.867 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.867 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2023-10-14T12:17:56.867 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2023-10-14T12:17:56.868 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2023-10-14T12:17:56.868 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.868 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2023-10-14T12:17:56.868 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2023-10-14T12:17:56.868 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.869 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2023-10-14T12:17:56.869 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.869 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2023-10-14T12:17:56.869 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.869 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2023-10-14T12:17:56.870 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.870 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2023-10-14T12:17:56.870 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2023-10-14T12:17:56.870 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.870 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2023-10-14T12:17:56.871 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2023-10-14T12:17:56.871 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2023-10-14T12:17:56.871 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2023-10-14T12:17:56.871 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2023-10-14T12:17:56.871 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2023-10-14T12:17:56.872 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2023-10-14T12:17:56.872 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2023-10-14T12:17:56.872 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2023-10-14T12:17:56.872 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-14T12:17:56.873 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2023-10-14T12:17:56.873 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2023-10-14T12:17:56.873 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T12:17:56.873 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2023-10-14T12:17:56.873 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2023-10-14T12:17:56.874 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2023-10-14T12:17:56.874 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2023-10-14T12:17:56.874 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2023-10-14T12:17:56.874 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.874 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2023-10-14T12:17:56.875 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-14T12:17:56.875 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2023-10-14T12:17:56.875 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2023-10-14T12:17:56.875 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2023-10-14T12:17:56.875 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:17:56.876 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:17:56.876 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2023-10-14T12:17:56.876 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2023-10-14T12:17:56.876 INFO:teuthology.orchestra.run.smithi032.stdout: debug finisher = 20 2023-10-14T12:17:56.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.877 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2023-10-14T12:17:56.877 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-14T12:17:56.877 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2023-10-14T12:17:56.877 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2023-10-14T12:17:56.877 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2023-10-14T12:17:56.877 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2023-10-14T12:17:56.878 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2023-10-14T12:17:56.878 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:17:56.878 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2023-10-14T12:17:56.878 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2023-10-14T12:17:56.879 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:17:56.879 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.880 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T12:17:56.880 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T12:17:56.880 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T12:17:56.880 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.881 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T12:17:56.881 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T12:17:56.881 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T12:17:56.881 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.882 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2023-10-14T12:17:56.882 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2023-10-14T12:17:56.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.883 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2023-10-14T12:17:56.883 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2023-10-14T12:17:56.883 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:17:56.883 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2023-10-14T12:17:56.884 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2023-10-14T12:17:56.884 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2023-10-14T12:17:56.884 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2023-10-14T12:17:56.884 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T12:17:56.884 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T12:17:56.885 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2023-10-14T12:17:56.885 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2023-10-14T12:17:56.885 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-14T12:17:56.885 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = "" 2023-10-14T12:17:56.885 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2023-10-14T12:17:56.886 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2023-10-14T12:17:56.886 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2023-10-14T12:17:56.886 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2023-10-14T12:17:56.886 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2023-10-14T12:17:56.886 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2023-10-14T12:17:56.887 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2023-10-14T12:17:56.887 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2023-10-14T12:17:56.887 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2023-10-14T12:17:56.887 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2023-10-14T12:17:56.887 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2023-10-14T12:17:56.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2023-10-14T12:17:56.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-14T12:17:56.888 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2023-10-14T12:17:56.888 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2023-10-14T12:17:56.888 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2023-10-14T12:17:56.889 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2023-10-14T12:17:56.889 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2023-10-14T12:17:56.889 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2023-10-14T12:17:56.889 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2023-10-14T12:17:56.891 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-10-14T12:17:56.892 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-10-14T12:17:56.892 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T12:17:56.892 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-10-14T12:17:56.892 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.893 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-10-14T12:17:56.893 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.893 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-10-14T12:17:56.893 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.894 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-10-14T12:17:56.894 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-10-14T12:17:56.894 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.894 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-10-14T12:17:56.894 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-10-14T12:17:56.895 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.895 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T12:17:56.895 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-10-14T12:17:56.895 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.895 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T12:17:56.896 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T12:17:56.896 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.896 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-10-14T12:17:56.896 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.896 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-10-14T12:17:56.897 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-10-14T12:17:56.897 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-10-14T12:17:56.897 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-10-14T12:17:56.897 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-10-14T12:17:56.897 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-10-14T12:17:56.898 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-10-14T12:17:56.898 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T12:17:56.899 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T12:17:56.899 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-10-14T12:17:56.899 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.899 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T12:17:56.900 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.900 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-10-14T12:17:56.900 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.900 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-10-14T12:17:56.901 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.901 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-10-14T12:17:56.901 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-10-14T12:17:56.901 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-10-14T12:17:56.902 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.32,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2023-10-14T12:17:56.902 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on skipped message = False 2023-10-14T12:17:56.902 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed 2023-10-14T12:17:56.902 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.903 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-10-14T12:17:56.903 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-10-14T12:17:56.903 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.903 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-10-14T12:17:56.904 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-10-14T12:17:56.904 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-10-14T12:17:56.904 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.904 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-10-14T12:17:56.905 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-10-14T12:17:56.905 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.906 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-10-14T12:17:56.906 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-10-14T12:17:56.906 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-10-14T12:17:56.906 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.907 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-10-14T12:17:56.907 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-10-14T12:17:56.907 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.907 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-10-14T12:17:56.908 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.908 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-10-14T12:17:56.908 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.908 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-10-14T12:17:56.908 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.909 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-10-14T12:17:56.909 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-10-14T12:17:56.909 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.909 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-10-14T12:17:56.909 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-10-14T12:17:56.911 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2023-10-14T12:17:56.911 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2023-10-14T12:17:56.911 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2023-10-14T12:17:56.911 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2023-10-14T12:17:56.911 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2023-10-14T12:17:56.912 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2023-10-14T12:17:56.912 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2023-10-14T12:17:56.912 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T12:17:56.913 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-10-14T12:17:56.913 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2023-10-14T12:17:56.913 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T12:17:56.913 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2023-10-14T12:17:56.913 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2023-10-14T12:17:56.914 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2023-10-14T12:17:56.914 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2023-10-14T12:17:56.914 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-10-14T12:17:56.914 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.914 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-10-14T12:17:56.915 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T12:17:56.915 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-10-14T12:17:56.915 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-10-14T12:17:56.915 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-10-14T12:17:56.915 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:17:56.916 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:17:56.916 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-10-14T12:17:56.916 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-10-14T12:17:56.916 INFO:teuthology.orchestra.run.smithi092.stdout: debug finisher = 20 2023-10-14T12:17:56.916 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.917 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-10-14T12:17:56.917 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T12:17:56.917 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-10-14T12:17:56.917 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-10-14T12:17:56.917 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-10-14T12:17:56.918 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-10-14T12:17:56.918 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-10-14T12:17:56.918 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:17:56.918 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-10-14T12:17:56.918 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-10-14T12:17:56.918 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:17:56.919 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.919 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T12:17:56.919 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T12:17:56.919 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T12:17:56.919 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.920 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T12:17:56.920 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T12:17:56.920 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T12:17:56.920 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.921 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-10-14T12:17:56.921 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-10-14T12:17:56.921 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.921 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-10-14T12:17:56.922 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2023-10-14T12:17:56.922 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T12:17:56.923 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-10-14T12:17:56.924 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-10-14T12:17:56.924 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-10-14T12:17:56.924 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-10-14T12:17:56.924 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T12:17:56.924 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T12:17:56.925 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2023-10-14T12:17:56.925 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-10-14T12:17:56.925 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T12:17:56.925 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = "" 2023-10-14T12:17:56.925 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-10-14T12:17:56.926 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-10-14T12:17:56.926 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-10-14T12:17:56.926 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2023-10-14T12:17:56.926 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2023-10-14T12:17:56.927 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-10-14T12:17:56.927 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-10-14T12:17:56.927 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-10-14T12:17:56.927 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-10-14T12:17:56.927 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2023-10-14T12:17:56.928 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2023-10-14T12:17:56.928 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2023-10-14T12:17:56.928 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T12:17:56.928 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2023-10-14T12:17:56.928 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2023-10-14T12:17:56.929 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2023-10-14T12:17:56.929 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2023-10-14T12:17:56.929 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-10-14T12:17:56.929 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-10-14T12:17:56.929 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-10-14T12:17:56.930 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T12:17:56.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T12:17:56.989 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T12:17:56.989 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:56.990 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T12:17:57.006 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:57.007 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T12:17:57.063 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:17:57.063 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:57.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T12:17:57.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:17:57.141 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:17:57.141 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:17:57.198 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:17:57.198 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:57.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T12:17:57.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:17:57.243 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:17:57.244 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:17:57.303 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T12:17:57.303 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T12:17:57.304 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T12:17:57.359 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T12:17:57.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T12:17:57.437 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T12:17:57.440 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T12:17:57.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T12:17:57.497 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T12:17:57.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T12:17:57.526 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T12:17:57.622 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T12:17:57.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T12:17:57.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T12:17:57.712 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T12:17:57.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T12:17:57.743 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T12:17:57.838 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T12:17:57.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T12:17:57.867 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T12:17:57.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T12:17:57.913 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T12:17:57.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T12:17:57.971 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T12:17:57.985 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T12:17:58.029 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T12:17:58.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T12:17:58.125 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T12:17:58.138 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T12:17:58.138 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T12:17:58.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T12:17:58.167 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:17:58.169 INFO:tasks.ceph:role: osd.0 2023-10-14T12:17:58.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:17:58.170 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T12:17:58.234 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:17:58.234 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:17:58.234 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:17:58.235 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:17:58.235 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:17:58.235 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:17:58.235 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:17:58.236 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:17:58.236 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:17:58.236 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:17:58.257 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-10-14T12:17:58.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-14T12:17:58.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T12:17:58.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T12:17:58.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T12:17:58.481 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:17:58.481 INFO:tasks.ceph:role: osd.1 2023-10-14T12:17:58.481 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:17:58.482 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T12:17:58.548 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:17:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:17:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:17:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:17:58.549 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:17:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:17:58.550 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:17:58.550 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:17:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:17:58.551 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:17:58.570 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-10-14T12:17:58.572 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-14T12:17:58.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T12:17:58.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T12:17:58.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T12:17:58.790 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:17:58.791 INFO:tasks.ceph:role: osd.2 2023-10-14T12:17:58.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:17:58.791 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T12:17:58.857 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:17:58.858 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:17:58.858 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:17:58.858 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:17:58.859 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:17:58.859 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:17:58.859 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:17:58.859 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:17:58.859 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:17:58.860 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:17:58.880 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-10-14T12:17:58.881 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-14T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T12:17:58.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T12:17:59.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T12:17:59.101 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:17:59.101 INFO:tasks.ceph:role: osd.3 2023-10-14T12:17:59.101 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:17:59.102 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T12:17:59.167 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:17:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:17:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:17:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:17:59.168 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:17:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:17:59.169 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:17:59.169 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:17:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:17:59.169 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:17:59.190 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-10-14T12:17:59.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-14T12:17:59.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T12:17:59.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T12:17:59.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:17:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:17:59.449+0000 7f76d06af640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T12:17:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:17:59.449+0000 7f76d06af640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T12:17:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:17:59.449+0000 7f76d06af640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:17:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:17:59.449+0000 7f76d06af640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:17:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:17:59.449+0000 7f76d06af640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:17:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:17:59.450+0000 7f76d06af640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T12:18:02.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T12:18:02.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:02.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:02.446+0000 7f4a4e0a7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T12:18:02.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:02.446+0000 7f4a4e0a7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T12:18:02.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:02.447+0000 7f4a4e0a7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:18:02.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:02.447+0000 7f4a4e0a7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:18:02.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:02.447+0000 7f4a4e0a7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:18:02.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:02.447+0000 7f4a4e0a7640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T12:18:05.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T12:18:05.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:05.445+0000 7f80dd197640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T12:18:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:05.445+0000 7f80dd197640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T12:18:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:05.445+0000 7f80dd197640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:18:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:05.445+0000 7f80dd197640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:18:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:05.445+0000 7f80dd197640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:18:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:05.445+0000 7f80dd197640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T12:18:08.311 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T12:18:08.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:08.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:08.434+0000 7f2836fd5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T12:18:08.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:08.434+0000 7f2836fd5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T12:18:08.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:08.434+0000 7f2836fd5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:18:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:08.434+0000 7f2836fd5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:18:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:08.434+0000 7f2836fd5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:18:08.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:08.435+0000 7f2836fd5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T12:18:11.297 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T12:18:11.330 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T12:18:11.363 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:18:11.364 INFO:tasks.ceph:role: osd.4 2023-10-14T12:18:11.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:18:11.364 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T12:18:11.442 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:18:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:18:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:18:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:18:11.443 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:18:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:18:11.444 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:18:11.444 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:18:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:18:11.445 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:18:11.866 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T12:18:11.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T12:18:11.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T12:18:12.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T12:18:12.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T12:18:12.128 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:18:12.129 INFO:tasks.ceph:role: osd.5 2023-10-14T12:18:12.129 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:18:12.129 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T12:18:12.203 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:18:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:18:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:18:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:18:12.204 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:18:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:18:12.204 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:18:12.204 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:18:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:18:12.204 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:18:12.626 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T12:18:12.628 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T12:18:12.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T12:18:12.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T12:18:12.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T12:18:12.817 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:18:12.817 INFO:tasks.ceph:role: osd.6 2023-10-14T12:18:12.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:18:12.818 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T12:18:12.892 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:18:12.892 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:18:12.892 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:18:12.892 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:18:12.893 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:18:12.893 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:18:12.893 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:18:12.893 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:18:12.893 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:18:12.894 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:18:13.342 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T12:18:13.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T12:18:13.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T12:18:13.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T12:18:13.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T12:18:13.563 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:18:13.564 INFO:tasks.ceph:role: osd.7 2023-10-14T12:18:13.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:18:13.564 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T12:18:13.639 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:18:13.639 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:18:13.639 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:18:13.640 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:18:13.640 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:18:13.640 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:18:13.640 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:18:13.640 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:18:13.641 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:18:13.641 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:18:14.076 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T12:18:14.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T12:18:14.078 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T12:18:14.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T12:18:14.281 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:14.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:14.383+0000 7fbe19f50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T12:18:14.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:14.384+0000 7fbe19f50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T12:18:14.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:14.384+0000 7fbe19f50640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:18:14.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:14.384+0000 7fbe19f50640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:18:14.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:14.384+0000 7fbe19f50640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:18:14.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:14.391+0000 7fbe19f50640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T12:18:17.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T12:18:17.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:17.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:17.391+0000 7f8ee93a6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T12:18:17.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:17.391+0000 7f8ee93a6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T12:18:17.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:17.391+0000 7f8ee93a6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:18:17.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:17.392+0000 7f8ee93a6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:18:17.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:17.392+0000 7f8ee93a6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:18:17.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:17.392+0000 7f8ee93a6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T12:18:20.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T12:18:20.289 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:20.382+0000 7f2f22a4c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T12:18:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:20.383+0000 7f2f22a4c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T12:18:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:20.383+0000 7f2f22a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:18:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:20.383+0000 7f2f22a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:18:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:20.383+0000 7f2f22a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:18:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:20.383+0000 7f2f22a4c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T12:18:23.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T12:18:23.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:23.392+0000 7fb8bdbdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T12:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:23.392+0000 7fb8bdbdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T12:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:23.392+0000 7fb8bdbdb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:23.392+0000 7fb8bdbdb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:23.392+0000 7fb8bdbdb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:23.393+0000 7fb8bdbdb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T12:18:24.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:18:24.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:18:26.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T12:18:26.293 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T12:18:26.294 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T12:18:26.328 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T12:18:26.400 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T12:18:26.471 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T12:18:26.542 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T12:18:26.611 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T12:18:26.682 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:26.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T12:18:26.751 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:26.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T12:18:26.783 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:26.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T12:18:26.854 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:26.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T12:18:26.925 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:26.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T12:18:26.997 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:26.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T12:18:27.068 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:27.068 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T12:18:27.137 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:27.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T12:18:27.206 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:27.206 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T12:18:27.227 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:27.228 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T12:18:27.288 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:27.289 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T12:18:27.307 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:27.307 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T12:18:27.364 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T12:18:27.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T12:18:27.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T12:18:27.407 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2023-10-14T12:18:27.408 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hipl6RBqFRAAEXs8yqVj3iQWD4kBHomBcA== 2023-10-14T12:18:27.408 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2023-10-14T12:18:27.408 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hiplrqSaHRAAES8OghPOSw2npKafMXiIAQ== 2023-10-14T12:18:27.408 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2023-10-14T12:18:27.408 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hiplnuYQJRAAXr4jabJT4v7t7n5/nHTuiQ== 2023-10-14T12:18:27.409 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2023-10-14T12:18:27.409 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD3hiplzH7cGhAA88LnkIr4eFWoIN55H1CnhQ== 2023-10-14T12:18:27.409 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2023-10-14T12:18:27.409 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD6hiplf4u+GhAAlNk5fZGFEahIUIab1n1ZmQ== 2023-10-14T12:18:27.410 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2023-10-14T12:18:27.410 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD9hiplCV+mGhAAslJMVkAfYSD8TFuDngSJDw== 2023-10-14T12:18:27.414 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2023-10-14T12:18:27.414 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAAhypla9EFGhAAGezETrPKT/nm9vaMALDi2Q== 2023-10-14T12:18:27.414 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2023-10-14T12:18:27.414 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hipllvgOGhAAH2D/yYTLtMoUoZrou6FNAQ== 2023-10-14T12:18:27.414 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2023-10-14T12:18:27.415 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hiplPdFyKhAAHoa5EIYmuDylqZvqAvW0aw== 2023-10-14T12:18:27.415 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2023-10-14T12:18:27.415 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hipln7H0MRAA4paEuBYUWvi1C3Q34jueZg== 2023-10-14T12:18:27.415 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2023-10-14T12:18:27.415 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAGhyplWcDqFhAACaifXfBK0P7iW9M736dFFg== 2023-10-14T12:18:27.416 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2023-10-14T12:18:27.416 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAJhypl6CRpFxAATFnfNGOdwssFbo0WSc630A== 2023-10-14T12:18:27.416 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2023-10-14T12:18:27.416 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAMhypl3E3gFhAA2u0NVzKX2u11h7lGQWMoOQ== 2023-10-14T12:18:27.416 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2023-10-14T12:18:27.417 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAPhypla+Z1FxAAOC3wIVmu+ugmHLKIhxMfTw== 2023-10-14T12:18:27.417 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2023-10-14T12:18:27.417 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hiplbLVwNhAA8WYVpBrISyYWaAdxO/MbXg== 2023-10-14T12:18:27.417 INFO:teuthology.orchestra.run.smithi032.stdout:[client.2] 2023-10-14T12:18:27.417 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hiplPAjpORAAZfBb1jttYTRyMNLJ0NatGg== 2023-10-14T12:18:27.417 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2023-10-14T12:18:27.418 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD2hipl/kK0ARAAdDok989IrMUt12F3mU2l8w== 2023-10-14T12:18:27.418 INFO:teuthology.orchestra.run.smithi032.stdout:[client.3] 2023-10-14T12:18:27.418 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD2hipl21R2BxAAVzz6xKow1ABtONFgIpTVZw== 2023-10-14T12:18:27.431 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2023-10-14T12:18:27.431 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hipl6RBqFRAAEXs8yqVj3iQWD4kBHomBcA== 2023-10-14T12:18:27.431 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-10-14T12:18:27.432 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hiplrqSaHRAAES8OghPOSw2npKafMXiIAQ== 2023-10-14T12:18:27.432 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-10-14T12:18:27.432 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hiplnuYQJRAAXr4jabJT4v7t7n5/nHTuiQ== 2023-10-14T12:18:27.432 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2023-10-14T12:18:27.432 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD3hiplzH7cGhAA88LnkIr4eFWoIN55H1CnhQ== 2023-10-14T12:18:27.433 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2023-10-14T12:18:27.433 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD6hiplf4u+GhAAlNk5fZGFEahIUIab1n1ZmQ== 2023-10-14T12:18:27.433 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2023-10-14T12:18:27.433 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD9hiplCV+mGhAAslJMVkAfYSD8TFuDngSJDw== 2023-10-14T12:18:27.433 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2023-10-14T12:18:27.434 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAAhypla9EFGhAAGezETrPKT/nm9vaMALDi2Q== 2023-10-14T12:18:27.434 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2023-10-14T12:18:27.434 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hipllvgOGhAAH2D/yYTLtMoUoZrou6FNAQ== 2023-10-14T12:18:27.435 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-10-14T12:18:27.435 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hiplPdFyKhAAHoa5EIYmuDylqZvqAvW0aw== 2023-10-14T12:18:27.435 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-10-14T12:18:27.435 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hipln7H0MRAA4paEuBYUWvi1C3Q34jueZg== 2023-10-14T12:18:27.435 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2023-10-14T12:18:27.436 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAGhyplWcDqFhAACaifXfBK0P7iW9M736dFFg== 2023-10-14T12:18:27.436 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2023-10-14T12:18:27.436 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAJhypl6CRpFxAATFnfNGOdwssFbo0WSc630A== 2023-10-14T12:18:27.436 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2023-10-14T12:18:27.436 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAMhypl3E3gFhAA2u0NVzKX2u11h7lGQWMoOQ== 2023-10-14T12:18:27.436 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2023-10-14T12:18:27.437 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAPhypla+Z1FxAAOC3wIVmu+ugmHLKIhxMfTw== 2023-10-14T12:18:27.437 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-10-14T12:18:27.437 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hiplbLVwNhAA8WYVpBrISyYWaAdxO/MbXg== 2023-10-14T12:18:27.437 INFO:teuthology.orchestra.run.smithi092.stdout:[client.2] 2023-10-14T12:18:27.437 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1hiplPAjpORAAZfBb1jttYTRyMNLJ0NatGg== 2023-10-14T12:18:27.438 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2023-10-14T12:18:27.438 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD2hipl/kK0ARAAdDok989IrMUt12F3mU2l8w== 2023-10-14T12:18:27.438 INFO:teuthology.orchestra.run.smithi092.stdout:[client.3] 2023-10-14T12:18:27.438 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD2hipl21R2BxAAVzz6xKow1ABtONFgIpTVZw== 2023-10-14T12:18:27.439 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:18:27.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:18:27.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.709 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:27.873 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:18:27.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:18:27.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:27.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:18:28.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.048 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.103 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.215 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:18:28.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.330 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:18:28.503 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T12:18:28.504 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T12:18:28.531 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:18:28.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T12:18:28.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T12:18:28.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:18:28.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T12:18:28.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T12:18:28.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:18:28.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T12:18:29.002 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:29.005 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:18:29.058 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T12:18:29.059 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T12:18:29.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T12:18:29.063 INFO:tasks.ceph.mon.a:Started 2023-10-14T12:18:29.064 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T12:18:29.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T12:18:29.103 INFO:tasks.ceph.mon.b:Started 2023-10-14T12:18:29.103 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T12:18:29.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T12:18:29.106 INFO:tasks.ceph.mon.c:Started 2023-10-14T12:18:29.106 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T12:18:29.107 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T12:18:29.107 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T12:18:29.109 INFO:tasks.ceph.mgr.y:Started 2023-10-14T12:18:29.109 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T12:18:29.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T12:18:29.112 INFO:tasks.ceph.mgr.x:Started 2023-10-14T12:18:29.113 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T12:18:29.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T12:18:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.238+0000 7fb0d8642700 1 Processor -- start 2023-10-14T12:18:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.238+0000 7fb0d8642700 1 -- start start 2023-10-14T12:18:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d8642700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d8642700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d8642700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d8642700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d01619a0 con 0x7fb0d00cede0 2023-10-14T12:18:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d8642700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d006b1f0 con 0x7fb0d006a840 2023-10-14T12:18:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d8642700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00cf260 con 0x7fb0d00cd950 2023-10-14T12:18:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37444/0 (socket says 172.21.15.32:37444) 2023-10-14T12:18:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 -- 172.21.15.32:0/2403174166 learned_addr learned my addr 172.21.15.32:0/2403174166 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 -- 172.21.15.32:0/2403174166 >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 msgr2=0x7fb0d015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T12:18:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 -- 172.21.15.32:0/2403174166 >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 msgr2=0x7fb0d015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:18:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d63de700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:18:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d6bdf700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:18:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d63de700 1 -- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 msgr2=0x7fb0d015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T12:18:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d63de700 1 -- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 msgr2=0x7fb0d015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:18:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d63de700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:18:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d6bdf700 1 -- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 msgr2=0x7fb0d006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T12:18:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d6bdf700 1 -- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 msgr2=0x7fb0d006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:18:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d63de700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:18:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d6bdf700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:18:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.239+0000 7fb0d6bdf700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:18:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.32:3300/0 conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d6bdf700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d63de700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 -- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 msgr2=0x7fb0d015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 -- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 msgr2=0x7fb0d006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 -- 172.21.15.32:0/2403174166 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d00b2d60 con 0x7fb0d00cede0 2023-10-14T12:18:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d6bdf700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d63de700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cede0 0x7fb0d015f570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006ebc0 tx=0x7fb0cc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed6d217579b2294 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d53dc700 1 -- 172.21.15.32:0/2403174166 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc017070 con 0x7fb0d00cede0 2023-10-14T12:18:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d53dc700 1 -- 172.21.15.32:0/2403174166 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc005a20 con 0x7fb0d00cede0 2023-10-14T12:18:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.440+0000 7fb0d53dc700 1 -- 172.21.15.32:0/2403174166 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00c070 con 0x7fb0d00cede0 2023-10-14T12:18:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 -- 172.21.15.32:0/2403174166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cede0 msgr2=0x7fb0d015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cede0 0x7fb0d015f570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006ebc0 tx=0x7fb0cc009c30 comp rx=0 tx=0).stop 2023-10-14T12:18:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 -- 172.21.15.32:0/2403174166 shutdown_connections 2023-10-14T12:18:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 --2- 172.21.15.32:0/2403174166 >> v2:172.21.15.92:3300/0 conn(0x7fb0d006a840 0x7fb0d006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d00cd950 0x7fb0d015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 --2- 172.21.15.32:0/2403174166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cede0 0x7fb0d015f570 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 -- 172.21.15.32:0/2403174166 >> 172.21.15.32:0/2403174166 conn(0x7fb0d006dae0 msgr2=0x7fb0d006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 -- 172.21.15.32:0/2403174166 shutdown_connections 2023-10-14T12:18:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.441+0000 7fb0d8642700 1 -- 172.21.15.32:0/2403174166 wait complete. 2023-10-14T12:18:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 Processor -- start 2023-10-14T12:18:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 -- start start 2023-10-14T12:18:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 0x7fb0d00ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cd950 0x7fb0d015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d00cede0 0x7fb0d015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d015c8f0 con 0x7fb0d00cd950 2023-10-14T12:18:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d015d0b0 con 0x7fb0d00cede0 2023-10-14T12:18:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.443+0000 7fb0d8642700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00caac0 con 0x7fb0d006a840 2023-10-14T12:18:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d5bdd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cd950 0x7fb0d015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 0x7fb0d00ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d6bdf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d00cede0 0x7fb0d015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 0x7fb0d00ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43168/0 (socket says 172.21.15.32:43168) 2023-10-14T12:18:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 -- 172.21.15.32:0/3606809870 learned_addr learned my addr 172.21.15.32:0/3606809870 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 -- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d00cede0 msgr2=0x7fb0d015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d00cede0 0x7fb0d015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 -- 172.21.15.32:0/3606809870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cd950 msgr2=0x7fb0d015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cd950 0x7fb0d015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 -- 172.21.15.32:0/3606809870 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009ad0 con 0x7fb0d006a840 2023-10-14T12:18:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d5bdd700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cd950 0x7fb0d015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.444+0000 7fb0d63de700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 0x7fb0d00ca400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009990 tx=0x7fb0c0009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0015880 con 0x7fb0d006a840 2023-10-14T12:18:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00159e0 con 0x7fb0d006a840 2023-10-14T12:18:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c0009500 con 0x7fb0d006a840 2023-10-14T12:18:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0015d70 con 0x7fb0d006a840 2023-10-14T12:18:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc009560 con 0x7fb0d006a840 2023-10-14T12:18:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0c001e400 con 0x7fb0d006a840 2023-10-14T12:18:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.449+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb0c0014550 con 0x7fb0d006a840 2023-10-14T12:18:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.450+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d0067d20 con 0x7fb0d006a840 2023-10-14T12:18:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.455+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb0c003db40 con 0x7fb0d006a840 2023-10-14T12:18:29.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.532+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb0d00b2630 con 0x7fb0d006a840 2023-10-14T12:18:29.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.540+0000 7fb0c6ffd700 1 -- 172.21.15.32:0/3606809870 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb0c002c020 con 0x7fb0d006a840 2023-10-14T12:18:29.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 msgr2=0x7fb0d00ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:29.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 0x7fb0d00ca400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009990 tx=0x7fb0c0009ca0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 shutdown_connections 2023-10-14T12:18:29.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0d00cede0 0x7fb0d015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0d006a840 0x7fb0d00ca400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 --2- 172.21.15.32:0/3606809870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0d00cd950 0x7fb0d015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:29.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 >> 172.21.15.32:0/3606809870 conn(0x7fb0d006dae0 msgr2=0x7fb0d00aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:29.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 shutdown_connections 2023-10-14T12:18:29.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:29.541+0000 7fb0d8642700 1 -- 172.21.15.32:0/3606809870 wait complete. 2023-10-14T12:18:29.544 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2023-10-14T12:18:29.549 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:29.547+0000 7f177b0b0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T12:18:29.555 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T12:18:29.555 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T12:18:29.556 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:29.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T12:18:29.560 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:29.559+0000 7fe0663f3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T12:18:29.583 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:29.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T12:18:29.613 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:29.612+0000 7f177b0b0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T12:18:29.634 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:29.633+0000 7fe0663f3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T12:18:29.651 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:29.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T12:18:29.689 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:29.688+0000 7f177b0b0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T12:18:29.719 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:18:29.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T12:18:29.720 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:29.718+0000 7fe0663f3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T12:18:29.747 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:29.748 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T12:18:29.768 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:29.767+0000 7f177b0b0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T12:18:29.776 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:29.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T12:18:29.807 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:29.806+0000 7fe0663f3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T12:18:29.842 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:29.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T12:18:29.910 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:18:29.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T12:18:29.922 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:29.920+0000 7f177b0b0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T12:18:29.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 4a30f715-7217-41fb-87f2-3b54902f54b7 0 2023-10-14T12:18:29.958 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:29.957+0000 7fe0663f3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T12:18:30.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.107+0000 7f2fe054c700 1 Processor -- start 2023-10-14T12:18:30.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.107+0000 7f2fe054c700 1 -- start start 2023-10-14T12:18:30.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fe054c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2fd806e750 0x7f2fd80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fe054c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 0x7f2fd80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fe054c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd80b5c70 con 0x7f2fd80b54f0 2023-10-14T12:18:30.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fe054c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd80b5990 con 0x7f2fd806e750 2023-10-14T12:18:30.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fe054c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd815b2b0 con 0x7f2fd806eb30 2023-10-14T12:18:30.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fddae7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 0x7f2fd80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fde2e8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2fd806e750 0x7f2fd80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fddae7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 0x7f2fd80cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59006/0 (socket says 172.21.15.92:59006) 2023-10-14T12:18:30.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.108+0000 7f2fddae7700 1 -- 172.21.15.92:0/2850527587 learned_addr learned my addr 172.21.15.92:0/2850527587 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fddae7700 1 -- 172.21.15.92:0/2850527587 >> v2:172.21.15.92:3300/0 conn(0x7f2fd806e750 msgr2=0x7f2fd80ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:30.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fddae7700 1 --2- 172.21.15.92:0/2850527587 >> v2:172.21.15.92:3300/0 conn(0x7f2fd806e750 0x7f2fd80ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fddae7700 1 -- 172.21.15.92:0/2850527587 >> v1:172.21.15.92:6789/0 conn(0x7f2fd80b54f0 legacy=0x7f2fd815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fddae7700 1 -- 172.21.15.92:0/2850527587 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd815b590 con 0x7f2fd806eb30 2023-10-14T12:18:30.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fddae7700 1 --2- 172.21.15.92:0/2850527587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 0x7f2fd80cf400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098f0 tx=0x7f2fc8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=544c6b01f8da51a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fdd2e6700 1 -- 172.21.15.92:0/2850527587 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8011830 con 0x7f2fd806eb30 2023-10-14T12:18:30.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fdd2e6700 1 -- 172.21.15.92:0/2850527587 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8011990 con 0x7f2fd806eb30 2023-10-14T12:18:30.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.109+0000 7f2fdd2e6700 1 -- 172.21.15.92:0/2850527587 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8011d20 con 0x7f2fd806eb30 2023-10-14T12:18:30.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 -- 172.21.15.92:0/2850527587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 msgr2=0x7f2fd80cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2850527587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 0x7f2fd80cf400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098f0 tx=0x7f2fc8009c00 comp rx=0 tx=0).stop 2023-10-14T12:18:30.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 -- 172.21.15.92:0/2850527587 shutdown_connections 2023-10-14T12:18:30.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2850527587 >> v2:172.21.15.92:3300/0 conn(0x7f2fd806e750 0x7f2fd80ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2850527587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd806eb30 0x7f2fd80cf400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 -- 172.21.15.92:0/2850527587 >> 172.21.15.92:0/2850527587 conn(0x7f2fd80cc6f0 msgr2=0x7f2fd80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 -- 172.21.15.92:0/2850527587 shutdown_connections 2023-10-14T12:18:30.117 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.110+0000 7f2fe054c700 1 -- 172.21.15.92:0/2850527587 wait complete. 2023-10-14T12:18:30.119 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.111+0000 7f2fe054c700 1 Processor -- start 2023-10-14T12:18:30.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.111+0000 7f2fe054c700 1 -- start start 2023-10-14T12:18:30.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd806e750 0x7f2fd8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 0x7f2fd80c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd80b54f0 0x7f2fd8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.120 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80c7cf0 con 0x7f2fd806e750 2023-10-14T12:18:30.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80b2e90 con 0x7f2fd806eb30 2023-10-14T12:18:30.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80b3170 con 0x7f2fd80b54f0 2023-10-14T12:18:30.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 0x7f2fd80c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fdeae9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd80b54f0 0x7f2fd8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 0x7f2fd80c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49650/0 (socket says 172.21.15.92:49650) 2023-10-14T12:18:30.121 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 -- 172.21.15.92:0/2625279648 learned_addr learned my addr 172.21.15.92:0/2625279648 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fde2e8700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd806e750 0x7f2fd8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 -- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd80b54f0 msgr2=0x7f2fd8150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd80b54f0 0x7f2fd8150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 -- 172.21.15.92:0/2625279648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd806e750 msgr2=0x7f2fd8152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.122 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd806e750 0x7f2fd8152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 -- 172.21.15.92:0/2625279648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8009550 con 0x7f2fd806eb30 2023-10-14T12:18:30.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fde2e8700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd806e750 0x7f2fd8152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:30.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fdeae9700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd80b54f0 0x7f2fd8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:30.123 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fddae7700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 0x7f2fd80c96c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8000c00 tx=0x7f2fc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc801d7c0 con 0x7f2fd806eb30 2023-10-14T12:18:30.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc801d920 con 0x7f2fd806eb30 2023-10-14T12:18:30.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd80b3450 con 0x7f2fd806eb30 2023-10-14T12:18:30.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc801dcd0 con 0x7f2fd806eb30 2023-10-14T12:18:30.124 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.112+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd80c7430 con 0x7f2fd806eb30 2023-10-14T12:18:30.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.113+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2fc80039a0 con 0x7f2fd806eb30 2023-10-14T12:18:30.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.113+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2fc8029720 con 0x7f2fd806eb30 2023-10-14T12:18:30.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.114+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd80b3970 con 0x7f2fd806eb30 2023-10-14T12:18:30.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.116+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2fd80b3970 con 0x7f2fd806eb30 2023-10-14T12:18:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.199+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a30f715-7217-41fb-87f2-3b54902f54b7", "id": 0} v 0) v1 -- 0x7f2fd8067d20 con 0x7f2fd806eb30 2023-10-14T12:18:30.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.205+0000 7f2fceffd700 1 -- 172.21.15.92:0/2625279648 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a30f715-7217-41fb-87f2-3b54902f54b7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2fc802e020 con 0x7f2fd806eb30 2023-10-14T12:18:30.208 INFO:teuthology.orchestra.run.smithi092.stdout:0 2023-10-14T12:18:30.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 msgr2=0x7f2fd80c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 0x7f2fd80c96c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8000c00 tx=0x7f2fc8004750 comp rx=0 tx=0).stop 2023-10-14T12:18:30.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 shutdown_connections 2023-10-14T12:18:30.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fd80b54f0 0x7f2fd8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd806e750 0x7f2fd8152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 --2- 172.21.15.92:0/2625279648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fd806eb30 0x7f2fd80c96c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 >> 172.21.15.92:0/2625279648 conn(0x7f2fd80cc6f0 msgr2=0x7f2fd806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 shutdown_connections 2023-10-14T12:18:30.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.206+0000 7f2fe054c700 1 -- 172.21.15.92:0/2625279648 wait complete. 2023-10-14T12:18:30.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new b510ad79-25de-47e7-896b-747dd8488598 1 2023-10-14T12:18:30.324 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:30.323+0000 7f177b0b0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T12:18:30.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.338+0000 7f3c04f3f700 1 Processor -- start 2023-10-14T12:18:30.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.338+0000 7f3c04f3f700 1 -- start start 2023-10-14T12:18:30.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3c04f3f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3c0006af50 0x7f3c000cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3c04f3f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c000b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3c04f3f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000b3530 con 0x7f3c0015f130 2023-10-14T12:18:30.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3c04f3f700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000cde00 con 0x7f3c0006af50 2023-10-14T12:18:30.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3c04f3f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cd180 con 0x7f3c000b28b0 2023-10-14T12:18:30.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c000b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c000b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59022/0 (socket says 172.21.15.92:59022) 2023-10-14T12:18:30.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 -- 172.21.15.92:0/3498257132 learned_addr learned my addr 172.21.15.92:0/3498257132 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfdd9b700 1 --2- 172.21.15.92:0/3498257132 >> v2:172.21.15.32:3300/0 conn(0x7f3c0006af50 0x7f3c000cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 -- 172.21.15.92:0/3498257132 >> v2:172.21.15.32:3300/0 conn(0x7f3c0006af50 msgr2=0x7f3c000cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:30.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 --2- 172.21.15.92:0/3498257132 >> v2:172.21.15.32:3300/0 conn(0x7f3c0006af50 0x7f3c000cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 -- 172.21.15.92:0/3498257132 >> v1:172.21.15.32:6789/0 conn(0x7f3c0015f130 legacy=0x7f3c0006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 -- 172.21.15.92:0/3498257132 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000cd460 con 0x7f3c000b28b0 2023-10-14T12:18:30.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.339+0000 7f3bfed9d700 1 --2- 172.21.15.92:0/3498257132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c000b3960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1f7a827aca595a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3bfd59a700 1 -- 172.21.15.92:0/3498257132 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800e070 con 0x7f3c000b28b0 2023-10-14T12:18:30.345 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3bfd59a700 1 -- 172.21.15.92:0/3498257132 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800b910 con 0x7f3c000b28b0 2023-10-14T12:18:30.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3bfd59a700 1 -- 172.21.15.92:0/3498257132 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800bcc0 con 0x7f3c000b28b0 2023-10-14T12:18:30.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 -- 172.21.15.92:0/3498257132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 msgr2=0x7f3c000b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/3498257132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c000b3960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:30.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 -- 172.21.15.92:0/3498257132 shutdown_connections 2023-10-14T12:18:30.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/3498257132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c000b3960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/3498257132 >> v2:172.21.15.32:3300/0 conn(0x7f3c0006af50 0x7f3c000cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 -- 172.21.15.92:0/3498257132 >> 172.21.15.92:0/3498257132 conn(0x7f3c0006dae0 msgr2=0x7f3c0006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 -- 172.21.15.92:0/3498257132 shutdown_connections 2023-10-14T12:18:30.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.340+0000 7f3c04f3f700 1 -- 172.21.15.92:0/3498257132 wait complete. 2023-10-14T12:18:30.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 Processor -- start 2023-10-14T12:18:30.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 -- start start 2023-10-14T12:18:30.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c0006af50 0x7f3c000c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c001569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c0015f130 0x7f3c000ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cabc0 con 0x7f3c0006af50 2023-10-14T12:18:30.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cae60 con 0x7f3c0015f130 2023-10-14T12:18:30.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3c04f3f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cb140 con 0x7f3c000b28b0 2023-10-14T12:18:30.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.342+0000 7f3bfdd9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c001569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c001569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59026/0 (socket says 172.21.15.92:59026) 2023-10-14T12:18:30.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 -- 172.21.15.92:0/2172937890 learned_addr learned my addr 172.21.15.92:0/2172937890 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfe59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c0006af50 0x7f3c000c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfed9d700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c0015f130 0x7f3c000ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 -- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c0015f130 msgr2=0x7f3c000ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c0015f130 0x7f3c000ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 -- 172.21.15.92:0/2172937890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c0006af50 msgr2=0x7f3c000c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c0006af50 0x7f3c000c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 -- 172.21.15.92:0/2172937890 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009b30 con 0x7f3c000b28b0 2023-10-14T12:18:30.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfe59c700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c0006af50 0x7f3c000c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:30.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3bfdd9b700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c001569d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400e890 tx=0x7f3bf400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4013680 con 0x7f3c000b28b0 2023-10-14T12:18:30.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf40137e0 con 0x7f3c000b28b0 2023-10-14T12:18:30.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000cb420 con 0x7f3c000b28b0 2023-10-14T12:18:30.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4013b50 con 0x7f3c000b28b0 2023-10-14T12:18:30.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c00156f10 con 0x7f3c000b28b0 2023-10-14T12:18:30.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3bf401c450 con 0x7f3c000b28b0 2023-10-14T12:18:30.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.343+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3bf4012950 con 0x7f3c000b28b0 2023-10-14T12:18:30.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.344+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000cba70 con 0x7f3c000b28b0 2023-10-14T12:18:30.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.346+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3bf403bb40 con 0x7f3c000b28b0 2023-10-14T12:18:30.374 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:30.373+0000 7fe0663f3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T12:18:30.432 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.431+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b510ad79-25de-47e7-896b-747dd8488598", "id": 1} v 0) v1 -- 0x7f3c00067d20 con 0x7f3c000b28b0 2023-10-14T12:18:30.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.435+0000 7f3beeffd700 1 -- 172.21.15.92:0/2172937890 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b510ad79-25de-47e7-896b-747dd8488598", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3bf402a030 con 0x7f3c000b28b0 2023-10-14T12:18:30.437 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-14T12:18:30.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 msgr2=0x7f3c001569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c001569d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400e890 tx=0x7f3bf400eba0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 shutdown_connections 2023-10-14T12:18:30.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c0015f130 0x7f3c000ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c0006af50 0x7f3c000c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 --2- 172.21.15.92:0/2172937890 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c000b28b0 0x7f3c001569d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 >> 172.21.15.92:0/2172937890 conn(0x7f3c0006dae0 msgr2=0x7f3c000d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 shutdown_connections 2023-10-14T12:18:30.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.436+0000 7f3c04f3f700 1 -- 172.21.15.92:0/2172937890 wait complete. 2023-10-14T12:18:30.447 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:30.446+0000 7f177b0b0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T12:18:30.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 7e2e45a9-a69f-4a75-8c80-206635e8a7a5 2 2023-10-14T12:18:30.496 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:30.495+0000 7fe0663f3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T12:18:30.546 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:30.545+0000 7f177b0b0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T12:18:30.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.568+0000 7fae5f310700 1 Processor -- start 2023-10-14T12:18:30.570 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.568+0000 7fae5f310700 1 -- start start 2023-10-14T12:18:30.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5f310700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae580cd950 0x7fae5815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5f310700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 0x7fae5806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5f310700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae580cf290 con 0x7fae580cede0 2023-10-14T12:18:30.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5f310700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae581619a0 con 0x7fae580cd950 2023-10-14T12:18:30.573 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5f310700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5806b1f0 con 0x7fae5806a840 2023-10-14T12:18:30.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5d8ad700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 0x7fae5806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5d8ad700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 0x7fae5806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59032/0 (socket says 172.21.15.92:59032) 2023-10-14T12:18:30.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5d8ad700 1 -- 172.21.15.92:0/3508871888 learned_addr learned my addr 172.21.15.92:0/3508871888 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.569+0000 7fae5d0ac700 1 --2- 172.21.15.92:0/3508871888 >> v2:172.21.15.92:3300/0 conn(0x7fae580cd950 0x7fae5815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5d0ac700 1 -- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 msgr2=0x7fae5806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:30.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5d0ac700 1 --2- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 0x7fae5806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5d0ac700 1 -- 172.21.15.92:0/3508871888 >> v1:172.21.15.32:6789/0 conn(0x7fae580cede0 legacy=0x7fae5815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5d0ac700 1 -- 172.21.15.92:0/3508871888 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580b2d60 con 0x7fae580cd950 2023-10-14T12:18:30.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5d8ad700 1 --2- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 0x7fae5806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:30.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5d0ac700 1 --2- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae580cd950 0x7fae5815e2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae54009840 tx=0x7fae54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5febb018d53f1b37 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae4ffff700 1 -- 172.21.15.92:0/3508871888 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54011830 con 0x7fae580cd950 2023-10-14T12:18:30.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae4ffff700 1 -- 172.21.15.92:0/3508871888 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54011990 con 0x7fae580cd950 2023-10-14T12:18:30.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae4ffff700 1 -- 172.21.15.92:0/3508871888 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54011d20 con 0x7fae580cd950 2023-10-14T12:18:30.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5f310700 1 -- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae580cd950 msgr2=0x7fae5815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.570+0000 7fae5f310700 1 --2- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae580cd950 0x7fae5815e2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae54009840 tx=0x7fae54009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:30.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.571+0000 7fae5f310700 1 -- 172.21.15.92:0/3508871888 shutdown_connections 2023-10-14T12:18:30.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.571+0000 7fae5f310700 1 --2- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae580cd950 0x7fae5815e2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.571+0000 7fae5f310700 1 --2- 172.21.15.92:0/3508871888 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae5806a840 0x7fae5806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.571+0000 7fae5f310700 1 -- 172.21.15.92:0/3508871888 >> 172.21.15.92:0/3508871888 conn(0x7fae5806dae0 msgr2=0x7fae5806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.571+0000 7fae5f310700 1 -- 172.21.15.92:0/3508871888 shutdown_connections 2023-10-14T12:18:30.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.571+0000 7fae5f310700 1 -- 172.21.15.92:0/3508871888 wait complete. 2023-10-14T12:18:30.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.572+0000 7fae5f310700 1 Processor -- start 2023-10-14T12:18:30.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.572+0000 7fae5f310700 1 -- start start 2023-10-14T12:18:30.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.572+0000 7fae5f310700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 0x7fae58156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae580cd950 0x7fae580b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae580cede0 0x7fae581530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58155cd0 con 0x7fae580cede0 2023-10-14T12:18:30.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae581553c0 con 0x7fae5806a840 2023-10-14T12:18:30.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae58156ed0 con 0x7fae580cd950 2023-10-14T12:18:30.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 0x7fae58156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5c8ab700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae580cd950 0x7fae580b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 0x7fae58156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49670/0 (socket says 172.21.15.92:49670) 2023-10-14T12:18:30.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 -- 172.21.15.92:0/2494680227 learned_addr learned my addr 172.21.15.92:0/2494680227 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d8ad700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae580cede0 0x7fae581530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 -- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae580cd950 msgr2=0x7fae580b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae580cd950 0x7fae580b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 -- 172.21.15.92:0/2494680227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae580cede0 msgr2=0x7fae581530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae580cede0 0x7fae581530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 -- 172.21.15.92:0/2494680227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50009b30 con 0x7fae5806a840 2023-10-14T12:18:30.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5d0ac700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 0x7fae58156530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae54009fd0 tx=0x7fae54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540036a0 con 0x7fae5806a840 2023-10-14T12:18:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5401f070 con 0x7fae5806a840 2023-10-14T12:18:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae540094a0 con 0x7fae5806a840 2023-10-14T12:18:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54003a60 con 0x7fae5806a840 2023-10-14T12:18:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.573+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae581558f0 con 0x7fae5806a840 2023-10-14T12:18:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.574+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae54026480 con 0x7fae5806a840 2023-10-14T12:18:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.574+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fae54021070 con 0x7fae5806a840 2023-10-14T12:18:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.574+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae58067d20 con 0x7fae5806a840 2023-10-14T12:18:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.576+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fae5402b020 con 0x7fae5806a840 2023-10-14T12:18:30.597 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:30.596+0000 7fe0663f3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T12:18:30.632 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:30.631+0000 7f177b0b0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T12:18:30.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.659+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e2e45a9-a69f-4a75-8c80-206635e8a7a5", "id": 2} v 0) v1 -- 0x7fae580b2630 con 0x7fae5806a840 2023-10-14T12:18:30.663 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.662+0000 7fae4dffb700 1 -- 172.21.15.92:0/2494680227 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e2e45a9-a69f-4a75-8c80-206635e8a7a5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae54015020 con 0x7fae5806a840 2023-10-14T12:18:30.664 INFO:teuthology.orchestra.run.smithi092.stdout:2 2023-10-14T12:18:30.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 msgr2=0x7fae58156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 0x7fae58156530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae54009fd0 tx=0x7fae54004750 comp rx=0 tx=0).stop 2023-10-14T12:18:30.665 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 shutdown_connections 2023-10-14T12:18:30.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae580cede0 0x7fae581530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae5806a840 0x7fae58156530 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 --2- 172.21.15.92:0/2494680227 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae580cd950 0x7fae580b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 >> 172.21.15.92:0/2494680227 conn(0x7fae5806dae0 msgr2=0x7fae580ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.666 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 shutdown_connections 2023-10-14T12:18:30.667 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.663+0000 7fae5f310700 1 -- 172.21.15.92:0/2494680227 wait complete. 2023-10-14T12:18:30.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 42e9134f-a98b-4516-ac90-0a8edb83f3c3 3 2023-10-14T12:18:30.682 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:30.681+0000 7fe0663f3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T12:18:30.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.799+0000 7f8995dc8700 1 Processor -- start 2023-10-14T12:18:30.801 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.799+0000 7f8995dc8700 1 -- start start 2023-10-14T12:18:30.804 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f8995dc8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f899006af50 0x7f89900cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f8995dc8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f8995dc8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89900b3530 con 0x7f899015f130 2023-10-14T12:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f8995dc8700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900cde00 con 0x7f899006af50 2023-10-14T12:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f8995dc8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cd180 con 0x7f89900b28b0 2023-10-14T12:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f898f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f899015f130 0x7f899006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36920/0 (socket says 172.21.15.92:36920) 2023-10-14T12:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f898f7fe700 1 -- 172.21.15.92:0/2405881537 learned_addr learned my addr 172.21.15.92:0/2405881537 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-10-14T12:18:30.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f898ffff700 1 --2- 172.21.15.92:0/2405881537 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f898effd700 1 --2- 172.21.15.92:0/2405881537 >> v2:172.21.15.32:3300/0 conn(0x7f899006af50 0x7f89900cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f898e7fc700 1 -- 172.21.15.92:0/2405881537 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053344048 0 0) 0x7f89900b3530 con 0x7f899015f130 2023-10-14T12:18:30.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.800+0000 7f898e7fc700 1 -- 172.21.15.92:0/2405881537 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c0035b0 con 0x7f899015f130 2023-10-14T12:18:30.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898ffff700 1 -- 172.21.15.92:0/2405881537 >> v2:172.21.15.32:3300/0 conn(0x7f899006af50 msgr2=0x7f89900cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:30.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898ffff700 1 --2- 172.21.15.92:0/2405881537 >> v2:172.21.15.32:3300/0 conn(0x7f899006af50 0x7f89900cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898ffff700 1 -- 172.21.15.92:0/2405881537 >> v1:172.21.15.92:6789/0 conn(0x7f899015f130 legacy=0x7f899006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898ffff700 1 -- 172.21.15.92:0/2405881537 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900cd460 con 0x7f89900b28b0 2023-10-14T12:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898ffff700 1 --2- 172.21.15.92:0/2405881537 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900b3960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8980009d90 tx=0x7f898000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5987b4fe52d9ef80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898e7fc700 1 -- 172.21.15.92:0/2405881537 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000e070 con 0x7f89900b28b0 2023-10-14T12:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898e7fc700 1 -- 172.21.15.92:0/2405881537 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898000bb20 con 0x7f89900b28b0 2023-10-14T12:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f898e7fc700 1 -- 172.21.15.92:0/2405881537 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980012430 con 0x7f89900b28b0 2023-10-14T12:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f8995dc8700 1 -- 172.21.15.92:0/2405881537 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 msgr2=0x7f89900b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.801+0000 7f8995dc8700 1 --2- 172.21.15.92:0/2405881537 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900b3960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8980009d90 tx=0x7f898000b330 comp rx=0 tx=0).stop 2023-10-14T12:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.802+0000 7f8995dc8700 1 -- 172.21.15.92:0/2405881537 shutdown_connections 2023-10-14T12:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.802+0000 7f8995dc8700 1 --2- 172.21.15.92:0/2405881537 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900b3960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.802+0000 7f8995dc8700 1 --2- 172.21.15.92:0/2405881537 >> v2:172.21.15.32:3300/0 conn(0x7f899006af50 0x7f89900cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.802+0000 7f8995dc8700 1 -- 172.21.15.92:0/2405881537 >> 172.21.15.92:0/2405881537 conn(0x7f899006dae0 msgr2=0x7f899006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.802+0000 7f8995dc8700 1 -- 172.21.15.92:0/2405881537 shutdown_connections 2023-10-14T12:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.802+0000 7f8995dc8700 1 -- 172.21.15.92:0/2405881537 wait complete. 2023-10-14T12:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.803+0000 7f8995dc8700 1 Processor -- start 2023-10-14T12:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.803+0000 7f8995dc8700 1 -- start start 2023-10-14T12:18:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f899006af50 0x7f89901f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 0x7f89901e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cb160 con 0x7f899006af50 2023-10-14T12:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cadc0 con 0x7f899015f130 2023-10-14T12:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89901f7060 con 0x7f89900b28b0 2023-10-14T12:18:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 0x7f89901e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 0x7f89901e6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49686/0 (socket says 172.21.15.92:49686) 2023-10-14T12:18:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59048/0 (socket says 172.21.15.92:59048) 2023-10-14T12:18:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 -- 172.21.15.92:0/798678242 learned_addr learned my addr 172.21.15.92:0/798678242 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898f7fe700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f899006af50 0x7f89901f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 -- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 msgr2=0x7f89900aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 -- 172.21.15.92:0/798678242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f899006af50 msgr2=0x7f89901f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f899006af50 0x7f89901f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 -- 172.21.15.92:0/798678242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8980009a70 con 0x7f899015f130 2023-10-14T12:18:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f898ffff700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 0x7f89901e6920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8980014040 tx=0x7f8980004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:30.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800129f0 con 0x7f899015f130 2023-10-14T12:18:30.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980020070 con 0x7f899015f130 2023-10-14T12:18:30.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89901f7330 con 0x7f899015f130 2023-10-14T12:18:30.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980012db0 con 0x7f899015f130 2023-10-14T12:18:30.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.804+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901f78f0 con 0x7f899015f130 2023-10-14T12:18:30.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.805+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8980004340 con 0x7f899015f130 2023-10-14T12:18:30.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.805+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8980022070 con 0x7f899015f130 2023-10-14T12:18:30.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.805+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89901f7a80 con 0x7f899015f130 2023-10-14T12:18:30.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.807+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8980004820 con 0x7f899015f130 2023-10-14T12:18:30.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.890+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42e9134f-a98b-4516-ac90-0a8edb83f3c3", "id": 3} v 0) v1 -- 0x7f89900c3e70 con 0x7f899015f130 2023-10-14T12:18:30.894 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.893+0000 7f8987fff700 1 -- 172.21.15.92:0/798678242 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42e9134f-a98b-4516-ac90-0a8edb83f3c3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8980027c80 con 0x7f899015f130 2023-10-14T12:18:30.894 INFO:teuthology.orchestra.run.smithi092.stdout:3 2023-10-14T12:18:30.895 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 msgr2=0x7f89901e6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:30.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 0x7f89901e6920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8980014040 tx=0x7f8980004ad0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 shutdown_connections 2023-10-14T12:18:30.896 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f899015f130 0x7f89901e6920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f899006af50 0x7f89901f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 --2- 172.21.15.92:0/798678242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89900b28b0 0x7f89900aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:30.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 >> 172.21.15.92:0/798678242 conn(0x7f899006dae0 msgr2=0x7f89900aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:30.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 shutdown_connections 2023-10-14T12:18:30.897 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:30.894+0000 7f8995dc8700 1 -- 172.21.15.92:0/798678242 wait complete. 2023-10-14T12:18:30.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a 4 2023-10-14T12:18:31.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.032+0000 7f9137e88700 1 Processor -- start 2023-10-14T12:18:31.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.032+0000 7f9137e88700 1 -- start start 2023-10-14T12:18:31.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9137e88700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91300d0c70 0x7f91300cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9137e88700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f91300ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9137e88700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91300d23e0 con 0x7f913015b740 2023-10-14T12:18:31.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9137e88700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913015bb20 con 0x7f91300d0c70 2023-10-14T12:18:31.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9137e88700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300cf190 con 0x7f91300c5110 2023-10-14T12:18:31.037 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9136425700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f91300ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9136425700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f91300ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59056/0 (socket says 172.21.15.92:59056) 2023-10-14T12:18:31.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9136425700 1 -- 172.21.15.92:0/174121674 learned_addr learned my addr 172.21.15.92:0/174121674 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.033+0000 7f9135423700 1 --2- 172.21.15.92:0/174121674 >> v2:172.21.15.32:3300/0 conn(0x7f91300d0c70 0x7f91300cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9136425700 1 -- 172.21.15.92:0/174121674 >> v2:172.21.15.32:3300/0 conn(0x7f91300d0c70 msgr2=0x7f91300cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:31.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9136425700 1 --2- 172.21.15.92:0/174121674 >> v2:172.21.15.32:3300/0 conn(0x7f91300d0c70 0x7f91300cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9136425700 1 -- 172.21.15.92:0/174121674 >> v1:172.21.15.32:6789/0 conn(0x7f913015b740 legacy=0x7f91300d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9136425700 1 -- 172.21.15.92:0/174121674 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300cbd40 con 0x7f91300c5110 2023-10-14T12:18:31.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9136425700 1 --2- 172.21.15.92:0/174121674 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f91300ce510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9128009e50 tx=0x7f912800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b9454e6e089bce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9134c22700 1 -- 172.21.15.92:0/174121674 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800e070 con 0x7f91300c5110 2023-10-14T12:18:31.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9134c22700 1 -- 172.21.15.92:0/174121674 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912800b910 con 0x7f91300c5110 2023-10-14T12:18:31.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9134c22700 1 -- 172.21.15.92:0/174121674 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800bcc0 con 0x7f91300c5110 2023-10-14T12:18:31.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9137e88700 1 -- 172.21.15.92:0/174121674 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 msgr2=0x7f91300ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.034+0000 7f9137e88700 1 --2- 172.21.15.92:0/174121674 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f91300ce510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9128009e50 tx=0x7f912800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:31.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.035+0000 7f9137e88700 1 -- 172.21.15.92:0/174121674 shutdown_connections 2023-10-14T12:18:31.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.035+0000 7f9137e88700 1 --2- 172.21.15.92:0/174121674 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f91300ce510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.035+0000 7f9137e88700 1 --2- 172.21.15.92:0/174121674 >> v2:172.21.15.32:3300/0 conn(0x7f91300d0c70 0x7f91300cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.035+0000 7f9137e88700 1 -- 172.21.15.92:0/174121674 >> 172.21.15.92:0/174121674 conn(0x7f91300665a0 msgr2=0x7f9130066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.035+0000 7f9137e88700 1 -- 172.21.15.92:0/174121674 shutdown_connections 2023-10-14T12:18:31.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.035+0000 7f9137e88700 1 -- 172.21.15.92:0/174121674 wait complete. 2023-10-14T12:18:31.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.036+0000 7f9137e88700 1 Processor -- start 2023-10-14T12:18:31.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.036+0000 7f9137e88700 1 -- start start 2023-10-14T12:18:31.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f913015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91300d0c70 0x7f913015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f913015b740 0x7f91301f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913015c8d0 con 0x7f91300d0c70 2023-10-14T12:18:31.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913015cba0 con 0x7f913015b740 2023-10-14T12:18:31.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913015ce80 con 0x7f91300c5110 2023-10-14T12:18:31.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f913015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f913015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59058/0 (socket says 172.21.15.92:59058) 2023-10-14T12:18:31.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 -- 172.21.15.92:0/2801581936 learned_addr learned my addr 172.21.15.92:0/2801581936 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9136425700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f913015b740 0x7f91301f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135423700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91300d0c70 0x7f913015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 -- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f913015b740 msgr2=0x7f91301f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f913015b740 0x7f91301f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 -- 172.21.15.92:0/2801581936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91300d0c70 msgr2=0x7f913015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91300d0c70 0x7f913015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 -- 172.21.15.92:0/2801581936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128009b30 con 0x7f91300c5110 2023-10-14T12:18:31.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9135c24700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f913015be50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c450 tx=0x7f912c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c0052d0 con 0x7f91300c5110 2023-10-14T12:18:31.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c005430 con 0x7f91300c5110 2023-10-14T12:18:31.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913015d160 con 0x7f91300c5110 2023-10-14T12:18:31.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c0038c0 con 0x7f91300c5110 2023-10-14T12:18:31.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.037+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913014fdd0 con 0x7f91300c5110 2023-10-14T12:18:31.050 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.038+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f912c003d20 con 0x7f91300c5110 2023-10-14T12:18:31.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.038+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f912c011d10 con 0x7f91300c5110 2023-10-14T12:18:31.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.039+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913015d960 con 0x7f91300c5110 2023-10-14T12:18:31.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.041+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f912c017070 con 0x7f91300c5110 2023-10-14T12:18:31.086 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:31.085+0000 7f177b0b0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T12:18:31.123 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:31.121+0000 7fe0663f3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T12:18:31.125 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.124+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a", "id": 4} v 0) v1 -- 0x7f913014ff90 con 0x7f91300c5110 2023-10-14T12:18:31.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.127+0000 7f91267fc700 1 -- 172.21.15.92:0/2801581936 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f91300d23e0 con 0x7f91300c5110 2023-10-14T12:18:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:4 2023-10-14T12:18:31.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 msgr2=0x7f913015be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f913015be50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c450 tx=0x7f912c00c760 comp rx=0 tx=0).stop 2023-10-14T12:18:31.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 shutdown_connections 2023-10-14T12:18:31.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f913015b740 0x7f91301f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91300c5110 0x7f913015be50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 --2- 172.21.15.92:0/2801581936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91300d0c70 0x7f913015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.128+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 >> 172.21.15.92:0/2801581936 conn(0x7f91300665a0 msgr2=0x7f91300cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.129+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 shutdown_connections 2023-10-14T12:18:31.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.129+0000 7f9137e88700 1 -- 172.21.15.92:0/2801581936 wait complete. 2023-10-14T12:18:31.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new e2d13906-ef87-447f-bac3-9371176c87c6 5 2023-10-14T12:18:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.264+0000 7fc593d28700 1 Processor -- start 2023-10-14T12:18:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.264+0000 7fc593d28700 1 -- start start 2023-10-14T12:18:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc593d28700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0cf8a0 0x7fc58c0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc593d28700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c15ee90 con 0x7fc58c15eab0 2023-10-14T12:18:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc593d28700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c158370 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc593d28700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0d23b0 con 0x7fc58c0cf8a0 2023-10-14T12:18:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc5912c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0cf8a0 0x7fc58c0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc5922c5700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc58c0d1bc0 0x7fc58c0cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36948/0 (socket says 172.21.15.92:36948) 2023-10-14T12:18:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc5922c5700 1 -- 172.21.15.92:0/3739245273 learned_addr learned my addr 172.21.15.92:0/3739245273 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-10-14T12:18:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc590ac2700 1 -- 172.21.15.92:0/3739245273 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965548273 0 0) 0x7fc58c158370 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc5912c3700 1 -- 172.21.15.92:0/3739245273 >> v1:172.21.15.92:6789/0 conn(0x7fc58c0d1bc0 legacy=0x7fc58c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc5912c3700 1 -- 172.21.15.92:0/3739245273 >> v1:172.21.15.32:6789/0 conn(0x7fc58c15eab0 legacy=0x7fc58c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.265+0000 7fc5912c3700 1 -- 172.21.15.92:0/3739245273 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0cda20 con 0x7fc58c0cf8a0 2023-10-14T12:18:31.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc5912c3700 1 --2- 172.21.15.92:0/3739245273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0cf8a0 0x7fc58c0d1680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009870 tx=0x7fc57c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187d8a76d225462c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc590ac2700 1 -- 172.21.15.92:0/3739245273 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c011830 con 0x7fc58c0cf8a0 2023-10-14T12:18:31.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc590ac2700 1 -- 172.21.15.92:0/3739245273 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c011990 con 0x7fc58c0cf8a0 2023-10-14T12:18:31.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc590ac2700 1 -- 172.21.15.92:0/3739245273 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c011d20 con 0x7fc58c0cf8a0 2023-10-14T12:18:31.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 -- 172.21.15.92:0/3739245273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0cf8a0 msgr2=0x7fc58c0d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 --2- 172.21.15.92:0/3739245273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0cf8a0 0x7fc58c0d1680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009870 tx=0x7fc57c009b80 comp rx=0 tx=0).stop 2023-10-14T12:18:31.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 -- 172.21.15.92:0/3739245273 shutdown_connections 2023-10-14T12:18:31.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 --2- 172.21.15.92:0/3739245273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0cf8a0 0x7fc58c0d1680 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 -- 172.21.15.92:0/3739245273 >> 172.21.15.92:0/3739245273 conn(0x7fc58c0665a0 msgr2=0x7fc58c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 -- 172.21.15.92:0/3739245273 shutdown_connections 2023-10-14T12:18:31.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.266+0000 7fc593d28700 1 -- 172.21.15.92:0/3739245273 wait complete. 2023-10-14T12:18:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 Processor -- start 2023-10-14T12:18:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 -- start start 2023-10-14T12:18:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc58c0cf8a0 0x7fc58c14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 0x7fc58c0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc58c15eab0 0x7fc58c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c7fc0 con 0x7fc58c15eab0 2023-10-14T12:18:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1f6860 con 0x7fc58c0cf8a0 2023-10-14T12:18:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc593d28700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1f6b40 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc5912c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 0x7fc58c0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc591ac4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc58c0cf8a0 0x7fc58c14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc5912c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 0x7fc58c0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:59072/0 (socket says 172.21.15.92:59072) 2023-10-14T12:18:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc5912c3700 1 -- 172.21.15.92:0/1083235418 learned_addr learned my addr 172.21.15.92:0/1083235418 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.268+0000 7fc5922c5700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc58c15eab0 0x7fc58c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5912c3700 1 -- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc58c0cf8a0 msgr2=0x7fc58c14e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5912c3700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc58c0cf8a0 0x7fc58c14e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5912c3700 1 -- 172.21.15.92:0/1083235418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc58c15eab0 msgr2=0x7fc58c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5912c3700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc58c15eab0 0x7fc58c0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5912c3700 1 -- 172.21.15.92:0/1083235418 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0094a0 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5912c3700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 0x7fc58c0c96e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc57c014040 tx=0x7fc57c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0036a0 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c01e070 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c1f6e20 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c003a60 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c1f73e0 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc57c02d440 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.269+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc57c01a9a0 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.270+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c067d20 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.272+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc57c020070 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.356+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2d13906-ef87-447f-bac3-9371176c87c6", "id": 5} v 0) v1 -- 0x7fc58c15d8d0 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.359+0000 7fc5827fc700 1 -- 172.21.15.92:0/1083235418 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2d13906-ef87-447f-bac3-9371176c87c6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc57c015020 con 0x7fc58c0d1bc0 2023-10-14T12:18:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:5 2023-10-14T12:18:31.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 msgr2=0x7fc58c0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 0x7fc58c0c96e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc57c014040 tx=0x7fc57c004750 comp rx=0 tx=0).stop 2023-10-14T12:18:31.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 shutdown_connections 2023-10-14T12:18:31.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc58c15eab0 0x7fc58c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc58c0cf8a0 0x7fc58c14e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 --2- 172.21.15.92:0/1083235418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc58c0d1bc0 0x7fc58c0c96e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 >> 172.21.15.92:0/1083235418 conn(0x7fc58c0665a0 msgr2=0x7fc58c0cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 shutdown_connections 2023-10-14T12:18:31.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.360+0000 7fc593d28700 1 -- 172.21.15.92:0/1083235418 wait complete. 2023-10-14T12:18:31.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new b2885cf8-8304-4748-8f49-664b88012f98 6 2023-10-14T12:18:31.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.516+0000 7f14f3894700 1 Processor -- start 2023-10-14T12:18:31.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.517+0000 7f14f3894700 1 -- start start 2023-10-14T12:18:31.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f3894700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f3894700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14ec0cd210 0x7f14ec0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f3894700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec15a290 con 0x7f14ec0cba30 2023-10-14T12:18:31.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f3894700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec0cdfd0 con 0x7f14ec0cd210 2023-10-14T12:18:31.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f3894700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0cdbd0 con 0x7f14ec159eb0 2023-10-14T12:18:31.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f0e2f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14ec0cd210 0x7f14ec0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f0e2f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14ec0cd210 0x7f14ec0cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49712/0 (socket says 172.21.15.92:49712) 2023-10-14T12:18:31.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f0e2f700 1 -- 172.21.15.92:0/322972163 learned_addr learned my addr 172.21.15.92:0/322972163 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.519+0000 7f14f1630700 1 --2- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14f0e2f700 1 -- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 msgr2=0x7f14ec0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:31.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14f0e2f700 1 --2- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14f0e2f700 1 -- 172.21.15.92:0/322972163 >> v1:172.21.15.32:6789/0 conn(0x7f14ec0cba30 legacy=0x7f14ec0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:31.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14f0e2f700 1 -- 172.21.15.92:0/322972163 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0cb7e0 con 0x7f14ec0cd210 2023-10-14T12:18:31.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14f0e2f700 1 --2- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec0cd690 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14e400b1a0 tx=0x7f14e400b4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ddb34e50d973d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14e3fff700 1 -- 172.21.15.92:0/322972163 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400e070 con 0x7f14ec0cd210 2023-10-14T12:18:31.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.520+0000 7f14e3fff700 1 -- 172.21.15.92:0/322972163 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40090d0 con 0x7f14ec0cd210 2023-10-14T12:18:31.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 -- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 msgr2=0x7f14ec0cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 --2- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec0cd690 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14e400b1a0 tx=0x7f14e400b4b0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.526 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 -- 172.21.15.92:0/322972163 shutdown_connections 2023-10-14T12:18:31.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 --2- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 --2- 172.21.15.92:0/322972163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec0cd690 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 -- 172.21.15.92:0/322972163 >> 172.21.15.92:0/322972163 conn(0x7f14ec0cf430 msgr2=0x7f14ec0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 -- 172.21.15.92:0/322972163 shutdown_connections 2023-10-14T12:18:31.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.521+0000 7f14f3894700 1 -- 172.21.15.92:0/322972163 wait complete. 2023-10-14T12:18:31.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.523+0000 7f14f3894700 1 Processor -- start 2023-10-14T12:18:31.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.523+0000 7f14f3894700 1 -- start start 2023-10-14T12:18:31.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f3894700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 0x7f14ec0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f3894700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f3894700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f3894700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0c5250 con 0x7f14ec0cba30 2023-10-14T12:18:31.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f3894700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1f3310 con 0x7f14ec0cd210 2023-10-14T12:18:31.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f3894700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1f2420 con 0x7f14ec159eb0 2023-10-14T12:18:31.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f1630700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 0x7f14ec0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f1630700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 0x7f14ec0c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.92:57946/0 (socket says 172.21.15.92:57946) 2023-10-14T12:18:31.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f1630700 1 -- 172.21.15.92:0/3185134627 learned_addr learned my addr 172.21.15.92:0/3185134627 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f0e2f700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.524+0000 7f14f1e31700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f1630700 1 -- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 msgr2=0x7f14ec0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f1630700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f1630700 1 -- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 msgr2=0x7f14ec157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f1630700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f1630700 1 -- 172.21.15.92:0/3185134627 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4009b30 con 0x7f14ec0cba30 2023-10-14T12:18:31.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f1630700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 0x7f14ec0c4d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14dc010ed0 tx=0x7f14dc00d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc012040 con 0x7f14ec0cba30 2023-10-14T12:18:31.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc00ddb0 con 0x7f14ec0cba30 2023-10-14T12:18:31.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc018610 con 0x7f14ec0cba30 2023-10-14T12:18:31.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.525+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec1f2700 con 0x7f14ec0cba30 2023-10-14T12:18:31.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.526+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec1f2cc0 con 0x7f14ec0cba30 2023-10-14T12:18:31.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.526+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f14dc018770 con 0x7f14ec0cba30 2023-10-14T12:18:31.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.526+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f14dc022dc0 con 0x7f14ec0cba30 2023-10-14T12:18:31.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.527+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec04ebb0 con 0x7f14ec0cba30 2023-10-14T12:18:31.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.532+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f14dc018c00 con 0x7f14ec0cba30 2023-10-14T12:18:31.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.625+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2885cf8-8304-4748-8f49-664b88012f98", "id": 6} v 0) v1 -- 0x7f14ec0ce980 con 0x7f14ec0cba30 2023-10-14T12:18:31.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.627+0000 7f14e1ffb700 1 -- 172.21.15.92:0/3185134627 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2885cf8-8304-4748-8f49-664b88012f98", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14dc018da0 con 0x7f14ec0cba30 2023-10-14T12:18:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:6 2023-10-14T12:18:31.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 msgr2=0x7f14ec0c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 0x7f14ec0c4d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14dc010ed0 tx=0x7f14dc00d390 comp rx=0 tx=0).stop 2023-10-14T12:18:31.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 shutdown_connections 2023-10-14T12:18:31.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14ec159eb0 0x7f14ec0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0cba30 0x7f14ec0c4d10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 --2- 172.21.15.92:0/3185134627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14ec0cd210 0x7f14ec157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 >> 172.21.15.92:0/3185134627 conn(0x7f14ec0cf430 msgr2=0x7f14ec0c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 shutdown_connections 2023-10-14T12:18:31.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.628+0000 7f14f3894700 1 -- 172.21.15.92:0/3185134627 wait complete. 2023-10-14T12:18:31.642 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 09251b8b-4019-4e97-968a-b24fa2abc702 7 2023-10-14T12:18:31.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.763+0000 7f0db8afd700 1 Processor -- start 2023-10-14T12:18:31.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.763+0000 7f0db8afd700 1 -- start start 2023-10-14T12:18:31.767 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.764+0000 7f0db8afd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0db40cd950 0x7f0db415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.764+0000 7f0db8afd700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40cf290 con 0x7f0db40cede0 2023-10-14T12:18:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.764+0000 7f0db8afd700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40b2d60 con 0x7f0db406a840 2023-10-14T12:18:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.764+0000 7f0db8afd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db41619a0 con 0x7f0db40cd950 2023-10-14T12:18:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0db40cd950 0x7f0db415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0db40cd950 0x7f0db415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49724/0 (socket says 172.21.15.92:49724) 2023-10-14T12:18:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 -- 172.21.15.92:0/169492763 learned_addr learned my addr 172.21.15.92:0/169492763 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 -- 172.21.15.92:0/169492763 >> v1:172.21.15.92:6789/0 conn(0x7f0db406a840 legacy=0x7f0db4161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 -- 172.21.15.92:0/169492763 >> v1:172.21.15.32:6789/0 conn(0x7f0db40cede0 legacy=0x7f0db415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 -- 172.21.15.92:0/169492763 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40cdd30 con 0x7f0db40cd950 2023-10-14T12:18:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db259c700 1 --2- 172.21.15.92:0/169492763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db40cd950 0x7f0db415e2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0da40098f0 tx=0x7f0da4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4823829506174eaa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db159a700 1 -- 172.21.15.92:0/169492763 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400b8a0 con 0x7f0db40cd950 2023-10-14T12:18:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db159a700 1 -- 172.21.15.92:0/169492763 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400ba00 con 0x7f0db40cd950 2023-10-14T12:18:31.771 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f0db159a700 1 -- 172.21.15.92:0/169492763 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400bd90 con 0x7f0db40cd950 2023-10-14T12:18:31.771 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:31.765+0000 7f177b0b0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T12:18:31.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 -- 172.21.15.92:0/169492763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db40cd950 msgr2=0x7f0db415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 --2- 172.21.15.92:0/169492763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db40cd950 0x7f0db415e2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0da40098f0 tx=0x7f0da4009c00 comp rx=0 tx=0).stop 2023-10-14T12:18:31.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 -- 172.21.15.92:0/169492763 shutdown_connections 2023-10-14T12:18:31.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 --2- 172.21.15.92:0/169492763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db40cd950 0x7f0db415e2f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 -- 172.21.15.92:0/169492763 >> 172.21.15.92:0/169492763 conn(0x7f0db406dae0 msgr2=0x7f0db406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 -- 172.21.15.92:0/169492763 shutdown_connections 2023-10-14T12:18:31.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.766+0000 7f0db8afd700 1 -- 172.21.15.92:0/169492763 wait complete. 2023-10-14T12:18:31.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.767+0000 7f0db8afd700 1 Processor -- start 2023-10-14T12:18:31.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.767+0000 7f0db8afd700 1 -- start start 2023-10-14T12:18:31.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db8afd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 0x7f0db4153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db8afd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db40cd950 0x7f0db40ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db8afd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db40cede0 0x7f0db40ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:31.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db8afd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40c4000 con 0x7f0db40cede0 2023-10-14T12:18:31.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db8afd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40c42e0 con 0x7f0db406a840 2023-10-14T12:18:31.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db8afd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40c45c0 con 0x7f0db40cd950 2023-10-14T12:18:31.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 0x7f0db4153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 0x7f0db4153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49730/0 (socket says 172.21.15.92:49730) 2023-10-14T12:18:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db40cd950 0x7f0db40ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db259c700 1 -- 172.21.15.92:0/2663498608 learned_addr learned my addr 172.21.15.92:0/2663498608 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T12:18:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db2d9d700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db40cede0 0x7f0db40ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:31.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 -- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 msgr2=0x7f0db4153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 0x7f0db4153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 -- 172.21.15.92:0/2663498608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db40cede0 msgr2=0x7f0db40ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db40cede0 0x7f0db40ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 -- 172.21.15.92:0/2663498608 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009550 con 0x7f0db40cd950 2023-10-14T12:18:31.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db259c700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 0x7f0db4153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:31.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.768+0000 7f0db1d9b700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db40cd950 0x7f0db40ad930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c370 tx=0x7f0da800c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:31.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80052d0 con 0x7f0db40cd950 2023-10-14T12:18:31.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8005450 con 0x7f0db40cd950 2023-10-14T12:18:31.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db40c48a0 con 0x7f0db40cd950 2023-10-14T12:18:31.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8003910 con 0x7f0db40cd950 2023-10-14T12:18:31.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db4153f70 con 0x7f0db40cd950 2023-10-14T12:18:31.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0da801c440 con 0x7f0db40cd950 2023-10-14T12:18:31.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.769+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0da8003d70 con 0x7f0db40cd950 2023-10-14T12:18:31.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.770+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4067d20 con 0x7f0db40cd950 2023-10-14T12:18:31.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.772+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0da8017070 con 0x7f0db40cd950 2023-10-14T12:18:31.795 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:31.794+0000 7fe0663f3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T12:18:31.839 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:31.837+0000 7f177b0b0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T12:18:31.857 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.856+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09251b8b-4019-4e97-968a-b24fa2abc702", "id": 7} v 0) v1 -- 0x7f0db40b2630 con 0x7f0db40cd950 2023-10-14T12:18:31.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.864+0000 7f0da2ffd700 1 -- 172.21.15.92:0/2663498608 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09251b8b-4019-4e97-968a-b24fa2abc702", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0da801c8d0 con 0x7f0db40cd950 2023-10-14T12:18:31.865 INFO:teuthology.orchestra.run.smithi092.stdout:7 2023-10-14T12:18:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.864+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db40cd950 msgr2=0x7f0db40ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.864+0000 7f0db8afd700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db40cd950 0x7f0db40ad930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c370 tx=0x7f0da800c680 comp rx=0 tx=0).stop 2023-10-14T12:18:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.864+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 shutdown_connections 2023-10-14T12:18:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.865+0000 7f0db8afd700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db40cede0 0x7f0db40ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.865+0000 7f0db8afd700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db406a840 0x7f0db4153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.865+0000 7f0db8afd700 1 --2- 172.21.15.92:0/2663498608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db40cd950 0x7f0db40ad930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.865+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 >> 172.21.15.92:0/2663498608 conn(0x7f0db406dae0 msgr2=0x7f0db40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.865+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 shutdown_connections 2023-10-14T12:18:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T12:18:31.865+0000 7f0db8afd700 1 -- 172.21.15.92:0/2663498608 wait complete. 2023-10-14T12:18:31.869 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:31.866+0000 7fe0663f3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T12:18:31.878 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T12:18:31.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T12:18:31.881 INFO:tasks.ceph.osd.0:Started 2023-10-14T12:18:31.881 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T12:18:31.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T12:18:31.883 INFO:tasks.ceph.osd.1:Started 2023-10-14T12:18:31.884 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T12:18:31.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T12:18:31.886 INFO:tasks.ceph.osd.2:Started 2023-10-14T12:18:31.887 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T12:18:31.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T12:18:31.889 INFO:tasks.ceph.osd.3:Started 2023-10-14T12:18:31.889 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T12:18:31.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T12:18:31.892 INFO:tasks.ceph.osd.4:Started 2023-10-14T12:18:31.892 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T12:18:31.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T12:18:31.894 INFO:tasks.ceph.osd.5:Started 2023-10-14T12:18:31.895 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T12:18:31.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T12:18:31.897 INFO:tasks.ceph.osd.6:Started 2023-10-14T12:18:31.898 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T12:18:31.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T12:18:31.904 INFO:tasks.ceph.osd.7:Started 2023-10-14T12:18:31.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:32.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.064+0000 7f9957c0c700 1 Processor -- start 2023-10-14T12:18:32.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.064+0000 7f9957c0c700 1 -- start start 2023-10-14T12:18:32.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f9957c0c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500b2980 0x7f995006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:32.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f9957c0c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f99500728e0 0x7f995015e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:32.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f9957c0c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9950070040 con 0x7f995015a8e0 2023-10-14T12:18:32.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f9957c0c700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500d0420 con 0x7f99500728e0 2023-10-14T12:18:32.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f9957c0c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500afce0 con 0x7f99500b2980 2023-10-14T12:18:32.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f99561a9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f99500728e0 0x7f995015e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:32.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f99561a9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f99500728e0 0x7f995015e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37510/0 (socket says 172.21.15.32:37510) 2023-10-14T12:18:32.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f99561a9700 1 -- 172.21.15.32:0/2639062782 learned_addr learned my addr 172.21.15.32:0/2639062782 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:32.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.065+0000 7f99551a7700 1 --2- 172.21.15.32:0/2639062782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500b2980 0x7f995006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:32.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99561a9700 1 -- 172.21.15.32:0/2639062782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500b2980 msgr2=0x7f995006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:32.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99561a9700 1 --2- 172.21.15.32:0/2639062782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500b2980 0x7f995006fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99561a9700 1 -- 172.21.15.32:0/2639062782 >> v1:172.21.15.92:6789/0 conn(0x7f995015a8e0 legacy=0x7f99500b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:32.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99561a9700 1 -- 172.21.15.32:0/2639062782 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950071e00 con 0x7f99500728e0 2023-10-14T12:18:32.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99561a9700 1 --2- 172.21.15.32:0/2639062782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99500728e0 0x7f995015e450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f994800d150 tx=0x7f994800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92117afeab002a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:32.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99549a6700 1 -- 172.21.15.32:0/2639062782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948010070 con 0x7f99500728e0 2023-10-14T12:18:32.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99549a6700 1 -- 172.21.15.32:0/2639062782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994800dd10 con 0x7f99500728e0 2023-10-14T12:18:32.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f99549a6700 1 -- 172.21.15.32:0/2639062782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800b310 con 0x7f99500728e0 2023-10-14T12:18:32.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f9957c0c700 1 -- 172.21.15.32:0/2639062782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99500728e0 msgr2=0x7f995015e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:32.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.066+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2639062782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99500728e0 0x7f995015e450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f994800d150 tx=0x7f994800d460 comp rx=0 tx=0).stop 2023-10-14T12:18:32.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.067+0000 7f9957c0c700 1 -- 172.21.15.32:0/2639062782 shutdown_connections 2023-10-14T12:18:32.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.067+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2639062782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99500728e0 0x7f995015e450 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.067+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2639062782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500b2980 0x7f995006fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.067+0000 7f9957c0c700 1 -- 172.21.15.32:0/2639062782 >> 172.21.15.32:0/2639062782 conn(0x7f99500cd270 msgr2=0x7f99500cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:32.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.067+0000 7f9957c0c700 1 -- 172.21.15.32:0/2639062782 shutdown_connections 2023-10-14T12:18:32.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.067+0000 7f9957c0c700 1 -- 172.21.15.32:0/2639062782 wait complete. 2023-10-14T12:18:32.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.068+0000 7f9957c0c700 1 Processor -- start 2023-10-14T12:18:32.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.068+0000 7f9957c0c700 1 -- start start 2023-10-14T12:18:32.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f9957c0c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500728e0 0x7f99500c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:32.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f9957c0c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500b2980 0x7f99500c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:32.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f9957c0c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 0x7f99500ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:32.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f9957c0c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995015bcd0 con 0x7f995015a8e0 2023-10-14T12:18:32.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f9957c0c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c5820 con 0x7f99500b2980 2023-10-14T12:18:32.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f9957c0c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c6640 con 0x7f99500728e0 2023-10-14T12:18:32.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f99561a9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 0x7f99500ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:32.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.069+0000 7f99551a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500b2980 0x7f99500c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:32.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 0x7f99500ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37516/0 (socket says 172.21.15.32:37516) 2023-10-14T12:18:32.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99551a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500b2980 0x7f99500c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:41782/0 (socket says 172.21.15.32:41782) 2023-10-14T12:18:32.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 -- 172.21.15.32:0/2522906944 learned_addr learned my addr 172.21.15.32:0/2522906944 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:32.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99559a8700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500728e0 0x7f99500c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:32.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 -- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500728e0 msgr2=0x7f99500c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:32.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500728e0 0x7f99500c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 -- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500b2980 msgr2=0x7f99500c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:32.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500b2980 0x7f99500c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 -- 172.21.15.32:0/2522906944 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994800bd40 con 0x7f995015a8e0 2023-10-14T12:18:32.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99561a9700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 0x7f99500ca180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9948014000 tx=0x7f9948004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:32.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800bbc0 con 0x7f995015a8e0 2023-10-14T12:18:32.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994800b4c0 con 0x7f995015a8e0 2023-10-14T12:18:32.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500c5a30 con 0x7f995015a8e0 2023-10-14T12:18:32.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800ae70 con 0x7f995015a8e0 2023-10-14T12:18:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500c5ff0 con 0x7f995015a8e0 2023-10-14T12:18:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9948004340 con 0x7f995015a8e0 2023-10-14T12:18:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.070+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9948026410 con 0x7f995015a8e0 2023-10-14T12:18:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.071+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950067d20 con 0x7f995015a8e0 2023-10-14T12:18:32.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.073+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9948021030 con 0x7f995015a8e0 2023-10-14T12:18:32.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.144+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99500c6780 con 0x7f995015a8e0 2023-10-14T12:18:32.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.145+0000 7f99467fc700 1 -- 172.21.15.32:0/2522906944 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9948004820 con 0x7f995015a8e0 2023-10-14T12:18:32.146 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:32.147 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:31.858033+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 msgr2=0x7f99500ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 0x7f99500ca180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9948014000 tx=0x7f9948004ad0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 shutdown_connections 2023-10-14T12:18:32.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f995015a8e0 0x7f99500ca180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500728e0 0x7f99500c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 --2- 172.21.15.32:0/2522906944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500b2980 0x7f99500c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:32.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 >> 172.21.15.32:0/2522906944 conn(0x7f99500cd270 msgr2=0x7f99500cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:32.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 shutdown_connections 2023-10-14T12:18:32.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:32.146+0000 7f9957c0c700 1 -- 172.21.15.32:0/2522906944 wait complete. 2023-10-14T12:18:32.159 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T12:18:32.160 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T12:18:32.247 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T12:18:32.245+0000 7fe5bf99c640 -1 Falling back to public interface 2023-10-14T12:18:32.498 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T12:18:32.496+0000 7f91ea637640 -1 Falling back to public interface 2023-10-14T12:18:32.509 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-14T12:18:32.507+0000 7fb5c33d3640 -1 Falling back to public interface 2023-10-14T12:18:32.517 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-14T12:18:32.516+0000 7f55cf159640 -1 Falling back to public interface 2023-10-14T12:18:32.522 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T12:18:32.520+0000 7f58e038a640 -1 Falling back to public interface 2023-10-14T12:18:32.522 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T12:18:32.521+0000 7fd82bdc6640 -1 Falling back to public interface 2023-10-14T12:18:32.528 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-14T12:18:32.527+0000 7f7430904640 -1 Falling back to public interface 2023-10-14T12:18:32.529 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-14T12:18:32.528+0000 7f869763f640 -1 Falling back to public interface 2023-10-14T12:18:32.564 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:32.562+0000 7f177b0b0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:18:32.627 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:32.625+0000 7fe0663f3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:18:32.641 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:32.639+0000 7f177b0b0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T12:18:32.708 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:32.707+0000 7fe0663f3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T12:18:32.783 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:32.782+0000 7f177b0b0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:18:32.857 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:32.856+0000 7fe0663f3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:18:32.965 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:33.019 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:33.018+0000 7f177b0b0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T12:18:33.081 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.079+0000 7f2ab764e700 1 Processor -- start 2023-10-14T12:18:33.081 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.080+0000 7f2ab764e700 1 -- start start 2023-10-14T12:18:33.083 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.080+0000 7f2ab764e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab015da20 0x7f2ab00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:33.084 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.080+0000 7f2ab764e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ab006afe0 0x7f2ab006e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:33.084 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.080+0000 7f2ab764e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab0072940 con 0x7f2ab00b39b0 2023-10-14T12:18:33.084 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.080+0000 7f2ab764e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab0071d30 con 0x7f2ab006afe0 2023-10-14T12:18:33.084 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.080+0000 7f2ab764e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab0072010 con 0x7f2ab015da20 2023-10-14T12:18:33.084 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ab006afe0 0x7f2ab006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:33.085 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ab006afe0 0x7f2ab006e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37522/0 (socket says 172.21.15.32:37522) 2023-10-14T12:18:33.085 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 -- 172.21.15.32:0/2080965364 learned_addr learned my addr 172.21.15.32:0/2080965364 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:33.085 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab53ea700 1 --2- 172.21.15.32:0/2080965364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab015da20 0x7f2ab00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:33.085 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 -- 172.21.15.32:0/2080965364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab015da20 msgr2=0x7f2ab00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:33.085 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 --2- 172.21.15.32:0/2080965364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab015da20 0x7f2ab00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.086 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 -- 172.21.15.32:0/2080965364 >> v1:172.21.15.92:6789/0 conn(0x7f2ab00b39b0 legacy=0x7f2ab006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:33.086 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 -- 172.21.15.32:0/2080965364 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00722f0 con 0x7f2ab006afe0 2023-10-14T12:18:33.086 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2ab5beb700 1 --2- 172.21.15.32:0/2080965364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab006afe0 0x7f2ab006e030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009e50 tx=0x7f2aa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e26cd299274073 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:33.086 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2aa7fff700 1 -- 172.21.15.32:0/2080965364 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800e070 con 0x7f2ab006afe0 2023-10-14T12:18:33.086 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2aa7fff700 1 -- 172.21.15.32:0/2080965364 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa800b910 con 0x7f2ab006afe0 2023-10-14T12:18:33.087 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.081+0000 7f2aa7fff700 1 -- 172.21.15.32:0/2080965364 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800bcc0 con 0x7f2ab006afe0 2023-10-14T12:18:33.087 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 -- 172.21.15.32:0/2080965364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab006afe0 msgr2=0x7f2ab006e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:33.087 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 --2- 172.21.15.32:0/2080965364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab006afe0 0x7f2ab006e030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009e50 tx=0x7f2aa800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:33.087 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 -- 172.21.15.32:0/2080965364 shutdown_connections 2023-10-14T12:18:33.087 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 --2- 172.21.15.32:0/2080965364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab006afe0 0x7f2ab006e030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.088 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 --2- 172.21.15.32:0/2080965364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab015da20 0x7f2ab00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.088 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 -- 172.21.15.32:0/2080965364 >> 172.21.15.32:0/2080965364 conn(0x7f2ab00cce30 msgr2=0x7f2ab00cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:33.088 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 -- 172.21.15.32:0/2080965364 shutdown_connections 2023-10-14T12:18:33.088 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.082+0000 7f2ab764e700 1 -- 172.21.15.32:0/2080965364 wait complete. 2023-10-14T12:18:33.091 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.084+0000 7f2ab764e700 1 Processor -- start 2023-10-14T12:18:33.091 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.084+0000 7f2ab764e700 1 -- start start 2023-10-14T12:18:33.091 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab764e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab006afe0 0x7f2ab015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:33.092 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab764e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab00b39b0 0x7f2ab015f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:33.092 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab764e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 0x7f2ab01f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:33.092 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab764e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00cc410 con 0x7f2ab015da20 2023-10-14T12:18:33.092 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab764e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab015f580 con 0x7f2ab00b39b0 2023-10-14T12:18:33.092 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab764e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab015f810 con 0x7f2ab006afe0 2023-10-14T12:18:33.093 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 0x7f2ab01f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:33.093 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 0x7f2ab01f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37528/0 (socket says 172.21.15.32:37528) 2023-10-14T12:18:33.093 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 -- 172.21.15.32:0/1438701995 learned_addr learned my addr 172.21.15.32:0/1438701995 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:33.093 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab4be9700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab00b39b0 0x7f2ab015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:33.093 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab53ea700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab006afe0 0x7f2ab015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:33.094 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 -- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab006afe0 msgr2=0x7f2ab015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:33.094 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab006afe0 0x7f2ab015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.094 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 -- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab00b39b0 msgr2=0x7f2ab015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:33.094 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab00b39b0 0x7f2ab015f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.094 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 -- 172.21.15.32:0/1438701995 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8009b30 con 0x7f2ab015da20 2023-10-14T12:18:33.095 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab53ea700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab006afe0 0x7f2ab015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:33.095 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.085+0000 7f2ab5beb700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 0x7f2ab01f3010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8012000 tx=0x7f2aa8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:33.095 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8004800 con 0x7f2ab015da20 2023-10-14T12:18:33.095 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8004960 con 0x7f2ab015da20 2023-10-14T12:18:33.095 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab00c3f80 con 0x7f2ab015da20 2023-10-14T12:18:33.096 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa801b670 con 0x7f2ab015da20 2023-10-14T12:18:33.096 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab00c4540 con 0x7f2ab015da20 2023-10-14T12:18:33.096 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2aa801bad0 con 0x7f2ab015da20 2023-10-14T12:18:33.096 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.086+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2aa8026db0 con 0x7f2ab015da20 2023-10-14T12:18:33.096 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.087+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab0074d70 con 0x7f2ab015da20 2023-10-14T12:18:33.097 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.089+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2aa80266e0 con 0x7f2ab015da20 2023-10-14T12:18:33.111 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:33.110+0000 7fe0663f3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T12:18:33.161 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.160+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ab009ded0 con 0x7f2ab015da20 2023-10-14T12:18:33.162 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.161+0000 7f2aa5ffb700 1 -- 172.21.15.32:0/1438701995 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2aa8026880 con 0x7f2ab015da20 2023-10-14T12:18:33.163 INFO:teuthology.misc.health.smithi032.stdout: 2023-10-14T12:18:33.163 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:31.858033+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:33.164 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 msgr2=0x7f2ab01f3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:33.164 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 0x7f2ab01f3010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8012000 tx=0x7f2aa8004ad0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.164 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 shutdown_connections 2023-10-14T12:18:33.164 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ab015da20 0x7f2ab01f3010 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.165 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ab006afe0 0x7f2ab015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.165 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 --2- 172.21.15.32:0/1438701995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ab00b39b0 0x7f2ab015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:33.165 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 >> 172.21.15.32:0/1438701995 conn(0x7f2ab00cce30 msgr2=0x7f2ab00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:33.165 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 shutdown_connections 2023-10-14T12:18:33.166 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:33.162+0000 7f2ab764e700 1 -- 172.21.15.32:0/1438701995 wait complete. 2023-10-14T12:18:33.174 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T12:18:33.231 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:33.230+0000 7f177b0b0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T12:18:33.332 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:33.331+0000 7fe0663f3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T12:18:33.365 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:33.364+0000 7f177b0b0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T12:18:33.473 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:33.472+0000 7fe0663f3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T12:18:33.584 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:33.582+0000 7f177b0b0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T12:18:33.702 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:33.701+0000 7fe0663f3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T12:18:33.740 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:33.739+0000 7f177b0b0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T12:18:33.854 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:33.853+0000 7f177b0b0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T12:18:33.864 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:33.863+0000 7fe0663f3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T12:18:33.985 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:33.984+0000 7fe0663f3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T12:18:34.178 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:34.176+0000 7f177b0b0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T12:18:34.277 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:34.275+0000 7f177b0b0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T12:18:34.320 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:34.319+0000 7fe0663f3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T12:18:34.424 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:34.422+0000 7fe0663f3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T12:18:34.462 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:34.461+0000 7f177b0b0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T12:18:34.617 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:34.616+0000 7fe0663f3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T12:18:35.076 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:35.075+0000 7f177b0b0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T12:18:35.254 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-14T12:18:35.252+0000 7fe0663f3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T12:18:35.763 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T12:18:35.762+0000 7fe5bf99c640 -1 osd.4 0 log_to_monitors true 2023-10-14T12:18:36.008 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T12:18:36.007+0000 7f91ea637640 -1 osd.5 0 log_to_monitors true 2023-10-14T12:18:36.038 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T12:18:36.037+0000 7fd82bdc6640 -1 osd.7 0 log_to_monitors true 2023-10-14T12:18:36.039 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T12:18:36.037+0000 7f58e038a640 -1 osd.6 0 log_to_monitors true 2023-10-14T12:18:36.045 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-14T12:18:36.044+0000 7f55cf159640 -1 osd.1 0 log_to_monitors true 2023-10-14T12:18:36.062 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-14T12:18:36.061+0000 7fb5c33d3640 -1 osd.0 0 log_to_monitors true 2023-10-14T12:18:36.066 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-14T12:18:36.065+0000 7f7430904640 -1 osd.3 0 log_to_monitors true 2023-10-14T12:18:36.078 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-14T12:18:36.077+0000 7f869763f640 -1 osd.2 0 log_to_monitors true 2023-10-14T12:18:36.102 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:36.100+0000 7f173303e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T12:18:36.102 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T12:18:36.101+0000 7f173303e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T12:18:38.542 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-14T12:18:38.541+0000 7f55c2d10700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T12:18:38.546 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-14T12:18:38.545+0000 7f868b1f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T12:18:38.548 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-14T12:18:38.547+0000 7f74244bb700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T12:18:38.559 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-14T12:18:38.558+0000 7fb5b6f8a700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T12:18:38.560 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-14T12:18:38.559+0000 7f55bb0eb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:38.560 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-14T12:18:38.559+0000 7f86835d1700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:38.603 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-14T12:18:38.602+0000 7f741c896700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:38.604 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-14T12:18:38.603+0000 7fb5af365700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:39.224 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T12:18:39.219+0000 7fd81f97d700 -1 osd.7 0 waiting for initial osdmap 2023-10-14T12:18:39.230 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T12:18:39.228+0000 7f91de1ee700 -1 osd.5 0 waiting for initial osdmap 2023-10-14T12:18:39.236 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T12:18:39.235+0000 7fd817d58700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:39.246 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T12:18:39.245+0000 7f91d65c9700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:39.250 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T12:18:39.249+0000 7fe5b3553700 -1 osd.4 0 waiting for initial osdmap 2023-10-14T12:18:39.258 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T12:18:39.257+0000 7f58d3f41700 -1 osd.6 0 waiting for initial osdmap 2023-10-14T12:18:39.265 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T12:18:39.264+0000 7fe5ab92e700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:39.269 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T12:18:39.268+0000 7f58cc31c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:18:39.980 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:40.110 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.109+0000 7f0f87859700 1 Processor -- start 2023-10-14T12:18:40.111 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.109+0000 7f0f87859700 1 -- start start 2023-10-14T12:18:40.113 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f87859700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f800d1480 0x7f0f80162060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.113 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f87859700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f8015dce0 0x7f0f800b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.113 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f87859700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f801625a0 con 0x7f0f800d1e60 2023-10-14T12:18:40.113 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f87859700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800cf7a0 con 0x7f0f800d1480 2023-10-14T12:18:40.114 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f87859700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800cf310 con 0x7f0f8015dce0 2023-10-14T12:18:40.114 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f800d1480 0x7f0f80162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.114 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f800d1480 0x7f0f80162060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37732/0 (socket says 172.21.15.32:37732) 2023-10-14T12:18:40.115 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 -- 172.21.15.32:0/2841932640 learned_addr learned my addr 172.21.15.32:0/2841932640 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:40.115 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f85df6700 1 --2- 172.21.15.32:0/2841932640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f8015dce0 0x7f0f800b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.115 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 -- 172.21.15.32:0/2841932640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f8015dce0 msgr2=0x7f0f800b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:40.115 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 --2- 172.21.15.32:0/2841932640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f8015dce0 0x7f0f800b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.116 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 -- 172.21.15.32:0/2841932640 >> v1:172.21.15.92:6789/0 conn(0x7f0f800d1e60 legacy=0x7f0f8015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.116 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.110+0000 7f0f84df4700 1 -- 172.21.15.32:0/2841932640 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f800ce700 con 0x7f0f800d1480 2023-10-14T12:18:40.116 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f84df4700 1 --2- 172.21.15.32:0/2841932640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f800d1480 0x7f0f80162060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0098f0 tx=0x7f0f7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe49eba75532a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.116 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f73fff700 1 -- 172.21.15.32:0/2841932640 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c011830 con 0x7f0f800d1480 2023-10-14T12:18:40.116 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f73fff700 1 -- 172.21.15.32:0/2841932640 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c011990 con 0x7f0f800d1480 2023-10-14T12:18:40.117 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f73fff700 1 -- 172.21.15.32:0/2841932640 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c011d20 con 0x7f0f800d1480 2023-10-14T12:18:40.117 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f87859700 1 -- 172.21.15.32:0/2841932640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f800d1480 msgr2=0x7f0f80162060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.117 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f87859700 1 --2- 172.21.15.32:0/2841932640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f800d1480 0x7f0f80162060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0098f0 tx=0x7f0f7c009c00 comp rx=0 tx=0).stop 2023-10-14T12:18:40.117 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f87859700 1 -- 172.21.15.32:0/2841932640 shutdown_connections 2023-10-14T12:18:40.117 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f87859700 1 --2- 172.21.15.32:0/2841932640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f8015dce0 0x7f0f800b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.118 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f87859700 1 --2- 172.21.15.32:0/2841932640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f800d1480 0x7f0f80162060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.118 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.111+0000 7f0f87859700 1 -- 172.21.15.32:0/2841932640 >> 172.21.15.32:0/2841932640 conn(0x7f0f800d36c0 msgr2=0x7f0f800d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:40.118 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.112+0000 7f0f87859700 1 -- 172.21.15.32:0/2841932640 shutdown_connections 2023-10-14T12:18:40.118 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.112+0000 7f0f87859700 1 -- 172.21.15.32:0/2841932640 wait complete. 2023-10-14T12:18:40.121 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.113+0000 7f0f87859700 1 Processor -- start 2023-10-14T12:18:40.122 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.113+0000 7f0f87859700 1 -- start start 2023-10-14T12:18:40.122 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f800d1480 0x7f0f80159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.122 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f800d1e60 0x7f0f800cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.122 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 0x7f0f800cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.123 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8015a420 con 0x7f0f8015dce0 2023-10-14T12:18:40.123 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800cc590 con 0x7f0f800d1480 2023-10-14T12:18:40.123 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800cc870 con 0x7f0f800d1e60 2023-10-14T12:18:40.123 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 0x7f0f800cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.123 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 0x7f0f800cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37740/0 (socket says 172.21.15.32:37740) 2023-10-14T12:18:40.124 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 -- 172.21.15.32:0/3800405127 learned_addr learned my addr 172.21.15.32:0/3800405127 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:40.124 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f84df4700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f800d1e60 0x7f0f800cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.124 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f855f5700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f800d1480 0x7f0f80159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.124 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 -- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f800d1e60 msgr2=0x7f0f800cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.124 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f800d1e60 0x7f0f800cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.125 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 -- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f800d1480 msgr2=0x7f0f80159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.125 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f800d1480 0x7f0f80159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.125 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 -- 172.21.15.32:0/3800405127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c009550 con 0x7f0f8015dce0 2023-10-14T12:18:40.125 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f85df6700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 0x7f0f800cbf60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800efc0 tx=0x7f0f78009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.125 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78009b20 con 0x7f0f8015dce0 2023-10-14T12:18:40.126 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800f040 con 0x7f0f8015dce0 2023-10-14T12:18:40.126 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800cc90 con 0x7f0f8015dce0 2023-10-14T12:18:40.126 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.114+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f800ccb50 con 0x7f0f8015dce0 2023-10-14T12:18:40.126 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.115+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f800cd110 con 0x7f0f8015dce0 2023-10-14T12:18:40.126 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.116+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f800cd300 con 0x7f0f8015dce0 2023-10-14T12:18:40.127 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.116+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f0f78014480 con 0x7f0f8015dce0 2023-10-14T12:18:40.127 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.116+0000 7f0f71ffb700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0f6406ae70 0x7f0f6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.127 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.117+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f0f78089a30 con 0x7f0f8015dce0 2023-10-14T12:18:40.127 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.117+0000 7f0f855f5700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0f6406ae70 0x7f0f6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.128 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.117+0000 7f0f855f5700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0f6406ae70 0x7f0f6406d330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000fb0 tx=0x7f0f74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.128 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.122+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f78055080 con 0x7f0f8015dce0 2023-10-14T12:18:40.324 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.323+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f80074d70 con 0x7f0f8015dce0 2023-10-14T12:18:40.324 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.323+0000 7f0f71ffb700 1 -- 172.21.15.32:0/3800405127 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7f0f78018090 con 0x7f0f8015dce0 2023-10-14T12:18:40.325 INFO:teuthology.misc.health.smithi032.stdout: 2023-10-14T12:18:40.325 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":13,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:39.323337+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:40.327 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.325+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0f6406ae70 msgr2=0x7f0f6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.327 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.325+0000 7f0f87859700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0f6406ae70 0x7f0f6406d330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000fb0 tx=0x7f0f74009040 comp rx=0 tx=0).stop 2023-10-14T12:18:40.327 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.325+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 msgr2=0x7f0f800cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.327 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.325+0000 7f0f87859700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 0x7f0f800cbf60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800efc0 tx=0x7f0f78009f60 comp rx=0 tx=0).stop 2023-10-14T12:18:40.328 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.325+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 shutdown_connections 2023-10-14T12:18:40.328 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.325+0000 7f0f87859700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8015dce0 0x7f0f800cbf60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.328 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.326+0000 7f0f87859700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0f6406ae70 0x7f0f6406d330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.328 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.326+0000 7f0f87859700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f800d1480 0x7f0f80159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.329 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.326+0000 7f0f87859700 1 --2- 172.21.15.32:0/3800405127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f800d1e60 0x7f0f800cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.329 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.326+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 >> 172.21.15.32:0/3800405127 conn(0x7f0f800d36c0 msgr2=0x7f0f80160e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:40.330 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.326+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 shutdown_connections 2023-10-14T12:18:40.330 INFO:teuthology.misc.health.smithi032.stderr:2023-10-14T12:18:40.326+0000 7f0f87859700 1 -- 172.21.15.32:0/3800405127 wait complete. 2023-10-14T12:18:40.338 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T12:18:40.339 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T12:18:40.339 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T12:18:40.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T12:18:40.344 INFO:tasks.ceph.mds.a:Started 2023-10-14T12:18:40.344 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T12:18:40.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T12:18:40.346 INFO:tasks.ceph.mds.c:Started 2023-10-14T12:18:40.347 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T12:18:40.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T12:18:40.351 INFO:tasks.ceph.mds.b:Started 2023-10-14T12:18:40.351 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T12:18:40.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T12:18:40.354 INFO:tasks.ceph.mds.d:Started 2023-10-14T12:18:40.355 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T12:18:40.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:40.427 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2023-10-14T12:18:40.427 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2023-10-14T12:18:40.428 INFO:tasks.ceph.mds.a.smithi032.stderr:2023-10-14T12:18:40.427+0000 7f521111e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2023-10-14T12:18:40.439 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-10-14T12:18:40.440 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-10-14T12:18:40.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.487+0000 7f0a7921e700 1 Processor -- start 2023-10-14T12:18:40.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.487+0000 7f0a7921e700 1 -- start start 2023-10-14T12:18:40.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7921e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0a7415dbc0 0x7f0a7415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7921e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7921e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a740b7050 0x7f0a740d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7921e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7415e4e0 con 0x7f0a7415dbc0 2023-10-14T12:18:40.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7921e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740b7560 con 0x7f0a740b7050 2023-10-14T12:18:40.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7921e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b7840 con 0x7f0a740d3fc0 2023-10-14T12:18:40.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0a7415dbc0 0x7f0a7415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0a7415dbc0 0x7f0a7415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37790/0 (socket says 172.21.15.32:37790) 2023-10-14T12:18:40.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 -- 172.21.15.32:0/3430820115 learned_addr learned my addr 172.21.15.32:0/3430820115 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:40.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 -- 172.21.15.32:0/3430820115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 msgr2=0x7f0a740d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:40.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7259c700 1 --2- 172.21.15.32:0/3430820115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 --2- 172.21.15.32:0/3430820115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 -- 172.21.15.32:0/3430820115 >> v2:172.21.15.92:3300/0 conn(0x7f0a740b7050 msgr2=0x7f0a740d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:40.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a7359e700 1 --2- 172.21.15.32:0/3430820115 >> v2:172.21.15.92:3300/0 conn(0x7f0a740b7050 0x7f0a740d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 --2- 172.21.15.32:0/3430820115 >> v2:172.21.15.92:3300/0 conn(0x7f0a740b7050 0x7f0a740d2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 -- 172.21.15.32:0/3430820115 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740b7b20 con 0x7f0a7415dbc0 2023-10-14T12:18:40.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.488+0000 7f0a72d9d700 1 --2- 172.21.15.32:0/3430820115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a7415dbc0 0x7f0a7415dfa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a7408daa0 tx=0x7f0a68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bf998adef74bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a71d9b700 1 -- 172.21.15.32:0/3430820115 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68005e30 con 0x7f0a7415dbc0 2023-10-14T12:18:40.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a71d9b700 1 -- 172.21.15.32:0/3430820115 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68004030 con 0x7f0a7415dbc0 2023-10-14T12:18:40.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a71d9b700 1 -- 172.21.15.32:0/3430820115 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680043e0 con 0x7f0a7415dbc0 2023-10-14T12:18:40.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 -- 172.21.15.32:0/3430820115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a7415dbc0 msgr2=0x7f0a7415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 --2- 172.21.15.32:0/3430820115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a7415dbc0 0x7f0a7415dfa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a7408daa0 tx=0x7f0a68009bd0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 -- 172.21.15.32:0/3430820115 shutdown_connections 2023-10-14T12:18:40.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 --2- 172.21.15.32:0/3430820115 >> v2:172.21.15.92:3300/0 conn(0x7f0a740b7050 0x7f0a740d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 --2- 172.21.15.32:0/3430820115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a7415dbc0 0x7f0a7415dfa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 --2- 172.21.15.32:0/3430820115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 -- 172.21.15.32:0/3430820115 >> 172.21.15.32:0/3430820115 conn(0x7f0a7409cb40 msgr2=0x7f0a740d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:40.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 -- 172.21.15.32:0/3430820115 shutdown_connections 2023-10-14T12:18:40.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.489+0000 7f0a7921e700 1 -- 172.21.15.32:0/3430820115 wait complete. 2023-10-14T12:18:40.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 Processor -- start 2023-10-14T12:18:40.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 -- start start 2023-10-14T12:18:40.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 0x7f0a740cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a7415dbc0 0x7f0a740a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7415c620 con 0x7f0a740b7050 2023-10-14T12:18:40.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740a1330 con 0x7f0a7415dbc0 2023-10-14T12:18:40.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a7921e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740ca900 con 0x7f0a740d3fc0 2023-10-14T12:18:40.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a72d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 0x7f0a740cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a72d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 0x7f0a740cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37796/0 (socket says 172.21.15.32:37796) 2023-10-14T12:18:40.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.491+0000 7f0a72d9d700 1 -- 172.21.15.32:0/275627370 learned_addr learned my addr 172.21.15.32:0/275627370 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:40.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a7359e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a7415dbc0 0x7f0a740a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a7259c700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a72d9d700 1 -- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 msgr2=0x7f0a740a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a72d9d700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a72d9d700 1 -- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a7415dbc0 msgr2=0x7f0a740a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a72d9d700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a7415dbc0 0x7f0a740a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a72d9d700 1 -- 172.21.15.32:0/275627370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68009500 con 0x7f0a740b7050 2023-10-14T12:18:40.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a7359e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a7415dbc0 0x7f0a740a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:40.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a72d9d700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 0x7f0a740cbc60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009c10 tx=0x7f0a68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68011620 con 0x7f0a740b7050 2023-10-14T12:18:40.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a680117a0 con 0x7f0a740b7050 2023-10-14T12:18:40.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a740cabe0 con 0x7f0a740b7050 2023-10-14T12:18:40.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68011b50 con 0x7f0a740b7050 2023-10-14T12:18:40.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.492+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a740cb1a0 con 0x7f0a740b7050 2023-10-14T12:18:40.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.493+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7404ebb0 con 0x7f0a740b7050 2023-10-14T12:18:40.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.494+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f0a68011cb0 con 0x7f0a740b7050 2023-10-14T12:18:40.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.494+0000 7f0a5b7fe700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0a6006ae70 0x7f0a6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.494+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f0a6808a290 con 0x7f0a740b7050 2023-10-14T12:18:40.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.494+0000 7f0a7259c700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0a6006ae70 0x7f0a6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.495+0000 7f0a7259c700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0a6006ae70 0x7f0a6006d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a7406bd30 tx=0x7f0a64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.499+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a68055980 con 0x7f0a740b7050 2023-10-14T12:18:40.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.703+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a7415d090 con 0x7f0a740b7050 2023-10-14T12:18:40.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.703+0000 7f0a5b7fe700 1 -- 172.21.15.32:0/275627370 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11044 (secure 0 0 0) 0x7f0a68016090 con 0x7f0a740b7050 2023-10-14T12:18:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:40.706 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:40.333924+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:40.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0a6006ae70 msgr2=0x7f0a6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0a6006ae70 0x7f0a6006d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a7406bd30 tx=0x7f0a64008040 comp rx=0 tx=0).stop 2023-10-14T12:18:40.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 msgr2=0x7f0a740cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 0x7f0a740cbc60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009c10 tx=0x7f0a68004750 comp rx=0 tx=0).stop 2023-10-14T12:18:40.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 shutdown_connections 2023-10-14T12:18:40.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0a6006ae70 0x7f0a6006d330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a7415dbc0 0x7f0a740a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a740b7050 0x7f0a740cbc60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 --2- 172.21.15.32:0/275627370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a740d3fc0 0x7f0a740a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.705+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 >> 172.21.15.32:0/275627370 conn(0x7f0a7409cb40 msgr2=0x7f0a740b9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:40.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.706+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 shutdown_connections 2023-10-14T12:18:40.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.706+0000 7f0a7921e700 1 -- 172.21.15.32:0/275627370 wait complete. 2023-10-14T12:18:40.719 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-14T12:18:40.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:18:40.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.843+0000 7fab334f4700 1 Processor -- start 2023-10-14T12:18:40.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.844+0000 7fab334f4700 1 -- start start 2023-10-14T12:18:40.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.844+0000 7fab334f4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab2c06ef20 0x7fab2c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.844+0000 7fab334f4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab2c0ce0b0 0x7fab2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.844+0000 7fab334f4700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c15bf30 con 0x7fab2c15bb50 2023-10-14T12:18:40.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.844+0000 7fab334f4700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c0ce540 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.844+0000 7fab334f4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c0b2d70 con 0x7fab2c06ef20 2023-10-14T12:18:40.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31290700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fab2c15bb50 0x7fab2c06e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54836/0 (socket says 172.21.15.32:54836) 2023-10-14T12:18:40.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31290700 1 -- 172.21.15.32:0/940919534 learned_addr learned my addr 172.21.15.32:0/940919534 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:40.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31a91700 1 --2- 172.21.15.32:0/940919534 >> v2:172.21.15.32:3300/0 conn(0x7fab2c0ce0b0 0x7fab2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab30a8f700 1 --2- 172.21.15.32:0/940919534 >> v2:172.21.15.92:3300/0 conn(0x7fab2c06ef20 0x7fab2c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab1ffff700 1 -- 172.21.15.32:0/940919534 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375881401 0 0) 0x7fab2c15bf30 con 0x7fab2c15bb50 2023-10-14T12:18:40.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab1ffff700 1 -- 172.21.15.32:0/940919534 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab180035b0 con 0x7fab2c15bb50 2023-10-14T12:18:40.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31a91700 1 -- 172.21.15.32:0/940919534 >> v2:172.21.15.92:3300/0 conn(0x7fab2c06ef20 msgr2=0x7fab2c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:40.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31a91700 1 --2- 172.21.15.32:0/940919534 >> v2:172.21.15.92:3300/0 conn(0x7fab2c06ef20 0x7fab2c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31a91700 1 -- 172.21.15.32:0/940919534 >> v1:172.21.15.32:6789/0 conn(0x7fab2c15bb50 legacy=0x7fab2c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31a91700 1 -- 172.21.15.32:0/940919534 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c06d500 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab31a91700 1 --2- 172.21.15.32:0/940919534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c06a840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab2c070e90 tx=0x7fab2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c40ed25e4206436 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab1ffff700 1 -- 172.21.15.32:0/940919534 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2400e070 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab1ffff700 1 -- 172.21.15.32:0/940919534 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2400bb20 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.845+0000 7fab1ffff700 1 -- 172.21.15.32:0/940919534 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24012430 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 -- 172.21.15.32:0/940919534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 msgr2=0x7fab2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 --2- 172.21.15.32:0/940919534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c06a840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab2c070e90 tx=0x7fab2400b330 comp rx=0 tx=0).stop 2023-10-14T12:18:40.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 -- 172.21.15.32:0/940919534 shutdown_connections 2023-10-14T12:18:40.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 --2- 172.21.15.32:0/940919534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c06a840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 --2- 172.21.15.32:0/940919534 >> v2:172.21.15.92:3300/0 conn(0x7fab2c06ef20 0x7fab2c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 -- 172.21.15.32:0/940919534 >> 172.21.15.32:0/940919534 conn(0x7fab2c0cc6f0 msgr2=0x7fab2c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:40.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 -- 172.21.15.32:0/940919534 shutdown_connections 2023-10-14T12:18:40.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.846+0000 7fab334f4700 1 -- 172.21.15.32:0/940919534 wait complete. 2023-10-14T12:18:40.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.848+0000 7fab334f4700 1 Processor -- start 2023-10-14T12:18:40.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.848+0000 7fab334f4700 1 -- start start 2023-10-14T12:18:40.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab2c06ef20 0x7fab2c14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab2c15bb50 0x7fab2c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c155d10 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c150290 con 0x7fab2c15bb50 2023-10-14T12:18:40.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c155140 con 0x7fab2c06ef20 2023-10-14T12:18:40.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c0b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37820/0 (socket says 172.21.15.32:37820) 2023-10-14T12:18:40.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 -- 172.21.15.32:0/673430889 learned_addr learned my addr 172.21.15.32:0/673430889 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:40.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab31290700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab2c06ef20 0x7fab2c14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab31a91700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab2c15bb50 0x7fab2c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 -- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab2c06ef20 msgr2=0x7fab2c14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab2c06ef20 0x7fab2c14fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 -- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab2c15bb50 msgr2=0x7fab2c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab2c15bb50 0x7fab2c0b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 -- 172.21.15.32:0/673430889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24009a70 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab31a91700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab2c15bb50 0x7fab2c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab30a8f700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c0b2ee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab2000e9b0 tx=0x7fab2000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20009710 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000c850 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c1553e0 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.849+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000cbc0 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.850+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c1559a0 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.850+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c067ae0 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.851+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fab2000cd20 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.851+0000 7fab1dffb700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab1006ae70 0x7fab1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:40.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.851+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fab20089100 con 0x7fab2c0ce0b0 2023-10-14T12:18:40.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.852+0000 7fab31290700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab1006ae70 0x7fab1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:40.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.852+0000 7fab31290700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab1006ae70 0x7fab1006d330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab280011e0 tx=0x7fab28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:40.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:40.856+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab20054750 con 0x7fab2c0ce0b0 2023-10-14T12:18:41.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.102+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab2c155e50 con 0x7fab2c0ce0b0 2023-10-14T12:18:41.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.102+0000 7fab1dffb700 1 -- 172.21.15.32:0/673430889 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fab20021540 con 0x7fab2c0ce0b0 2023-10-14T12:18:41.104 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:41.104 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T12:18:41.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab1006ae70 msgr2=0x7fab1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:41.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab1006ae70 0x7fab1006d330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab280011e0 tx=0x7fab28009040 comp rx=0 tx=0).stop 2023-10-14T12:18:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 msgr2=0x7fab2c0b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c0b2ee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab2000e9b0 tx=0x7fab2000ed70 comp rx=0 tx=0).stop 2023-10-14T12:18:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 shutdown_connections 2023-10-14T12:18:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab1006ae70 0x7fab1006d330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:41.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab2c15bb50 0x7fab2c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab2c06ef20 0x7fab2c14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 --2- 172.21.15.32:0/673430889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab2c0ce0b0 0x7fab2c0b2ee0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 >> 172.21.15.32:0/673430889 conn(0x7fab2c0cc6f0 msgr2=0x7fab2c15b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 shutdown_connections 2023-10-14T12:18:41.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:41.105+0000 7fab334f4700 1 -- 172.21.15.32:0/673430889 wait complete. 2023-10-14T12:18:41.109 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 2 2023-10-14T12:18:43.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:18:43.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.250+0000 7f7db53b9700 1 Processor -- start 2023-10-14T12:18:43.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.250+0000 7f7db53b9700 1 -- start start 2023-10-14T12:18:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.250+0000 7f7db53b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db015e030 0x7f7db00cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.250+0000 7f7db53b9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db006adb0 con 0x7f7db006a840 2023-10-14T12:18:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7db53b9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db006b090 con 0x7f7db00ce280 2023-10-14T12:18:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7db53b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db006b370 con 0x7f7db015e030 2023-10-14T12:18:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dae7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7db006a840 0x7f7db00cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54856/0 (socket says 172.21.15.32:54856) 2023-10-14T12:18:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dae7fc700 1 -- 172.21.15.32:0/1290011697 learned_addr learned my addr 172.21.15.32:0/1290011697 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7daeffd700 1 --2- 172.21.15.32:0/1290011697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db015e030 0x7f7db00cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800465037 0 0) 0x7f7db006adb0 con 0x7f7db006a840 2023-10-14T12:18:43.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d980035b0 con 0x7f7db006a840 2023-10-14T12:18:43.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619489670 0 0) 0x7f7db006b090 con 0x7f7db00ce280 2023-10-14T12:18:43.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db006adb0 con 0x7f7db00ce280 2023-10-14T12:18:43.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7daeffd700 1 -- 172.21.15.32:0/1290011697 >> v1:172.21.15.92:6789/0 conn(0x7f7db00ce280 legacy=0x7f7db006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7daeffd700 1 -- 172.21.15.32:0/1290011697 >> v1:172.21.15.32:6789/0 conn(0x7f7db006a840 legacy=0x7f7db00cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7daeffd700 1 -- 172.21.15.32:0/1290011697 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db006b650 con 0x7f7db015e030 2023-10-14T12:18:43.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7daeffd700 1 --2- 172.21.15.32:0/1290011697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db015e030 0x7f7db00cb3a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009870 tx=0x7f7da0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7bec152ba152b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:43.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0011830 con 0x7f7db015e030 2023-10-14T12:18:43.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da0011990 con 0x7f7db015e030 2023-10-14T12:18:43.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.251+0000 7f7dadffb700 1 -- 172.21.15.32:0/1290011697 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0011d20 con 0x7f7db015e030 2023-10-14T12:18:43.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 -- 172.21.15.32:0/1290011697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db015e030 msgr2=0x7f7db00cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1290011697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db015e030 0x7f7db00cb3a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009870 tx=0x7f7da0009b80 comp rx=0 tx=0).stop 2023-10-14T12:18:43.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 -- 172.21.15.32:0/1290011697 shutdown_connections 2023-10-14T12:18:43.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1290011697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db015e030 0x7f7db00cb3a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 -- 172.21.15.32:0/1290011697 >> 172.21.15.32:0/1290011697 conn(0x7f7db00cc6f0 msgr2=0x7f7db00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:43.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 -- 172.21.15.32:0/1290011697 shutdown_connections 2023-10-14T12:18:43.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.252+0000 7f7db53b9700 1 -- 172.21.15.32:0/1290011697 wait complete. 2023-10-14T12:18:43.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.253+0000 7f7db53b9700 1 Processor -- start 2023-10-14T12:18:43.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 -- start start 2023-10-14T12:18:43.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db006a840 0x7f7db0160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 0x7f7db014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db015e030 0x7f7db014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db014af80 con 0x7f7db00ce280 2023-10-14T12:18:43.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01f3350 con 0x7f7db015e030 2023-10-14T12:18:43.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7db53b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db015ff00 con 0x7f7db006a840 2023-10-14T12:18:43.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7dae7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 0x7f7db014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7dae7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 0x7f7db014aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37838/0 (socket says 172.21.15.32:37838) 2023-10-14T12:18:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.254+0000 7f7dae7fc700 1 -- 172.21.15.32:0/1460443907 learned_addr learned my addr 172.21.15.32:0/1460443907 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7daeffd700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db006a840 0x7f7db0160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7daf7fe700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db015e030 0x7f7db014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7dae7fc700 1 -- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db006a840 msgr2=0x7f7db0160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7dae7fc700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db006a840 0x7f7db0160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7dae7fc700 1 -- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db015e030 msgr2=0x7f7db014d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7dae7fc700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db015e030 0x7f7db014d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7dae7fc700 1 -- 172.21.15.32:0/1460443907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da00094a0 con 0x7f7db00ce280 2023-10-14T12:18:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7dae7fc700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 0x7f7db014aa40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7da4001eb0 tx=0x7f7da400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4005d70 con 0x7f7db00ce280 2023-10-14T12:18:43.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da40070d0 con 0x7f7db00ce280 2023-10-14T12:18:43.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db01601e0 con 0x7f7db00ce280 2023-10-14T12:18:43.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4007460 con 0x7f7db00ce280 2023-10-14T12:18:43.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.255+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db01607a0 con 0x7f7db00ce280 2023-10-14T12:18:43.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.256+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db01614e0 con 0x7f7db00ce280 2023-10-14T12:18:43.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.257+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f7da40075c0 con 0x7f7db00ce280 2023-10-14T12:18:43.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.257+0000 7f7d977fe700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7d9c06ae70 0x7f7d9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.257+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7da40886a0 con 0x7f7db00ce280 2023-10-14T12:18:43.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.266+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7da4053b80 con 0x7f7db00ce280 2023-10-14T12:18:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.272+0000 7f7daeffd700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7d9c06ae70 0x7f7d9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.272+0000 7f7daeffd700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7d9c06ae70 0x7f7d9c06d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7da00097c0 tx=0x7f7da001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:43.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.464+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7da4053f50 con 0x7f7db00ce280 2023-10-14T12:18:43.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.520+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7db0066a30 con 0x7f7db00ce280 2023-10-14T12:18:43.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.520+0000 7f7d977fe700 1 -- 172.21.15.32:0/1460443907 <== mon.0 v2:172.21.15.32:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f7da4017e80 con 0x7f7db00ce280 2023-10-14T12:18:43.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:43.523 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T12:18:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7d9c06ae70 msgr2=0x7f7d9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7d9c06ae70 0x7f7d9c06d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7da00097c0 tx=0x7f7da001c040 comp rx=0 tx=0).stop 2023-10-14T12:18:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 msgr2=0x7f7db014aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 0x7f7db014aa40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7da4001eb0 tx=0x7f7da400c860 comp rx=0 tx=0).stop 2023-10-14T12:18:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 shutdown_connections 2023-10-14T12:18:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7d9c06ae70 0x7f7d9c06d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db015e030 0x7f7db014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7db006a840 0x7f7db0160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 --2- 172.21.15.32:0/1460443907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7db00ce280 0x7f7db014aa40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 >> 172.21.15.32:0/1460443907 conn(0x7f7db00cc6f0 msgr2=0x7f7db015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 shutdown_connections 2023-10-14T12:18:43.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.522+0000 7f7db53b9700 1 -- 172.21.15.32:0/1460443907 wait complete. 2023-10-14T12:18:43.527 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2023-10-14T12:18:43.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.663+0000 7fd215eb4700 1 Processor -- start 2023-10-14T12:18:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.663+0000 7fd215eb4700 1 -- start start 2023-10-14T12:18:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd215eb4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd21015f1f0 0x7fd2100cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd215eb4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2100cfc60 0x7fd2100cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd215eb4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21015e7a0 con 0x7fd21015ab10 2023-10-14T12:18:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd215eb4700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2100d0090 con 0x7fd2100cfc60 2023-10-14T12:18:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd215eb4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2100b29a0 con 0x7fd21015f1f0 2023-10-14T12:18:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2100cfc60 0x7fd2100cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2100cfc60 0x7fd2100cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37848/0 (socket says 172.21.15.32:37848) 2023-10-14T12:18:43.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 -- 172.21.15.32:0/375434443 learned_addr learned my addr 172.21.15.32:0/375434443 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:43.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20effd700 1 --2- 172.21.15.32:0/375434443 >> v2:172.21.15.92:3300/0 conn(0x7fd21015f1f0 0x7fd2100cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 -- 172.21.15.32:0/375434443 >> v2:172.21.15.92:3300/0 conn(0x7fd21015f1f0 msgr2=0x7fd2100cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 --2- 172.21.15.32:0/375434443 >> v2:172.21.15.92:3300/0 conn(0x7fd21015f1f0 0x7fd2100cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 -- 172.21.15.32:0/375434443 >> v1:172.21.15.92:6789/0 conn(0x7fd21015ab10 legacy=0x7fd2100b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 -- 172.21.15.32:0/375434443 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2100b2c80 con 0x7fd2100cfc60 2023-10-14T12:18:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20e7fc700 1 -- 172.21.15.32:0/375434443 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450084592 0 0) 0x7fd21015e7a0 con 0x7fd21015ab10 2023-10-14T12:18:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.664+0000 7fd20ffff700 1 --2- 172.21.15.32:0/375434443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2100cbf40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd21006d470 tx=0x7fd20800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dc95fcc0842515 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd20e7fc700 1 -- 172.21.15.32:0/375434443 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208010070 con 0x7fd2100cfc60 2023-10-14T12:18:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd20e7fc700 1 -- 172.21.15.32:0/375434443 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800dce0 con 0x7fd2100cfc60 2023-10-14T12:18:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd20e7fc700 1 -- 172.21.15.32:0/375434443 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800b310 con 0x7fd2100cfc60 2023-10-14T12:18:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 -- 172.21.15.32:0/375434443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 msgr2=0x7fd2100cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 --2- 172.21.15.32:0/375434443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2100cbf40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd21006d470 tx=0x7fd20800d430 comp rx=0 tx=0).stop 2023-10-14T12:18:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 -- 172.21.15.32:0/375434443 shutdown_connections 2023-10-14T12:18:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 --2- 172.21.15.32:0/375434443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2100cbf40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 --2- 172.21.15.32:0/375434443 >> v2:172.21.15.92:3300/0 conn(0x7fd21015f1f0 0x7fd2100cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 -- 172.21.15.32:0/375434443 >> 172.21.15.32:0/375434443 conn(0x7fd21006dae0 msgr2=0x7fd21006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 -- 172.21.15.32:0/375434443 shutdown_connections 2023-10-14T12:18:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.665+0000 7fd215eb4700 1 -- 172.21.15.32:0/375434443 wait complete. 2023-10-14T12:18:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.666+0000 7fd215eb4700 1 Processor -- start 2023-10-14T12:18:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 -- start start 2023-10-14T12:18:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2101f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd21015ab10 0x7fd210156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd21015f1f0 0x7fd2101f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2101f6d60 con 0x7fd2100cfc60 2023-10-14T12:18:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2101f3fe0 con 0x7fd21015ab10 2023-10-14T12:18:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.667+0000 7fd215eb4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2101f42c0 con 0x7fd21015f1f0 2023-10-14T12:18:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2101f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2101f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37850/0 (socket says 172.21.15.32:37850) 2023-10-14T12:18:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 -- 172.21.15.32:0/1219223514 learned_addr learned my addr 172.21.15.32:0/1219223514 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20effd700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd21015ab10 0x7fd210156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20ffff700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd21015f1f0 0x7fd2101f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 -- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd21015f1f0 msgr2=0x7fd2101f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd21015f1f0 0x7fd2101f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 -- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd21015ab10 msgr2=0x7fd210156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd21015ab10 0x7fd210156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 -- 172.21.15.32:0/1219223514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20800bd40 con 0x7fd2100cfc60 2023-10-14T12:18:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd20f7fe700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2101f3740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd20000c550 tx=0x7fd20000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000054e0 con 0x7fd2100cfc60 2023-10-14T12:18:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200003680 con 0x7fd2100cfc60 2023-10-14T12:18:43.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2101f45a0 con 0x7fd2100cfc60 2023-10-14T12:18:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200003a30 con 0x7fd2100cfc60 2023-10-14T12:18:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.668+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2101f3c80 con 0x7fd2100cfc60 2023-10-14T12:18:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.669+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd210067d20 con 0x7fd2100cfc60 2023-10-14T12:18:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.669+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd200003b90 con 0x7fd2100cfc60 2023-10-14T12:18:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.670+0000 7fd1f7fff700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd1fc06af00 0x7fd1fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.670+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd200088530 con 0x7fd2100cfc60 2023-10-14T12:18:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.670+0000 7fd20effd700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd1fc06af00 0x7fd1fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.670+0000 7fd20effd700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd1fc06af00 0x7fd1fc06d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd204009bc0 tx=0x7fd2040091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.675+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2000539c0 con 0x7fd2100cfc60 2023-10-14T12:18:43.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.876+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2100cf9d0 con 0x7fd2100cfc60 2023-10-14T12:18:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.927+0000 7fd1f7fff700 1 -- 172.21.15.32:0/1219223514 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fd200017020 con 0x7fd2100cfc60 2023-10-14T12:18:43.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:43.929 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":17,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:43.456043+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd1fc06af00 msgr2=0x7fd1fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd1fc06af00 0x7fd1fc06d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd204009bc0 tx=0x7fd2040091c0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 msgr2=0x7fd2101f3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2101f3740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd20000c550 tx=0x7fd20000c860 comp rx=0 tx=0).stop 2023-10-14T12:18:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 shutdown_connections 2023-10-14T12:18:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd21015f1f0 0x7fd2101f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2100cfc60 0x7fd2101f3740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd1fc06af00 0x7fd1fc06d3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 --2- 172.21.15.32:0/1219223514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd21015ab10 0x7fd210156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 >> 172.21.15.32:0/1219223514 conn(0x7fd21006dae0 msgr2=0x7fd2100b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 shutdown_connections 2023-10-14T12:18:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:43.929+0000 7fd215eb4700 1 -- 172.21.15.32:0/1219223514 wait complete. 2023-10-14T12:18:43.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:18:43.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:18:44.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.071+0000 7fe071fd2700 1 Processor -- start 2023-10-14T12:18:44.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.071+0000 7fe071fd2700 1 -- start start 2023-10-14T12:18:44.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe071fd2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe06c15ab10 0x7fe06c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe071fd2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe071fd2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06c15e7a0 con 0x7fe06c0b1f50 2023-10-14T12:18:44.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe071fd2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06c15f730 con 0x7fe06c15ab10 2023-10-14T12:18:44.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe071fd2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0b29a0 con 0x7fe06c0cfe30 2023-10-14T12:18:44.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe06bfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe06b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe06c15ab10 0x7fe06c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe06affd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe06c0b1f50 0x7fe06c0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:53760/0 (socket says 172.21.15.32:53760) 2023-10-14T12:18:44.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.072+0000 7fe06affd700 1 -- 172.21.15.32:0/3478779910 learned_addr learned my addr 172.21.15.32:0/3478779910 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:44.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06a7fc700 1 -- 172.21.15.32:0/3478779910 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880599730 0 0) 0x7fe06c15e7a0 con 0x7fe06c0b1f50 2023-10-14T12:18:44.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06a7fc700 1 -- 172.21.15.32:0/3478779910 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0540035b0 con 0x7fe06c0b1f50 2023-10-14T12:18:44.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06b7fe700 1 -- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 msgr2=0x7fe06c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:44.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06b7fe700 1 --2- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06b7fe700 1 -- 172.21.15.32:0/3478779910 >> v1:172.21.15.92:6789/0 conn(0x7fe06c0b1f50 legacy=0x7fe06c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06b7fe700 1 -- 172.21.15.32:0/3478779910 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0b2c80 con 0x7fe06c15ab10 2023-10-14T12:18:44.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06b7fe700 1 --2- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c15ab10 0x7fe06c15f1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009840 tx=0x7fe05c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f4dd705c19f1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06a7fc700 1 -- 172.21.15.32:0/3478779910 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c011830 con 0x7fe06c15ab10 2023-10-14T12:18:44.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06a7fc700 1 -- 172.21.15.32:0/3478779910 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c011990 con 0x7fe06c15ab10 2023-10-14T12:18:44.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.073+0000 7fe06a7fc700 1 -- 172.21.15.32:0/3478779910 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c011d20 con 0x7fe06c15ab10 2023-10-14T12:18:44.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 -- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c15ab10 msgr2=0x7fe06c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 --2- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c15ab10 0x7fe06c15f1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009840 tx=0x7fe05c009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:44.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 -- 172.21.15.32:0/3478779910 shutdown_connections 2023-10-14T12:18:44.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 --2- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 --2- 172.21.15.32:0/3478779910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c15ab10 0x7fe06c15f1f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 -- 172.21.15.32:0/3478779910 >> 172.21.15.32:0/3478779910 conn(0x7fe06c06dae0 msgr2=0x7fe06c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:44.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 -- 172.21.15.32:0/3478779910 shutdown_connections 2023-10-14T12:18:44.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.074+0000 7fe071fd2700 1 -- 172.21.15.32:0/3478779910 wait complete. 2023-10-14T12:18:44.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.075+0000 7fe071fd2700 1 Processor -- start 2023-10-14T12:18:44.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.075+0000 7fe071fd2700 1 -- start start 2023-10-14T12:18:44.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe071fd2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 0x7fe06c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe071fd2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe071fd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 0x7fe06c1ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe071fd2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0cc9a0 con 0x7fe06c15ab10 2023-10-14T12:18:44.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe071fd2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c15b400 con 0x7fe06c0b1f50 2023-10-14T12:18:44.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe071fd2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0c6f90 con 0x7fe06c0cfe30 2023-10-14T12:18:44.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe06bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 0x7fe06c1ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe06b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 0x7fe06c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe06bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 0x7fe06c1ef9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37866/0 (socket says 172.21.15.32:37866) 2023-10-14T12:18:44.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe06bfff700 1 -- 172.21.15.32:0/493809675 learned_addr learned my addr 172.21.15.32:0/493809675 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:44.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.076+0000 7fe06b7fe700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 0x7fe06c0b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42132/0 (socket says 172.21.15.32:42132) 2023-10-14T12:18:44.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06affd700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06bfff700 1 -- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 msgr2=0x7fe06c0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06bfff700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06bfff700 1 -- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 msgr2=0x7fe06c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06bfff700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 0x7fe06c0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06bfff700 1 -- 172.21.15.32:0/493809675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0094a0 con 0x7fe06c15ab10 2023-10-14T12:18:44.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06b7fe700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 0x7fe06c0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:44.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe06bfff700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 0x7fe06c1ef9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe06400ef90 tx=0x7fe064009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064009b20 con 0x7fe06c15ab10 2023-10-14T12:18:44.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06c0cc3e0 con 0x7fe06c15ab10 2023-10-14T12:18:44.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06400f040 con 0x7fe06c15ab10 2023-10-14T12:18:44.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06400cd20 con 0x7fe06c15ab10 2023-10-14T12:18:44.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.077+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06c15b090 con 0x7fe06c15ab10 2023-10-14T12:18:44.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.078+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06c15aef0 con 0x7fe06c15ab10 2023-10-14T12:18:44.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.079+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe064014480 con 0x7fe06c15ab10 2023-10-14T12:18:44.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.079+0000 7fe053fff700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe05806af00 0x7fe05806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.079+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe064089cf0 con 0x7fe06c15ab10 2023-10-14T12:18:44.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.079+0000 7fe06b7fe700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe05806af00 0x7fe05806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.080+0000 7fe06b7fe700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe05806af00 0x7fe05806d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe05c000c00 tx=0x7fe05c01e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.084+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe06c15aef0 con 0x7fe06c15ab10 2023-10-14T12:18:44.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.282+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe06c15aef0 con 0x7fe06c15ab10 2023-10-14T12:18:44.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.282+0000 7fe053fff700 1 -- 172.21.15.32:0/493809675 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe06c15aef0 con 0x7fe06c15ab10 2023-10-14T12:18:44.284 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:18:44.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe05806af00 msgr2=0x7fe05806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe05806af00 0x7fe05806d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe05c000c00 tx=0x7fe05c01e040 comp rx=0 tx=0).stop 2023-10-14T12:18:44.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 msgr2=0x7fe06c1ef9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 0x7fe06c1ef9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe06400ef90 tx=0x7fe064009f60 comp rx=0 tx=0).stop 2023-10-14T12:18:44.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 shutdown_connections 2023-10-14T12:18:44.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe06c15ab10 0x7fe06c1ef9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe05806af00 0x7fe05806d3c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe06c0b1f50 0x7fe06c0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 --2- 172.21.15.32:0/493809675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe06c0cfe30 0x7fe06c0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 >> 172.21.15.32:0/493809675 conn(0x7fe06c06dae0 msgr2=0x7fe06c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:44.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 shutdown_connections 2023-10-14T12:18:44.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.284+0000 7fe071fd2700 1 -- 172.21.15.32:0/493809675 wait complete. 2023-10-14T12:18:44.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T12:18:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.421+0000 7f789eefe700 1 Processor -- start 2023-10-14T12:18:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.422+0000 7f789eefe700 1 -- start start 2023-10-14T12:18:44.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.422+0000 7f789eefe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f789815ab10 0x7f789815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.422+0000 7f789eefe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f78980cfe30 0x7f78980cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.422+0000 7f789eefe700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789815e7a0 con 0x7f78980b1f50 2023-10-14T12:18:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.422+0000 7f789eefe700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789815f730 con 0x7f78980cfe30 2023-10-14T12:18:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.422+0000 7f789eefe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78980b29a0 con 0x7f789815ab10 2023-10-14T12:18:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f78980cfe30 0x7f78980cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f78980cfe30 0x7f78980cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37876/0 (socket says 172.21.15.32:37876) 2023-10-14T12:18:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 -- 172.21.15.32:0/3665411609 learned_addr learned my addr 172.21.15.32:0/3665411609 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789cc9a700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f789815ab10 0x7f789815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 -- 172.21.15.32:0/3665411609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f789815ab10 msgr2=0x7f789815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f789815ab10 0x7f789815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 -- 172.21.15.32:0/3665411609 >> v1:172.21.15.92:6789/0 conn(0x7f78980b1f50 legacy=0x7f78980cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 -- 172.21.15.32:0/3665411609 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980b2c80 con 0x7f78980cfe30 2023-10-14T12:18:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789cc9a700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f789815ab10 0x7f789815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f789d49b700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980cfe30 0x7f78980cbf40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f789000d150 tx=0x7f789000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1253e4143c461a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f78977fe700 1 -- 172.21.15.32:0/3665411609 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890010070 con 0x7f78980cfe30 2023-10-14T12:18:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f78977fe700 1 -- 172.21.15.32:0/3665411609 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789000dd80 con 0x7f78980cfe30 2023-10-14T12:18:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.423+0000 7f78977fe700 1 -- 172.21.15.32:0/3665411609 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000b310 con 0x7f78980cfe30 2023-10-14T12:18:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 -- 172.21.15.32:0/3665411609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980cfe30 msgr2=0x7f78980cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980cfe30 0x7f78980cbf40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f789000d150 tx=0x7f789000d460 comp rx=0 tx=0).stop 2023-10-14T12:18:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 -- 172.21.15.32:0/3665411609 shutdown_connections 2023-10-14T12:18:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980cfe30 0x7f78980cbf40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 --2- 172.21.15.32:0/3665411609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f789815ab10 0x7f789815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 -- 172.21.15.32:0/3665411609 >> 172.21.15.32:0/3665411609 conn(0x7f789806dae0 msgr2=0x7f789806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 -- 172.21.15.32:0/3665411609 shutdown_connections 2023-10-14T12:18:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.424+0000 7f789eefe700 1 -- 172.21.15.32:0/3665411609 wait complete. 2023-10-14T12:18:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.425+0000 7f789eefe700 1 Processor -- start 2023-10-14T12:18:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.425+0000 7f789eefe700 1 -- start start 2023-10-14T12:18:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789eefe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 0x7f7898155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789eefe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78980cfe30 0x7f789815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789eefe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f789815ab10 0x7f789814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789eefe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980aecc0 con 0x7f78980b1f50 2023-10-14T12:18:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789eefe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789815d740 con 0x7f789815ab10 2023-10-14T12:18:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789eefe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7898155cd0 con 0x7f78980cfe30 2023-10-14T12:18:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 0x7f7898155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 0x7f7898155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37878/0 (socket says 172.21.15.32:37878) 2023-10-14T12:18:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 -- 172.21.15.32:0/3760281615 learned_addr learned my addr 172.21.15.32:0/3760281615 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789d49b700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f789815ab10 0x7f789814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f7897fff700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78980cfe30 0x7f789815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 -- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78980cfe30 msgr2=0x7f789815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78980cfe30 0x7f789815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 -- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f789815ab10 msgr2=0x7f789814e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f789815ab10 0x7f789814e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 -- 172.21.15.32:0/3760281615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789000bd40 con 0x7f78980b1f50 2023-10-14T12:18:44.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f789cc9a700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 0x7f7898155f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c780 tx=0x7f788c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.426+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c011800 con 0x7f78980b1f50 2023-10-14T12:18:44.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.427+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c011960 con 0x7f78980b1f50 2023-10-14T12:18:44.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.427+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78980aef10 con 0x7f78980b1f50 2023-10-14T12:18:44.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.427+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c011cd0 con 0x7f78980b1f50 2023-10-14T12:18:44.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.427+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789815d380 con 0x7f78980b1f50 2023-10-14T12:18:44.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.427+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7898067d20 con 0x7f78980b1f50 2023-10-14T12:18:44.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.428+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f788c021350 con 0x7f78980b1f50 2023-10-14T12:18:44.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.428+0000 7f78957fa700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f787c06af30 0x7f787c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.428+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f788c089150 con 0x7f78980b1f50 2023-10-14T12:18:44.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.428+0000 7f7897fff700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f787c06af30 0x7f787c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.429+0000 7f7897fff700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f787c06af30 0x7f787c06d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78981559a0 tx=0x7f78840090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.433+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f788c0544b0 con 0x7f78980b1f50 2023-10-14T12:18:44.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.636+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7898159f90 con 0x7f78980b1f50 2023-10-14T12:18:44.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.636+0000 7f78957fa700 1 -- 172.21.15.32:0/3760281615 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f788c057ad0 con 0x7f78980b1f50 2023-10-14T12:18:44.638 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2023-10-14T12:18:44.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:18:44.638 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2023-10-14T12:18:44.638 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2023-10-14T12:18:44.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:18:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:] 2023-10-14T12:18:44.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f787c06af30 msgr2=0x7f787c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f787c06af30 0x7f787c06d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78981559a0 tx=0x7f78840090e0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 msgr2=0x7f7898155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 0x7f7898155f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c780 tx=0x7f788c00ca90 comp rx=0 tx=0).stop 2023-10-14T12:18:44.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 shutdown_connections 2023-10-14T12:18:44.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f787c06af30 0x7f787c06d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f789815ab10 0x7f789814e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78980b1f50 0x7f7898155f40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 --2- 172.21.15.32:0/3760281615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78980cfe30 0x7f789815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 >> 172.21.15.32:0/3760281615 conn(0x7f789806dae0 msgr2=0x7f78980ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:44.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 shutdown_connections 2023-10-14T12:18:44.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.638+0000 7f789eefe700 1 -- 172.21.15.32:0/3760281615 wait complete. 2023-10-14T12:18:44.652 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T12:18:44.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T12:18:44.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.780+0000 7f2f57f2a700 1 Processor -- start 2023-10-14T12:18:44.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.780+0000 7f2f57f2a700 1 -- start start 2023-10-14T12:18:44.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.781+0000 7f2f57f2a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2f500cf430 0x7f2f500d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f57f2a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500d05e0 con 0x7f2f500b0d30 2023-10-14T12:18:44.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f57f2a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500b08d0 con 0x7f2f500cdf40 2023-10-14T12:18:44.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f57f2a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f500cfcb0 con 0x7f2f500cf430 2023-10-14T12:18:44.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f554c5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2f500cf430 0x7f2f500d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f564c7700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2f500b0d30 0x7f2f500b11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54914/0 (socket says 172.21.15.32:54914) 2023-10-14T12:18:44.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f564c7700 1 -- 172.21.15.32:0/3785185195 learned_addr learned my addr 172.21.15.32:0/3785185195 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:44.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f554c5700 1 -- 172.21.15.32:0/3785185195 >> v1:172.21.15.92:6789/0 conn(0x7f2f500cdf40 legacy=0x7f2f500ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:44.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f554c5700 1 -- 172.21.15.32:0/3785185195 >> v1:172.21.15.32:6789/0 conn(0x7f2f500b0d30 legacy=0x7f2f500b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f554c5700 1 -- 172.21.15.32:0/3785185195 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500cff90 con 0x7f2f500cf430 2023-10-14T12:18:44.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f554c5700 1 --2- 172.21.15.32:0/3785185195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500cf430 0x7f2f500d2050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009840 tx=0x7f2f4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2f221de41b085 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f54cc4700 1 -- 172.21.15.32:0/3785185195 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c004230 con 0x7f2f500cf430 2023-10-14T12:18:44.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f54cc4700 1 -- 172.21.15.32:0/3785185195 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c004390 con 0x7f2f500cf430 2023-10-14T12:18:44.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.782+0000 7f2f54cc4700 1 -- 172.21.15.32:0/3785185195 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c0036a0 con 0x7f2f500cf430 2023-10-14T12:18:44.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 -- 172.21.15.32:0/3785185195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500cf430 msgr2=0x7f2f500d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/3785185195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500cf430 0x7f2f500d2050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009840 tx=0x7f2f4c009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:44.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 -- 172.21.15.32:0/3785185195 shutdown_connections 2023-10-14T12:18:44.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/3785185195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500cf430 0x7f2f500d2050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 -- 172.21.15.32:0/3785185195 >> 172.21.15.32:0/3785185195 conn(0x7f2f500d1530 msgr2=0x7f2f500d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:44.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 -- 172.21.15.32:0/3785185195 shutdown_connections 2023-10-14T12:18:44.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.783+0000 7f2f57f2a700 1 -- 172.21.15.32:0/3785185195 wait complete. 2023-10-14T12:18:44.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.784+0000 7f2f57f2a700 1 Processor -- start 2023-10-14T12:18:44.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.784+0000 7f2f57f2a700 1 -- start start 2023-10-14T12:18:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f57f2a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 0x7f2f50157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f57f2a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f500cdf40 0x7f2f500c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f57f2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500cf430 0x7f2f5006c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f57f2a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500b2960 con 0x7f2f500b0d30 2023-10-14T12:18:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f57f2a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500b24d0 con 0x7f2f500cf430 2023-10-14T12:18:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f57f2a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50158000 con 0x7f2f500cdf40 2023-10-14T12:18:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 0x7f2f50157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 0x7f2f50157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37892/0 (socket says 172.21.15.32:37892) 2023-10-14T12:18:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 -- 172.21.15.32:0/1793774484 learned_addr learned my addr 172.21.15.32:0/1793774484 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f564c7700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500cf430 0x7f2f5006c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f554c5700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f500cdf40 0x7f2f500c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 -- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f500cdf40 msgr2=0x7f2f500c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f500cdf40 0x7f2f500c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 -- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500cf430 msgr2=0x7f2f5006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:44.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500cf430 0x7f2f5006c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:44.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 -- 172.21.15.32:0/1793774484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0094a0 con 0x7f2f500b0d30 2023-10-14T12:18:44.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f564c7700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500cf430 0x7f2f5006c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:44.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.785+0000 7f2f55cc6700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 0x7f2f50157ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000c4b0 tx=0x7f2f4000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.786+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40011790 con 0x7f2f500b0d30 2023-10-14T12:18:44.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.786+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f400118f0 con 0x7f2f500b0d30 2023-10-14T12:18:44.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.786+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f500c4670 con 0x7f2f500b0d30 2023-10-14T12:18:44.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.786+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40011ca0 con 0x7f2f500b0d30 2023-10-14T12:18:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.786+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f500c5320 con 0x7f2f500b0d30 2023-10-14T12:18:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.787+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f50067d20 con 0x7f2f500b0d30 2023-10-14T12:18:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.787+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f4001c460 con 0x7f2f500b0d30 2023-10-14T12:18:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.787+0000 7f2f467fc700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2f3406af30 0x7f2f3406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:44.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.788+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f40088f50 con 0x7f2f500b0d30 2023-10-14T12:18:44.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.788+0000 7f2f554c5700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2f3406af30 0x7f2f3406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:44.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.788+0000 7f2f554c5700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2f3406af30 0x7f2f3406d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0090b0 tx=0x7f2f4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:44.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.792+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f400543e0 con 0x7f2f500b0d30 2023-10-14T12:18:44.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:44.992+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f5006dc10 con 0x7f2f500b0d30 2023-10-14T12:18:45.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.465+0000 7f2f467fc700 1 -- 172.21.15.32:0/1793774484 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f40057a00 con 0x7f2f500b0d30 2023-10-14T12:18:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.469+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2f3406af30 msgr2=0x7f2f3406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.469+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2f3406af30 0x7f2f3406d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0090b0 tx=0x7f2f4c008030 comp rx=0 tx=0).stop 2023-10-14T12:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.469+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 msgr2=0x7f2f50157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.469+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 0x7f2f50157ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000c4b0 tx=0x7f2f4000c7c0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.470+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 shutdown_connections 2023-10-14T12:18:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.470+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2f3406af30 0x7f2f3406d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.470+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500cf430 0x7f2f5006c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.470+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f500b0d30 0x7f2f50157ac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.470+0000 7f2f57f2a700 1 --2- 172.21.15.32:0/1793774484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f500cdf40 0x7f2f500c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.470+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 >> 172.21.15.32:0/1793774484 conn(0x7f2f500d1530 msgr2=0x7f2f500ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.471+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 shutdown_connections 2023-10-14T12:18:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.471+0000 7f2f57f2a700 1 -- 172.21.15.32:0/1793774484 wait complete. 2023-10-14T12:18:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2023-10-14T12:18:45.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T12:18:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.627+0000 7fd8b5fb0700 1 Processor -- start 2023-10-14T12:18:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.627+0000 7fd8b5fb0700 1 -- start start 2023-10-14T12:18:45.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8b5fb0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8b015dbb0 0x7fd8b00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:45.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8b5fb0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b00cc7d0 0x7fd8b00cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:45.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8b5fb0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b015df90 con 0x7fd8b006a840 2023-10-14T12:18:45.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8b5fb0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00cb040 con 0x7fd8b015dbb0 2023-10-14T12:18:45.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8b5fb0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0161a60 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8b015dbb0 0x7fd8b00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:45.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8b015dbb0 0x7fd8b00b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37902/0 (socket says 172.21.15.32:37902) 2023-10-14T12:18:45.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 -- 172.21.15.32:0/533165128 learned_addr learned my addr 172.21.15.32:0/533165128 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:45.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8aeffd700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b00cc7d0 0x7fd8b00cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:45.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 -- 172.21.15.32:0/533165128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b00cc7d0 msgr2=0x7fd8b00cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:45.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b00cc7d0 0x7fd8b00cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 -- 172.21.15.32:0/533165128 >> v1:172.21.15.92:6789/0 conn(0x7fd8b006a840 legacy=0x7fd8b00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:45.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8af7fe700 1 -- 172.21.15.32:0/533165128 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0161d40 con 0x7fd8b015dbb0 2023-10-14T12:18:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.628+0000 7fd8aeffd700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b00cc7d0 0x7fd8b00cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8af7fe700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b1f30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009e50 tx=0x7fd8a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319f8c2e7cdb0724 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8ae7fc700 1 -- 172.21.15.32:0/533165128 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800e070 con 0x7fd8b015dbb0 2023-10-14T12:18:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8ae7fc700 1 -- 172.21.15.32:0/533165128 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8003a20 con 0x7fd8b015dbb0 2023-10-14T12:18:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8ae7fc700 1 -- 172.21.15.32:0/533165128 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8003dd0 con 0x7fd8b015dbb0 2023-10-14T12:18:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/533165128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b015dbb0 msgr2=0x7fd8b00b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b1f30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009e50 tx=0x7fd8a800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/533165128 shutdown_connections 2023-10-14T12:18:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b1f30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/533165128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b00cc7d0 0x7fd8b00cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/533165128 >> 172.21.15.32:0/533165128 conn(0x7fd8b006dac0 msgr2=0x7fd8b006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:45.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/533165128 shutdown_connections 2023-10-14T12:18:45.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.629+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/533165128 wait complete. 2023-10-14T12:18:45.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.631+0000 7fd8b5fb0700 1 Processor -- start 2023-10-14T12:18:45.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.631+0000 7fd8b5fb0700 1 -- start start 2023-10-14T12:18:45.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8b5fb0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b006a840 0x7fd8b0151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:45.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8b5fb0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 0x7fd8b00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8b5fb0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8b5fb0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c7840 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8b5fb0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c7b20 con 0x7fd8b015dbb0 2023-10-14T12:18:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8b5fb0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c7e00 con 0x7fd8b006a840 2023-10-14T12:18:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8aeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 0x7fd8b00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:45.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8aeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 0x7fd8b00b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37908/0 (socket says 172.21.15.32:37908) 2023-10-14T12:18:45.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8af7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b006a840 0x7fd8b0151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:45.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8aeffd700 1 -- 172.21.15.32:0/1700730179 learned_addr learned my addr 172.21.15.32:0/1700730179 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:45.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.632+0000 7fd8affff700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:45.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8aeffd700 1 -- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b006a840 msgr2=0x7fd8b0151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:45.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8aeffd700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b006a840 0x7fd8b0151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8aeffd700 1 -- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8b015dbb0 msgr2=0x7fd8b00b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:45.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8aeffd700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:45.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8aeffd700 1 -- 172.21.15.32:0/1700730179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8009b30 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8aeffd700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 0x7fd8b00b30d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c750 tx=0x7fd89800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:45.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898011800 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898011960 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b00c80e0 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898011cd0 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.633+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b00c86a0 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.634+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b00c88c0 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.634+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd898021350 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.635+0000 7fd8a7fff700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd89006af00 0x7fd89006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:45.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.635+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd898089150 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.635+0000 7fd8af7fe700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd89006af00 0x7fd89006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:45.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.635+0000 7fd8af7fe700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd89006af00 0x7fd89006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8015040 tx=0x7fd8a8009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:45.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.640+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd898054470 con 0x7fd8b00cc7d0 2023-10-14T12:18:45.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:45.841+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd8b0067d20 con 0x7fd8b00cc7d0 2023-10-14T12:18:46.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.467+0000 7fd8a7fff700 1 -- 172.21.15.32:0/1700730179 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd898057a90 con 0x7fd8b00cc7d0 2023-10-14T12:18:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.472+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd89006af00 msgr2=0x7fd89006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.472+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd89006af00 0x7fd89006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8015040 tx=0x7fd8a8009000 comp rx=0 tx=0).stop 2023-10-14T12:18:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.472+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 msgr2=0x7fd8b00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.472+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 0x7fd8b00b30d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c750 tx=0x7fd89800ca60 comp rx=0 tx=0).stop 2023-10-14T12:18:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.473+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 shutdown_connections 2023-10-14T12:18:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.473+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd89006af00 0x7fd89006d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.473+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8b015dbb0 0x7fd8b00b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.473+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8b006a840 0x7fd8b0151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.473+0000 7fd8b5fb0700 1 --2- 172.21.15.32:0/1700730179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8b00cc7d0 0x7fd8b00b30d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.473+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 >> 172.21.15.32:0/1700730179 conn(0x7fd8b006dac0 msgr2=0x7fd8b00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.474+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 shutdown_connections 2023-10-14T12:18:46.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.474+0000 7fd8b5fb0700 1 -- 172.21.15.32:0/1700730179 wait complete. 2023-10-14T12:18:46.485 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2023-10-14T12:18:46.504 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T12:18:46.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.636+0000 7f4d3a41f700 1 Processor -- start 2023-10-14T12:18:46.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.636+0000 7f4d3a41f700 1 -- start start 2023-10-14T12:18:46.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d3a41f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d340b28b0 0x7f4d340cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:46.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d3a41f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340b3530 con 0x7f4d3415f130 2023-10-14T12:18:46.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d3a41f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340cd180 con 0x7f4d3406af50 2023-10-14T12:18:46.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d3a41f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340cde00 con 0x7f4d340b28b0 2023-10-14T12:18:46.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d33fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4d3415f130 0x7f4d3406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54938/0 (socket says 172.21.15.32:54938) 2023-10-14T12:18:46.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d33fff700 1 -- 172.21.15.32:0/2841993503 learned_addr learned my addr 172.21.15.32:0/2841993503 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:46.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d389bc700 1 --2- 172.21.15.32:0/2841993503 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d340b28b0 0x7f4d340cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:46.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100993969 0 0) 0x7f4d340b3530 con 0x7f4d3415f130 2023-10-14T12:18:46.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d200035b0 con 0x7f4d3415f130 2023-10-14T12:18:46.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445220189 0 0) 0x7f4d340cd180 con 0x7f4d3406af50 2023-10-14T12:18:46.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.637+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d340b3530 con 0x7f4d3406af50 2023-10-14T12:18:46.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d389bc700 1 -- 172.21.15.32:0/2841993503 >> v1:172.21.15.92:6789/0 conn(0x7f4d3406af50 legacy=0x7f4d340b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777746781 0 0) 0x7f4d200035b0 con 0x7f4d3415f130 2023-10-14T12:18:46.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d389bc700 1 -- 172.21.15.32:0/2841993503 >> v1:172.21.15.32:6789/0 conn(0x7f4d3415f130 legacy=0x7f4d3406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d389bc700 1 -- 172.21.15.32:0/2841993503 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340cd460 con 0x7f4d340b28b0 2023-10-14T12:18:46.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d389bc700 1 --2- 172.21.15.32:0/2841993503 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d340b28b0 0x7f4d340cede0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009dc0 tx=0x7f4d2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a8eca3d5ec5a3d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:46.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00e070 con 0x7f4d340b28b0 2023-10-14T12:18:46.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c003a20 con 0x7f4d340b28b0 2023-10-14T12:18:46.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d32ffd700 1 -- 172.21.15.32:0/2841993503 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24001670 con 0x7f4d340b28b0 2023-10-14T12:18:46.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d3a41f700 1 -- 172.21.15.32:0/2841993503 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d340b28b0 msgr2=0x7f4d340cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.638+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/2841993503 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d340b28b0 0x7f4d340cede0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009dc0 tx=0x7f4d2c00b330 comp rx=0 tx=0).stop 2023-10-14T12:18:46.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.639+0000 7f4d3a41f700 1 -- 172.21.15.32:0/2841993503 shutdown_connections 2023-10-14T12:18:46.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.639+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/2841993503 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d340b28b0 0x7f4d340cede0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.639+0000 7f4d3a41f700 1 -- 172.21.15.32:0/2841993503 >> 172.21.15.32:0/2841993503 conn(0x7f4d3406dae0 msgr2=0x7f4d3406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:46.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.639+0000 7f4d3a41f700 1 -- 172.21.15.32:0/2841993503 shutdown_connections 2023-10-14T12:18:46.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.639+0000 7f4d3a41f700 1 -- 172.21.15.32:0/2841993503 wait complete. 2023-10-14T12:18:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.640+0000 7f4d3a41f700 1 Processor -- start 2023-10-14T12:18:46.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.640+0000 7f4d3a41f700 1 -- start start 2023-10-14T12:18:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d3a41f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 0x7f4d340c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d3a41f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d340b28b0 0x7f4d341562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:46.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d3a41f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d3415f130 0x7f4d340c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d3a41f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415a520 con 0x7f4d3406af50 2023-10-14T12:18:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d3a41f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340c8d50 con 0x7f4d340b28b0 2023-10-14T12:18:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d3a41f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340c5180 con 0x7f4d3415f130 2023-10-14T12:18:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 0x7f4d340c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 0x7f4d340c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37920/0 (socket says 172.21.15.32:37920) 2023-10-14T12:18:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 -- 172.21.15.32:0/4032764131 learned_addr learned my addr 172.21.15.32:0/4032764131 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d337fe700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d340b28b0 0x7f4d341562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d389bc700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d3415f130 0x7f4d340c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:46.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 -- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d3415f130 msgr2=0x7f4d340c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d3415f130 0x7f4d340c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 -- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d340b28b0 msgr2=0x7f4d341562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:46.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d340b28b0 0x7f4d341562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:46.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 -- 172.21.15.32:0/4032764131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009a70 con 0x7f4d3406af50 2023-10-14T12:18:46.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.641+0000 7f4d33fff700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 0x7f4d340c7fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c750 tx=0x7f4d2400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:46.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.642+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24004c80 con 0x7f4d3406af50 2023-10-14T12:18:46.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.642+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d24004e00 con 0x7f4d3406af50 2023-10-14T12:18:46.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.642+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d340c84f0 con 0x7f4d3406af50 2023-10-14T12:18:46.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.642+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24007310 con 0x7f4d3406af50 2023-10-14T12:18:46.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.642+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d340c8a70 con 0x7f4d3406af50 2023-10-14T12:18:46.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.643+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d34067d20 con 0x7f4d3406af50 2023-10-14T12:18:46.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.643+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d24007470 con 0x7f4d3406af50 2023-10-14T12:18:46.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.643+0000 7f4d30ff9700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d1406af00 0x7f4d1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:46.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.644+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4d24089230 con 0x7f4d3406af50 2023-10-14T12:18:46.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.644+0000 7f4d337fe700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d1406af00 0x7f4d1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:46.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.644+0000 7f4d337fe700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d1406af00 0x7f4d1406d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d340d1460 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:46.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.648+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d240543d0 con 0x7f4d3406af50 2023-10-14T12:18:46.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:46.894+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4d340b0cc0 con 0x7f4d3406af50 2023-10-14T12:18:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.492+0000 7f4d30ff9700 1 -- 172.21.15.32:0/4032764131 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4d240579f0 con 0x7f4d3406af50 2023-10-14T12:18:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d1406af00 msgr2=0x7f4d1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d1406af00 0x7f4d1406d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d340d1460 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2023-10-14T12:18:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 msgr2=0x7f4d340c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 0x7f4d340c7fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c750 tx=0x7f4d2400ca60 comp rx=0 tx=0).stop 2023-10-14T12:18:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 shutdown_connections 2023-10-14T12:18:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d3415f130 0x7f4d340c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d3406af50 0x7f4d340c7fb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d1406af00 0x7f4d1406d3c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 --2- 172.21.15.32:0/4032764131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d340b28b0 0x7f4d341562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.501+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 >> 172.21.15.32:0/4032764131 conn(0x7f4d3406dae0 msgr2=0x7f4d340d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.502+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 shutdown_connections 2023-10-14T12:18:47.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.503+0000 7f4d3a41f700 1 -- 172.21.15.32:0/4032764131 wait complete. 2023-10-14T12:18:47.506 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T12:18:47.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:47.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.656+0000 7f3401a5b700 1 Processor -- start 2023-10-14T12:18:47.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.656+0000 7f3401a5b700 1 -- start start 2023-10-14T12:18:47.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f3401a5b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33fc0d3fc0 0x7f33fc15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:47.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f3401a5b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc15e4e0 con 0x7f33fc0b7050 2023-10-14T12:18:47.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f3401a5b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0d28e0 con 0x7f33fc15dbc0 2023-10-14T12:18:47.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f3401a5b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc0b7560 con 0x7f33fc0d3fc0 2023-10-14T12:18:47.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33fa7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33fc0d3fc0 0x7f33fc15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:47.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33fb7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f33fc0b7050 0x7f33fc0d21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54956/0 (socket says 172.21.15.32:54956) 2023-10-14T12:18:47.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33fb7fe700 1 -- 172.21.15.32:0/3650216870 learned_addr learned my addr 172.21.15.32:0/3650216870 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:47.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33fa7fc700 1 -- 172.21.15.32:0/3650216870 >> v1:172.21.15.92:6789/0 conn(0x7f33fc15dbc0 legacy=0x7f33fc0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33fa7fc700 1 -- 172.21.15.32:0/3650216870 >> v1:172.21.15.32:6789/0 conn(0x7f33fc0b7050 legacy=0x7f33fc0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33fa7fc700 1 -- 172.21.15.32:0/3650216870 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc0b7840 con 0x7f33fc0d3fc0 2023-10-14T12:18:47.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.657+0000 7f33f9ffb700 1 -- 172.21.15.32:0/3650216870 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126310953 0 0) 0x7f33fc15e4e0 con 0x7f33fc0b7050 2023-10-14T12:18:47.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f33fa7fc700 1 --2- 172.21.15.32:0/3650216870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc0d3fc0 0x7f33fc15dfa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009840 tx=0x7f33ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfa4d5bdff436d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:47.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f33f9ffb700 1 -- 172.21.15.32:0/3650216870 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011830 con 0x7f33fc0d3fc0 2023-10-14T12:18:47.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f33f9ffb700 1 -- 172.21.15.32:0/3650216870 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec011990 con 0x7f33fc0d3fc0 2023-10-14T12:18:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f33f9ffb700 1 -- 172.21.15.32:0/3650216870 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011d20 con 0x7f33fc0d3fc0 2023-10-14T12:18:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 -- 172.21.15.32:0/3650216870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc0d3fc0 msgr2=0x7f33fc15dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 --2- 172.21.15.32:0/3650216870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc0d3fc0 0x7f33fc15dfa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009840 tx=0x7f33ec009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 -- 172.21.15.32:0/3650216870 shutdown_connections 2023-10-14T12:18:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 --2- 172.21.15.32:0/3650216870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc0d3fc0 0x7f33fc15dfa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 -- 172.21.15.32:0/3650216870 >> 172.21.15.32:0/3650216870 conn(0x7f33fc09cb40 msgr2=0x7f33fc0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 -- 172.21.15.32:0/3650216870 shutdown_connections 2023-10-14T12:18:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.658+0000 7f3401a5b700 1 -- 172.21.15.32:0/3650216870 wait complete. 2023-10-14T12:18:47.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 Processor -- start 2023-10-14T12:18:47.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 -- start start 2023-10-14T12:18:47.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33fc0b7050 0x7f33fc0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:47.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33fc15dbc0 0x7f33fc157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 0x7f33fc154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1f5a20 con 0x7f33fc1560c0 2023-10-14T12:18:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc159f80 con 0x7f33fc15dbc0 2023-10-14T12:18:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.660+0000 7f3401a5b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1f50f0 con 0x7f33fc0b7050 2023-10-14T12:18:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 0x7f33fc154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 0x7f33fc154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37938/0 (socket says 172.21.15.32:37938) 2023-10-14T12:18:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 -- 172.21.15.32:0/1726610966 learned_addr learned my addr 172.21.15.32:0/1726610966 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fa7fc700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33fc15dbc0 0x7f33fc157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33faffd700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33fc0b7050 0x7f33fc0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 -- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33fc0b7050 msgr2=0x7f33fc0c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33fc0b7050 0x7f33fc0c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 -- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33fc15dbc0 msgr2=0x7f33fc157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33fc15dbc0 0x7f33fc157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 -- 172.21.15.32:0/1726610966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0094a0 con 0x7f33fc1560c0 2023-10-14T12:18:47.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fa7fc700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33fc15dbc0 0x7f33fc157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:47.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33fb7fe700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 0x7f33fc154e80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33f4002230 tx=0x7f33f400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:47.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f400ab70 con 0x7f33fc1560c0 2023-10-14T12:18:47.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f400acf0 con 0x7f33fc1560c0 2023-10-14T12:18:47.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc1f53d0 con 0x7f33fc1560c0 2023-10-14T12:18:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4007310 con 0x7f33fc1560c0 2023-10-14T12:18:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.661+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc0c7800 con 0x7f33fc1560c0 2023-10-14T12:18:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.662+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc0c79f0 con 0x7f33fc1560c0 2023-10-14T12:18:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.663+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f33f4007470 con 0x7f33fc1560c0 2023-10-14T12:18:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.663+0000 7f33e3fff700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f33e806af00 0x7f33e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.663+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33f40893a0 con 0x7f33fc1560c0 2023-10-14T12:18:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.663+0000 7f33faffd700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f33e806af00 0x7f33e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.664+0000 7f33faffd700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f33e806af00 0x7f33e806d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33f0000fb0 tx=0x7f33f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.668+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33f40544e0 con 0x7f33fc1560c0 2023-10-14T12:18:47.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.869+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33fc04ebb0 con 0x7f33fc1560c0 2023-10-14T12:18:47.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.870+0000 7f33e3fff700 1 -- 172.21.15.32:0/1726610966 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f33f400ae60 con 0x7f33fc1560c0 2023-10-14T12:18:47.872 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:47.873 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":20,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:46.895708+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:47.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f33e806af00 msgr2=0x7f33e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f33e806af00 0x7f33e806d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33f0000fb0 tx=0x7f33f0009040 comp rx=0 tx=0).stop 2023-10-14T12:18:47.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 msgr2=0x7f33fc154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:47.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 0x7f33fc154e80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33f4002230 tx=0x7f33f400cf50 comp rx=0 tx=0).stop 2023-10-14T12:18:47.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 shutdown_connections 2023-10-14T12:18:47.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33fc1560c0 0x7f33fc154e80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33fc0b7050 0x7f33fc0c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f33e806af00 0x7f33e806d3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 --2- 172.21.15.32:0/1726610966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33fc15dbc0 0x7f33fc157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:47.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.872+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 >> 172.21.15.32:0/1726610966 conn(0x7f33fc09cb40 msgr2=0x7f33fc0b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:47.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.873+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 shutdown_connections 2023-10-14T12:18:47.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:47.873+0000 7f3401a5b700 1 -- 172.21.15.32:0/1726610966 wait complete. 2023-10-14T12:18:47.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:48.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.010+0000 7f6929911700 1 Processor -- start 2023-10-14T12:18:48.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.010+0000 7f6929911700 1 -- start start 2023-10-14T12:18:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f6929911700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f692415e2f0 0x7f69240cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f6929911700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240b2d60 con 0x7f692406a840 2023-10-14T12:18:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f6929911700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240cdd30 con 0x7f69240cd950 2023-10-14T12:18:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f6929911700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69241619a0 con 0x7f692415e2f0 2023-10-14T12:18:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f69227fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f692415e2f0 0x7f69240cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f69237fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f692406a840 0x7f692406ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54970/0 (socket says 172.21.15.32:54970) 2023-10-14T12:18:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.011+0000 7f69237fe700 1 -- 172.21.15.32:0/3318479239 learned_addr learned my addr 172.21.15.32:0/3318479239 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:48.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f69227fc700 1 -- 172.21.15.32:0/3318479239 >> v1:172.21.15.92:6789/0 conn(0x7f69240cd950 legacy=0x7f692415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f69227fc700 1 -- 172.21.15.32:0/3318479239 >> v1:172.21.15.32:6789/0 conn(0x7f692406a840 legacy=0x7f692406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f69227fc700 1 -- 172.21.15.32:0/3318479239 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692415e920 con 0x7f692415e2f0 2023-10-14T12:18:48.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f6921ffb700 1 -- 172.21.15.32:0/3318479239 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564298552 0 0) 0x7f69240b2d60 con 0x7f692406a840 2023-10-14T12:18:48.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f69227fc700 1 --2- 172.21.15.32:0/3318479239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f692415e2f0 0x7f69240cede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6914009820 tx=0x7f6914009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66758752c23a06b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:48.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f6921ffb700 1 -- 172.21.15.32:0/3318479239 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914005e30 con 0x7f692415e2f0 2023-10-14T12:18:48.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f6921ffb700 1 -- 172.21.15.32:0/3318479239 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914006030 con 0x7f692415e2f0 2023-10-14T12:18:48.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.012+0000 7f6921ffb700 1 -- 172.21.15.32:0/3318479239 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140063e0 con 0x7f692415e2f0 2023-10-14T12:18:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 -- 172.21.15.32:0/3318479239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f692415e2f0 msgr2=0x7f69240cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 --2- 172.21.15.32:0/3318479239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f692415e2f0 0x7f69240cede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6914009820 tx=0x7f6914009b30 comp rx=0 tx=0).stop 2023-10-14T12:18:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 -- 172.21.15.32:0/3318479239 shutdown_connections 2023-10-14T12:18:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 --2- 172.21.15.32:0/3318479239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f692415e2f0 0x7f69240cede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 -- 172.21.15.32:0/3318479239 >> 172.21.15.32:0/3318479239 conn(0x7f692406dae0 msgr2=0x7f692406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 -- 172.21.15.32:0/3318479239 shutdown_connections 2023-10-14T12:18:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.013+0000 7f6929911700 1 -- 172.21.15.32:0/3318479239 wait complete. 2023-10-14T12:18:48.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.014+0000 7f6929911700 1 Processor -- start 2023-10-14T12:18:48.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.014+0000 7f6929911700 1 -- start start 2023-10-14T12:18:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6929911700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f692406a840 0x7f692415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6929911700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 0x7f69240ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6929911700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f692415e2f0 0x7f69240b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6929911700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b4870 con 0x7f69240cd950 2023-10-14T12:18:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6929911700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b4b50 con 0x7f692415e2f0 2023-10-14T12:18:48.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6929911700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b4e30 con 0x7f692406a840 2023-10-14T12:18:48.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 0x7f69240ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 0x7f69240ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37950/0 (socket says 172.21.15.32:37950) 2023-10-14T12:18:48.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 -- 172.21.15.32:0/580819452 learned_addr learned my addr 172.21.15.32:0/580819452 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:48.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f6922ffd700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f692406a840 0x7f692415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69237fe700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f692415e2f0 0x7f69240b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 -- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f692406a840 msgr2=0x7f692415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f692406a840 0x7f692415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 -- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f692415e2f0 msgr2=0x7f69240b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f692415e2f0 0x7f69240b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 -- 172.21.15.32:0/580819452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914009430 con 0x7f69240cd950 2023-10-14T12:18:48.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.015+0000 7f69227fc700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 0x7f69240ca010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f692406d4f0 tx=0x7f6914004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:48.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.016+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914025430 con 0x7f69240cd950 2023-10-14T12:18:48.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.016+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914020070 con 0x7f69240cd950 2023-10-14T12:18:48.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.016+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240b5110 con 0x7f69240cd950 2023-10-14T12:18:48.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.016+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140257d0 con 0x7f69240cd950 2023-10-14T12:18:48.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.016+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692415bf60 con 0x7f69240cd950 2023-10-14T12:18:48.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.016+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240b2630 con 0x7f69240cd950 2023-10-14T12:18:48.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.017+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6914022030 con 0x7f69240cd950 2023-10-14T12:18:48.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.017+0000 7f690bfff700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f691006af00 0x7f691006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.017+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f691408abb0 con 0x7f69240cd950 2023-10-14T12:18:48.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.018+0000 7f6922ffd700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f691006af00 0x7f691006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.018+0000 7f6922ffd700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f691006af00 0x7f691006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6918000f60 tx=0x7f6918009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:48.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.022+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6914055cf0 con 0x7f69240cd950 2023-10-14T12:18:48.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.223+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69240b2100 con 0x7f69240cd950 2023-10-14T12:18:48.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.224+0000 7f690bfff700 1 -- 172.21.15.32:0/580819452 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f6914059310 con 0x7f69240cd950 2023-10-14T12:18:48.226 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:48.226 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":20,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:46.895708+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:48.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f691006af00 msgr2=0x7f691006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f691006af00 0x7f691006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6918000f60 tx=0x7f6918009040 comp rx=0 tx=0).stop 2023-10-14T12:18:48.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 msgr2=0x7f69240ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 0x7f69240ca010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f692406d4f0 tx=0x7f6914004750 comp rx=0 tx=0).stop 2023-10-14T12:18:48.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 shutdown_connections 2023-10-14T12:18:48.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f691006af00 0x7f691006d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f692415e2f0 0x7f69240b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f692406a840 0x7f692415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 --2- 172.21.15.32:0/580819452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69240cd950 0x7f69240ca010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 >> 172.21.15.32:0/580819452 conn(0x7f692406dae0 msgr2=0x7f69240b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:48.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 shutdown_connections 2023-10-14T12:18:48.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.226+0000 7f6929911700 1 -- 172.21.15.32:0/580819452 wait complete. 2023-10-14T12:18:48.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T12:18:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.367+0000 7f2869349700 1 Processor -- start 2023-10-14T12:18:48.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.367+0000 7f2869349700 1 -- start start 2023-10-14T12:18:48.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2869349700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f286415dbc0 0x7f286415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2869349700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28640d3fc0 0x7f28640d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2869349700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28640b7050 0x7f28640d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2869349700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286415e4e0 con 0x7f28640d3fc0 2023-10-14T12:18:48.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2869349700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28640b7560 con 0x7f286415dbc0 2023-10-14T12:18:48.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2869349700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28640b7840 con 0x7f28640b7050 2023-10-14T12:18:48.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28640d3fc0 0x7f28640d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28640d3fc0 0x7f28640d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37956/0 (socket says 172.21.15.32:37956) 2023-10-14T12:18:48.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 -- 172.21.15.32:0/2213845908 learned_addr learned my addr 172.21.15.32:0/2213845908 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:48.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2862ffd700 1 --2- 172.21.15.32:0/2213845908 >> v2:172.21.15.92:3300/0 conn(0x7f286415dbc0 0x7f286415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28637fe700 1 --2- 172.21.15.32:0/2213845908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28640b7050 0x7f28640d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 -- 172.21.15.32:0/2213845908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28640b7050 msgr2=0x7f28640d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:48.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 --2- 172.21.15.32:0/2213845908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28640b7050 0x7f28640d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 -- 172.21.15.32:0/2213845908 >> v2:172.21.15.92:3300/0 conn(0x7f286415dbc0 msgr2=0x7f286415dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:48.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 --2- 172.21.15.32:0/2213845908 >> v2:172.21.15.92:3300/0 conn(0x7f286415dbc0 0x7f286415dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 -- 172.21.15.32:0/2213845908 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640b7b20 con 0x7f28640d3fc0 2023-10-14T12:18:48.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f2862ffd700 1 --2- 172.21.15.32:0/2213845908 >> v2:172.21.15.92:3300/0 conn(0x7f286415dbc0 0x7f286415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:48.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.368+0000 7f28627fc700 1 --2- 172.21.15.32:0/2213845908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640d3fc0 0x7f28640d1ac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2864072db0 tx=0x7f2854009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fac6c3e2346cf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:48.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2861ffb700 1 -- 172.21.15.32:0/2213845908 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400b870 con 0x7f28640d3fc0 2023-10-14T12:18:48.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2861ffb700 1 -- 172.21.15.32:0/2213845908 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285400b9d0 con 0x7f28640d3fc0 2023-10-14T12:18:48.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2861ffb700 1 -- 172.21.15.32:0/2213845908 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400bd60 con 0x7f28640d3fc0 2023-10-14T12:18:48.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 -- 172.21.15.32:0/2213845908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640d3fc0 msgr2=0x7f28640d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 --2- 172.21.15.32:0/2213845908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640d3fc0 0x7f28640d1ac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2864072db0 tx=0x7f2854009bd0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 -- 172.21.15.32:0/2213845908 shutdown_connections 2023-10-14T12:18:48.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 --2- 172.21.15.32:0/2213845908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28640b7050 0x7f28640d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 --2- 172.21.15.32:0/2213845908 >> v2:172.21.15.92:3300/0 conn(0x7f286415dbc0 0x7f286415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 --2- 172.21.15.32:0/2213845908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640d3fc0 0x7f28640d1ac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 -- 172.21.15.32:0/2213845908 >> 172.21.15.32:0/2213845908 conn(0x7f286409cb40 msgr2=0x7f28640d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:48.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 -- 172.21.15.32:0/2213845908 shutdown_connections 2023-10-14T12:18:48.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.369+0000 7f2869349700 1 -- 172.21.15.32:0/2213845908 wait complete. 2023-10-14T12:18:48.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 Processor -- start 2023-10-14T12:18:48.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 -- start start 2023-10-14T12:18:48.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 0x7f28641e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28640d3fc0 0x7f2864149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286415dbc0 0x7f28641f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2864158880 con 0x7f28640b7050 2023-10-14T12:18:48.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641f3390 con 0x7f28640d3fc0 2023-10-14T12:18:48.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2869349700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2864158420 con 0x7f286415dbc0 2023-10-14T12:18:48.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2862ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 0x7f28641e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2862ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 0x7f28641e6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37960/0 (socket says 172.21.15.32:37960) 2023-10-14T12:18:48.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.371+0000 7f2862ffd700 1 -- 172.21.15.32:0/4000963103 learned_addr learned my addr 172.21.15.32:0/4000963103 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:48.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f28627fc700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28640d3fc0 0x7f2864149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f28637fe700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286415dbc0 0x7f28641f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2862ffd700 1 -- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286415dbc0 msgr2=0x7f28641f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2862ffd700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286415dbc0 0x7f28641f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2862ffd700 1 -- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28640d3fc0 msgr2=0x7f2864149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:48.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2862ffd700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28640d3fc0 0x7f2864149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:48.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2862ffd700 1 -- 172.21.15.32:0/4000963103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2854009550 con 0x7f28640b7050 2023-10-14T12:18:48.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f28627fc700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28640d3fc0 0x7f2864149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:48.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2862ffd700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 0x7f28641e6890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f285800c7f0 tx=0x7f285800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:48.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858005c20 con 0x7f28640b7050 2023-10-14T12:18:48.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858005d80 con 0x7f28640b7050 2023-10-14T12:18:48.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858011820 con 0x7f28640b7050 2023-10-14T12:18:48.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2864157e60 con 0x7f28640b7050 2023-10-14T12:18:48.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.372+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28641e86d0 con 0x7f28640b7050 2023-10-14T12:18:48.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.373+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28640cd9f0 con 0x7f28640b7050 2023-10-14T12:18:48.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.373+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2858011980 con 0x7f28640b7050 2023-10-14T12:18:48.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.374+0000 7f284b7fe700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f285006af30 0x7f285006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:48.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.374+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2858089450 con 0x7f28640b7050 2023-10-14T12:18:48.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.374+0000 7f28627fc700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f285006af30 0x7f285006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:48.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.374+0000 7f28627fc700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f285006af30 0x7f285006d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2854000c00 tx=0x7f2854008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:48.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.378+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2858054470 con 0x7f28640b7050 2023-10-14T12:18:48.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:48.628+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f28640b7dd0 con 0x7f28640b7050 2023-10-14T12:18:49.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.501+0000 7f284b7fe700 1 -- 172.21.15.32:0/4000963103 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2858057a90 con 0x7f28640b7050 2023-10-14T12:18:49.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f285006af30 msgr2=0x7f285006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:49.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f285006af30 0x7f285006d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2854000c00 tx=0x7f2854008030 comp rx=0 tx=0).stop 2023-10-14T12:18:49.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 msgr2=0x7f28641e6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:49.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 0x7f28641e6890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f285800c7f0 tx=0x7f285800cbb0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 shutdown_connections 2023-10-14T12:18:49.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286415dbc0 0x7f28641f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28640b7050 0x7f28641e6890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f285006af30 0x7f285006d3f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.504+0000 7f2869349700 1 --2- 172.21.15.32:0/4000963103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28640d3fc0 0x7f2864149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.505+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 >> 172.21.15.32:0/4000963103 conn(0x7f286409cb40 msgr2=0x7f28640c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:49.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.505+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 shutdown_connections 2023-10-14T12:18:49.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.505+0000 7f2869349700 1 -- 172.21.15.32:0/4000963103 wait complete. 2023-10-14T12:18:49.522 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T12:18:49.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T12:18:49.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.657+0000 7fa88e6fb700 1 Processor -- start 2023-10-14T12:18:49.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.657+0000 7fa88e6fb700 1 -- start start 2023-10-14T12:18:49.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa88e6fb700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa88806e750 0x7fa8880ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:49.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa88e6fb700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880b5c70 con 0x7fa8880b54f0 2023-10-14T12:18:49.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa88e6fb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880b5990 con 0x7fa88806eb30 2023-10-14T12:18:49.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa88e6fb700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88815b2b0 con 0x7fa88806e750 2023-10-14T12:18:49.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa887fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa88806e750 0x7fa8880ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:49.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa88cc98700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8880b54f0 0x7fa88815ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54996/0 (socket says 172.21.15.32:54996) 2023-10-14T12:18:49.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa88cc98700 1 -- 172.21.15.32:0/2414423532 learned_addr learned my addr 172.21.15.32:0/2414423532 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:49.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa887fff700 1 -- 172.21.15.32:0/2414423532 >> v1:172.21.15.92:6789/0 conn(0x7fa88806eb30 legacy=0x7fa88815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:49.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa887fff700 1 -- 172.21.15.32:0/2414423532 >> v1:172.21.15.32:6789/0 conn(0x7fa8880b54f0 legacy=0x7fa88815ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:49.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa887fff700 1 -- 172.21.15.32:0/2414423532 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88815b590 con 0x7fa88806e750 2023-10-14T12:18:49.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa887fff700 1 --2- 172.21.15.32:0/2414423532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa8880ceec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa878009870 tx=0x7fa878009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa51a49f02d9aedb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:49.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa886ffd700 1 -- 172.21.15.32:0/2414423532 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878004230 con 0x7fa88806e750 2023-10-14T12:18:49.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa886ffd700 1 -- 172.21.15.32:0/2414423532 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878004390 con 0x7fa88806e750 2023-10-14T12:18:49.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.658+0000 7fa886ffd700 1 -- 172.21.15.32:0/2414423532 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780036a0 con 0x7fa88806e750 2023-10-14T12:18:49.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 -- 172.21.15.32:0/2414423532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 msgr2=0x7fa8880ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:49.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/2414423532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa8880ceec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa878009870 tx=0x7fa878009b80 comp rx=0 tx=0).stop 2023-10-14T12:18:49.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 -- 172.21.15.32:0/2414423532 shutdown_connections 2023-10-14T12:18:49.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/2414423532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa8880ceec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 -- 172.21.15.32:0/2414423532 >> 172.21.15.32:0/2414423532 conn(0x7fa8880cc6f0 msgr2=0x7fa8880ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:49.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 -- 172.21.15.32:0/2414423532 shutdown_connections 2023-10-14T12:18:49.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.659+0000 7fa88e6fb700 1 -- 172.21.15.32:0/2414423532 wait complete. 2023-10-14T12:18:49.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.660+0000 7fa88e6fb700 1 Processor -- start 2023-10-14T12:18:49.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.660+0000 7fa88e6fb700 1 -- start start 2023-10-14T12:18:49.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88e6fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa88815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:49.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88e6fb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa88806eb30 0x7fa8880ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:49.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88e6fb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880b54f0 0x7fa88815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:49.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88e6fb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881f6c30 con 0x7fa88806e750 2023-10-14T12:18:49.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88e6fb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815ad10 con 0x7fa8880b54f0 2023-10-14T12:18:49.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88e6fb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881591c0 con 0x7fa88806eb30 2023-10-14T12:18:49.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa887fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa88815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:49.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa887fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa88815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37974/0 (socket says 172.21.15.32:37974) 2023-10-14T12:18:49.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa887fff700 1 -- 172.21.15.32:0/3318536871 learned_addr learned my addr 172.21.15.32:0/3318536871 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:49.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa88cc98700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880b54f0 0x7fa88815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:49.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa887fff700 1 -- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa88806eb30 msgr2=0x7fa8880ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:49.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.661+0000 7fa8877fe700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa88806eb30 0x7fa8880ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:49.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa887fff700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa88806eb30 0x7fa8880ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa887fff700 1 -- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880b54f0 msgr2=0x7fa88815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:49.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa887fff700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880b54f0 0x7fa88815eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:49.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa887fff700 1 -- 172.21.15.32:0/3318536871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094a0 con 0x7fa88806e750 2023-10-14T12:18:49.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa88cc98700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880b54f0 0x7fa88815eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:49.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa8877fe700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa88806eb30 0x7fa8880ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:49.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa887fff700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa88815a7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa878009fd0 tx=0x7fa878004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:49.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878011830 con 0x7fa88806e750 2023-10-14T12:18:49.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87801e070 con 0x7fa88806e750 2023-10-14T12:18:49.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8881594a0 con 0x7fa88806e750 2023-10-14T12:18:49.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878011bd0 con 0x7fa88806e750 2023-10-14T12:18:49.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.662+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa888159a60 con 0x7fa88806e750 2023-10-14T12:18:49.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.663+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8881f6de0 con 0x7fa88806e750 2023-10-14T12:18:49.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.663+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa878011d30 con 0x7fa88806e750 2023-10-14T12:18:49.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.664+0000 7fa884ff9700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa87406af00 0x7fa87406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:49.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.664+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa87808a8b0 con 0x7fa88806e750 2023-10-14T12:18:49.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.664+0000 7fa8877fe700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa87406af00 0x7fa87406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:49.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.664+0000 7fa8877fe700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa87406af00 0x7fa87406d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8880ca140 tx=0x7fa87c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:49.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.668+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8780559f0 con 0x7fa88806e750 2023-10-14T12:18:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:49.916+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa888067d20 con 0x7fa88806e750 2023-10-14T12:18:50.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.506+0000 7fa884ff9700 1 -- 172.21.15.32:0/3318536871 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa878020070 con 0x7fa88806e750 2023-10-14T12:18:50.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa87406af00 msgr2=0x7fa87406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa87406af00 0x7fa87406d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8880ca140 tx=0x7fa87c009040 comp rx=0 tx=0).stop 2023-10-14T12:18:50.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 msgr2=0x7fa88815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa88815a7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa878009fd0 tx=0x7fa878004750 comp rx=0 tx=0).stop 2023-10-14T12:18:50.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 shutdown_connections 2023-10-14T12:18:50.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa87406af00 0x7fa87406d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880b54f0 0x7fa88815eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa88806e750 0x7fa88815a7d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 --2- 172.21.15.32:0/3318536871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa88806eb30 0x7fa8880ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.508+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 >> 172.21.15.32:0/3318536871 conn(0x7fa8880cc6f0 msgr2=0x7fa8880ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:50.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.509+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 shutdown_connections 2023-10-14T12:18:50.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.509+0000 7fa88e6fb700 1 -- 172.21.15.32:0/3318536871 wait complete. 2023-10-14T12:18:50.524 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T12:18:50.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:18:50.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.651+0000 7f3c94793700 1 Processor -- start 2023-10-14T12:18:50.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.652+0000 7f3c94793700 1 -- start start 2023-10-14T12:18:50.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.652+0000 7f3c94793700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c06e750 0x7f3c8c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:50.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.652+0000 7f3c94793700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3c8c0b54f0 0x7f3c8c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:50.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.652+0000 7f3c94793700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0b5c70 con 0x7f3c8c06eb30 2023-10-14T12:18:50.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.652+0000 7f3c94793700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b5990 con 0x7f3c8c0b54f0 2023-10-14T12:18:50.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.652+0000 7f3c94793700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c15b2b0 con 0x7f3c8c06e750 2023-10-14T12:18:50.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c9252f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c06e750 0x7f3c8c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:50.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3c8c0b54f0 0x7f3c8c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:50.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c91d2e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3c8c06eb30 0x7f3c8c15e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:53882/0 (socket says 172.21.15.32:53882) 2023-10-14T12:18:50.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3c8c0b54f0 0x7f3c8c0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42254/0 (socket says 172.21.15.32:42254) 2023-10-14T12:18:50.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c9252f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c06e750 0x7f3c8c0ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43674/0 (socket says 172.21.15.32:43674) 2023-10-14T12:18:50.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c91d2e700 1 -- 172.21.15.32:0/3077819609 learned_addr learned my addr 172.21.15.32:0/3077819609 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:50.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 -- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c06e750 msgr2=0x7f3c8c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:50.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 --2- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c06e750 0x7f3c8c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 -- 172.21.15.32:0/3077819609 >> v1:172.21.15.92:6789/0 conn(0x7f3c8c06eb30 legacy=0x7f3c8c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 -- 172.21.15.32:0/3077819609 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c15b590 con 0x7f3c8c0b54f0 2023-10-14T12:18:50.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c9152d700 1 -- 172.21.15.32:0/3077819609 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228536848 0 0) 0x7f3c8c0b5c70 con 0x7f3c8c06eb30 2023-10-14T12:18:50.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c92d30700 1 --2- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c0b54f0 0x7f3c8c0cf400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009d90 tx=0x7f3c8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ba76dadebb31da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:50.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.653+0000 7f3c9152d700 1 -- 172.21.15.32:0/3077819609 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400e070 con 0x7f3c8c0b54f0 2023-10-14T12:18:50.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c9152d700 1 -- 172.21.15.32:0/3077819609 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8400bb20 con 0x7f3c8c0b54f0 2023-10-14T12:18:50.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c9152d700 1 -- 172.21.15.32:0/3077819609 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84012430 con 0x7f3c8c0b54f0 2023-10-14T12:18:50.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 -- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c0b54f0 msgr2=0x7f3c8c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 --2- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c0b54f0 0x7f3c8c0cf400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009d90 tx=0x7f3c8400b330 comp rx=0 tx=0).stop 2023-10-14T12:18:50.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 -- 172.21.15.32:0/3077819609 shutdown_connections 2023-10-14T12:18:50.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 --2- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c06e750 0x7f3c8c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 --2- 172.21.15.32:0/3077819609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c0b54f0 0x7f3c8c0cf400 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 -- 172.21.15.32:0/3077819609 >> 172.21.15.32:0/3077819609 conn(0x7f3c8c0cc6f0 msgr2=0x7f3c8c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:50.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 -- 172.21.15.32:0/3077819609 shutdown_connections 2023-10-14T12:18:50.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.654+0000 7f3c94793700 1 -- 172.21.15.32:0/3077819609 wait complete. 2023-10-14T12:18:50.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.655+0000 7f3c94793700 1 Processor -- start 2023-10-14T12:18:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.655+0000 7f3c94793700 1 -- start start 2023-10-14T12:18:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c94793700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c06e750 0x7f3c8c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c94793700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 0x7f3c8c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c94793700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c0b54f0 0x7f3c8c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c94793700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c153b80 con 0x7f3c8c06eb30 2023-10-14T12:18:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c94793700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0adaa0 con 0x7f3c8c06e750 2023-10-14T12:18:50.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c94793700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0ace90 con 0x7f3c8c0b54f0 2023-10-14T12:18:50.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c91d2e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 0x7f3c8c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:50.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c91d2e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 0x7f3c8c153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37992/0 (socket says 172.21.15.32:37992) 2023-10-14T12:18:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c91d2e700 1 -- 172.21.15.32:0/10689417 learned_addr learned my addr 172.21.15.32:0/10689417 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c92d30700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c0b54f0 0x7f3c8c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.656+0000 7f3c9252f700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c06e750 0x7f3c8c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c91d2e700 1 -- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c0b54f0 msgr2=0x7f3c8c15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c91d2e700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c0b54f0 0x7f3c8c15bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c91d2e700 1 -- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c06e750 msgr2=0x7f3c8c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c91d2e700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c06e750 0x7f3c8c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c91d2e700 1 -- 172.21.15.32:0/10689417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c84009a70 con 0x7f3c8c06eb30 2023-10-14T12:18:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c92d30700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c0b54f0 0x7f3c8c15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c91d2e700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 0x7f3c8c153560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c880011e0 tx=0x7f3c8800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88004c80 con 0x7f3c8c06eb30 2023-10-14T12:18:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88004e00 con 0x7f3c8c06eb30 2023-10-14T12:18:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c0ad170 con 0x7f3c8c06eb30 2023-10-14T12:18:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88007310 con 0x7f3c8c06eb30 2023-10-14T12:18:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.657+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c0ad730 con 0x7f3c8c06eb30 2023-10-14T12:18:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.658+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c067d20 con 0x7f3c8c06eb30 2023-10-14T12:18:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.658+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c88007470 con 0x7f3c8c06eb30 2023-10-14T12:18:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.659+0000 7f3c7effd700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3c7006af00 0x7f3c7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.659+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c88089450 con 0x7f3c8c06eb30 2023-10-14T12:18:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.659+0000 7f3c9252f700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3c7006af00 0x7f3c7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.660+0000 7f3c9252f700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3c7006af00 0x7f3c7006d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009b70 tx=0x7f3c80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.663+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c88054480 con 0x7f3c8c06eb30 2023-10-14T12:18:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.906+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c8c06b950 con 0x7f3c8c06eb30 2023-10-14T12:18:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.907+0000 7f3c7effd700 1 -- 172.21.15.32:0/10689417 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f3c88057aa0 con 0x7f3c8c06eb30 2023-10-14T12:18:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:50.910 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:18:50.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3c7006af00 msgr2=0x7f3c7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3c7006af00 0x7f3c7006d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009b70 tx=0x7f3c80008040 comp rx=0 tx=0).stop 2023-10-14T12:18:50.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 msgr2=0x7f3c8c153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:50.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 0x7f3c8c153560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c880011e0 tx=0x7f3c8800cae0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 shutdown_connections 2023-10-14T12:18:50.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c8c0b54f0 0x7f3c8c15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3c7006af00 0x7f3c7006d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c06e750 0x7f3c8c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 --2- 172.21.15.32:0/10689417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c8c06eb30 0x7f3c8c153560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:50.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 >> 172.21.15.32:0/10689417 conn(0x7f3c8c0cc6f0 msgr2=0x7f3c8c0b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:50.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 shutdown_connections 2023-10-14T12:18:50.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:50.909+0000 7f3c94793700 1 -- 172.21.15.32:0/10689417 wait complete. 2023-10-14T12:18:50.915 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:18:50.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.046+0000 7f755f7c1700 1 Processor -- start 2023-10-14T12:18:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.046+0000 7f755f7c1700 1 -- start start 2023-10-14T12:18:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755f7c1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f75580cfe30 0x7f75580cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755f7c1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755815e7a0 con 0x7f755815f1f0 2023-10-14T12:18:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755f7c1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580b29a0 con 0x7f755815ab10 2023-10-14T12:18:51.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755f7c1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75580b2c80 con 0x7f75580cfe30 2023-10-14T12:18:51.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755cd5c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f755815f1f0 0x7f75580cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55020/0 (socket says 172.21.15.32:55020) 2023-10-14T12:18:51.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755cd5c700 1 -- 172.21.15.32:0/2054990049 learned_addr learned my addr 172.21.15.32:0/2054990049 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:51.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.047+0000 7f755dd5e700 1 --2- 172.21.15.32:0/2054990049 >> v2:172.21.15.92:3300/0 conn(0x7f75580cfe30 0x7f75580cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f754ffff700 1 -- 172.21.15.32:0/2054990049 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272645627 0 0) 0x7f755815e7a0 con 0x7f755815f1f0 2023-10-14T12:18:51.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f754ffff700 1 -- 172.21.15.32:0/2054990049 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75440035b0 con 0x7f755815f1f0 2023-10-14T12:18:51.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f755dd5e700 1 -- 172.21.15.32:0/2054990049 >> v1:172.21.15.92:6789/0 conn(0x7f755815ab10 legacy=0x7f75580b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f754ffff700 1 -- 172.21.15.32:0/2054990049 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915233374 0 0) 0x7f75580b29a0 con 0x7f755815ab10 2023-10-14T12:18:51.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f755dd5e700 1 -- 172.21.15.32:0/2054990049 >> v1:172.21.15.32:6789/0 conn(0x7f755815f1f0 legacy=0x7f75580cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f755dd5e700 1 -- 172.21.15.32:0/2054990049 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755815e9f0 con 0x7f75580cfe30 2023-10-14T12:18:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f755dd5e700 1 --2- 172.21.15.32:0/2054990049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75580cfe30 0x7f75580cbf40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7550009d90 tx=0x7f755000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea5ead50324b7e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f754ffff700 1 -- 172.21.15.32:0/2054990049 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000e070 con 0x7f75580cfe30 2023-10-14T12:18:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f754ffff700 1 -- 172.21.15.32:0/2054990049 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755000bb20 con 0x7f75580cfe30 2023-10-14T12:18:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.048+0000 7f754ffff700 1 -- 172.21.15.32:0/2054990049 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000bed0 con 0x7f75580cfe30 2023-10-14T12:18:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 -- 172.21.15.32:0/2054990049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75580cfe30 msgr2=0x7f75580cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 --2- 172.21.15.32:0/2054990049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75580cfe30 0x7f75580cbf40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7550009d90 tx=0x7f755000b330 comp rx=0 tx=0).stop 2023-10-14T12:18:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 -- 172.21.15.32:0/2054990049 shutdown_connections 2023-10-14T12:18:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 --2- 172.21.15.32:0/2054990049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75580cfe30 0x7f75580cbf40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 -- 172.21.15.32:0/2054990049 >> 172.21.15.32:0/2054990049 conn(0x7f755806dae0 msgr2=0x7f755806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 -- 172.21.15.32:0/2054990049 shutdown_connections 2023-10-14T12:18:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.049+0000 7f755f7c1700 1 -- 172.21.15.32:0/2054990049 wait complete. 2023-10-14T12:18:51.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.050+0000 7f755f7c1700 1 Processor -- start 2023-10-14T12:18:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.050+0000 7f755f7c1700 1 -- start start 2023-10-14T12:18:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75580cfe30 0x7f755814dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 0x7f755815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755815f1f0 0x7f75581584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c8670 con 0x7f755815ab10 2023-10-14T12:18:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755814e010 con 0x7f755815f1f0 2023-10-14T12:18:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7558156b50 con 0x7f75580cfe30 2023-10-14T12:18:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 0x7f755815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 0x7f755815c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38004/0 (socket says 172.21.15.32:38004) 2023-10-14T12:18:51.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 -- 172.21.15.32:0/1178109930 learned_addr learned my addr 172.21.15.32:0/1178109930 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:51.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755dd5e700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755815f1f0 0x7f75581584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755d55d700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75580cfe30 0x7f755814dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 -- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75580cfe30 msgr2=0x7f755814dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75580cfe30 0x7f755814dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 -- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755815f1f0 msgr2=0x7f75581584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755815f1f0 0x7f75581584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 -- 172.21.15.32:0/1178109930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550009a70 con 0x7f755815ab10 2023-10-14T12:18:51.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755cd5c700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 0x7f755815c720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f755400c700 tx=0x7f755400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540074e0 con 0x7f755815ab10 2023-10-14T12:18:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554007660 con 0x7f755815ab10 2023-10-14T12:18:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.051+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7558155040 con 0x7f755815ab10 2023-10-14T12:18:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.052+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554005a70 con 0x7f755815ab10 2023-10-14T12:18:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.052+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7558155600 con 0x7f755815ab10 2023-10-14T12:18:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.053+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75580b0d90 con 0x7f755815ab10 2023-10-14T12:18:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.053+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7554005bd0 con 0x7f755815ab10 2023-10-14T12:18:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.053+0000 7f754dffb700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f753c06af00 0x7f753c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.054+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7554088a40 con 0x7f755815ab10 2023-10-14T12:18:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.054+0000 7f755d55d700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f753c06af00 0x7f753c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.054+0000 7f755d55d700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f753c06af00 0x7f753c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7548007fd0 tx=0x7f7548009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.058+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f755408ae60 con 0x7f755815ab10 2023-10-14T12:18:51.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.258+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7558157cc0 con 0x7f755815ab10 2023-10-14T12:18:51.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.259+0000 7f754dffb700 1 -- 172.21.15.32:0/1178109930 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f7554017090 con 0x7f755815ab10 2023-10-14T12:18:51.261 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:51.262 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:51.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f753c06af00 msgr2=0x7f753c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f753c06af00 0x7f753c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7548007fd0 tx=0x7f7548009040 comp rx=0 tx=0).stop 2023-10-14T12:18:51.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 msgr2=0x7f755815c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 0x7f755815c720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f755400c700 tx=0x7f755400ca10 comp rx=0 tx=0).stop 2023-10-14T12:18:51.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 shutdown_connections 2023-10-14T12:18:51.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f753c06af00 0x7f753c06d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f755815f1f0 0x7f75581584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75580cfe30 0x7f755814dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 --2- 172.21.15.32:0/1178109930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755815ab10 0x7f755815c720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 >> 172.21.15.32:0/1178109930 conn(0x7f755806dae0 msgr2=0x7f75580b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:51.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 shutdown_connections 2023-10-14T12:18:51.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.261+0000 7f755f7c1700 1 -- 172.21.15.32:0/1178109930 wait complete. 2023-10-14T12:18:51.276 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T12:18:51.276 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:18:51.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.399+0000 7fc6a2853700 1 Processor -- start 2023-10-14T12:18:51.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.399+0000 7fc6a2853700 1 -- start start 2023-10-14T12:18:51.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a2853700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc69c15f1f0 0x7fc69c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a2853700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc69c0cfc60 0x7fc69c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a2853700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c15e7a0 con 0x7fc69c15ab10 2023-10-14T12:18:51.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a2853700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c0d0090 con 0x7fc69c0cfc60 2023-10-14T12:18:51.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a2853700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c0b29a0 con 0x7fc69c15f1f0 2023-10-14T12:18:51.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc69c0cfc60 0x7fc69c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc69c0cfc60 0x7fc69c0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38014/0 (socket says 172.21.15.32:38014) 2023-10-14T12:18:51.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 -- 172.21.15.32:0/3322252953 learned_addr learned my addr 172.21.15.32:0/3322252953 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:51.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc69b7fe700 1 --2- 172.21.15.32:0/3322252953 >> v2:172.21.15.92:3300/0 conn(0x7fc69c15f1f0 0x7fc69c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 -- 172.21.15.32:0/3322252953 >> v2:172.21.15.92:3300/0 conn(0x7fc69c15f1f0 msgr2=0x7fc69c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:51.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 --2- 172.21.15.32:0/3322252953 >> v2:172.21.15.92:3300/0 conn(0x7fc69c15f1f0 0x7fc69c0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 -- 172.21.15.32:0/3322252953 >> v1:172.21.15.92:6789/0 conn(0x7fc69c15ab10 legacy=0x7fc69c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 -- 172.21.15.32:0/3322252953 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c0b2c80 con 0x7fc69c0cfc60 2023-10-14T12:18:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc69b7fe700 1 --2- 172.21.15.32:0/3322252953 >> v2:172.21.15.92:3300/0 conn(0x7fc69c15f1f0 0x7fc69c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc6a0df0700 1 --2- 172.21.15.32:0/3322252953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0cbf40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc69c06d470 tx=0x7fc69400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddeb8275a9e34ae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.400+0000 7fc69affd700 1 -- 172.21.15.32:0/3322252953 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400e070 con 0x7fc69c0cfc60 2023-10-14T12:18:51.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc69affd700 1 -- 172.21.15.32:0/3322252953 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400b9c0 con 0x7fc69c0cfc60 2023-10-14T12:18:51.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc69affd700 1 -- 172.21.15.32:0/3322252953 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400bd70 con 0x7fc69c0cfc60 2023-10-14T12:18:51.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 -- 172.21.15.32:0/3322252953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 msgr2=0x7fc69c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 --2- 172.21.15.32:0/3322252953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0cbf40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc69c06d470 tx=0x7fc69400b330 comp rx=0 tx=0).stop 2023-10-14T12:18:51.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 -- 172.21.15.32:0/3322252953 shutdown_connections 2023-10-14T12:18:51.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 --2- 172.21.15.32:0/3322252953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0cbf40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 --2- 172.21.15.32:0/3322252953 >> v2:172.21.15.92:3300/0 conn(0x7fc69c15f1f0 0x7fc69c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 -- 172.21.15.32:0/3322252953 >> 172.21.15.32:0/3322252953 conn(0x7fc69c06dae0 msgr2=0x7fc69c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:51.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 -- 172.21.15.32:0/3322252953 shutdown_connections 2023-10-14T12:18:51.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.401+0000 7fc6a2853700 1 -- 172.21.15.32:0/3322252953 wait complete. 2023-10-14T12:18:51.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.402+0000 7fc6a2853700 1 Processor -- start 2023-10-14T12:18:51.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 -- start start 2023-10-14T12:18:51.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc69c15ab10 0x7fc69c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c15f1f0 0x7fc69c1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0c6c30 con 0x7fc69c0cfc60 2023-10-14T12:18:51.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0c6320 con 0x7fc69c15f1f0 2023-10-14T12:18:51.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc6a2853700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0af1b0 con 0x7fc69c15ab10 2023-10-14T12:18:51.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.403+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38016/0 (socket says 172.21.15.32:38016) 2023-10-14T12:18:51.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 -- 172.21.15.32:0/1927799767 learned_addr learned my addr 172.21.15.32:0/1927799767 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:51.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc6a0df0700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c15f1f0 0x7fc69c1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69b7fe700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc69c15ab10 0x7fc69c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 -- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc69c15ab10 msgr2=0x7fc69c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc69c15ab10 0x7fc69c0b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 -- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c15f1f0 msgr2=0x7fc69c1f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c15f1f0 0x7fc69c1f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 -- 172.21.15.32:0/1927799767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009b30 con 0x7fc69c0cfc60 2023-10-14T12:18:51.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc6a0df0700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c15f1f0 0x7fc69c1f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:51.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc69bfff700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0aeb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c450 tx=0x7fc68c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0052d0 con 0x7fc69c0cfc60 2023-10-14T12:18:51.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c005430 con 0x7fc69c0cfc60 2023-10-14T12:18:51.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c0c6570 con 0x7fc69c0cfc60 2023-10-14T12:18:51.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0038c0 con 0x7fc69c0cfc60 2023-10-14T12:18:51.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.404+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c0b4980 con 0x7fc69c0cfc60 2023-10-14T12:18:51.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.405+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c0c6d70 con 0x7fc69c0cfc60 2023-10-14T12:18:51.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.406+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc68c003a20 con 0x7fc69c0cfc60 2023-10-14T12:18:51.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.406+0000 7fc698ff9700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc67c06af00 0x7fc67c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.406+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68c0888e0 con 0x7fc69c0cfc60 2023-10-14T12:18:51.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.406+0000 7fc69b7fe700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc67c06af00 0x7fc67c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.407+0000 7fc69b7fe700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc67c06af00 0x7fc67c06d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0c5600 tx=0x7fc684008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.411+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc68c053990 con 0x7fc69c0cfc60 2023-10-14T12:18:51.452 INFO:tasks.ceph.mds.d.smithi092.stderr:2023-10-14T12:18:51.450+0000 7faaaa42d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:18:51.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.609+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc69c15ecd0 con 0x7fc67c06af00 2023-10-14T12:18:51.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.618+0000 7fc698ff9700 1 -- 172.21.15.32:0/1927799767 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264590 (secure 0 0 0) 0x7fc684009dc0 con 0x7fc67c06af00 2023-10-14T12:18:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:51.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc67c06af00 msgr2=0x7fc67c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc67c06af00 0x7fc67c06d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0c5600 tx=0x7fc684008040 comp rx=0 tx=0).stop 2023-10-14T12:18:51.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 msgr2=0x7fc69c0aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0aeb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c450 tx=0x7fc68c00c810 comp rx=0 tx=0).stop 2023-10-14T12:18:51.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 shutdown_connections 2023-10-14T12:18:51.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc67c06af00 0x7fc67c06d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c15f1f0 0x7fc69c1f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc69c0cfc60 0x7fc69c0aeb10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 --2- 172.21.15.32:0/1927799767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc69c15ab10 0x7fc69c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 >> 172.21.15.32:0/1927799767 conn(0x7fc69c06dae0 msgr2=0x7fc69c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 shutdown_connections 2023-10-14T12:18:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.621+0000 7fc6a2853700 1 -- 172.21.15.32:0/1927799767 wait complete. 2023-10-14T12:18:51.629 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:18:51.636 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T12:18:51.097305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2953216,"data_stored":1771208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.629403"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514013+0000","last_change":"2023-10-14T12:18:47.509049+0000","last_active":"2023-10-14T12:18:47.514013+0000","last_peered":"2023-10-14T12:18:47.514013+0000","last_clean":"2023-10-14T12:18:47.514013+0000","last_became_active":"2023-10-14T12:18:47.508659+0000","last_became_peered":"2023-10-14T12:18:47.508659+0000","last_unstale":"2023-10-14T12:18:47.514013+0000","last_undegraded":"2023-10-14T12:18:47.514013+0000","last_fullsized":"2023-10-14T12:18:47.514013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651885+0000","last_change":"2023-10-14T12:18:47.500830+0000","last_active":"2023-10-14T12:18:48.651885+0000","last_peered":"2023-10-14T12:18:48.651885+0000","last_clean":"2023-10-14T12:18:48.651885+0000","last_became_active":"2023-10-14T12:18:47.500534+0000","last_became_peered":"2023-10-14T12:18:47.500534+0000","last_unstale":"2023-10-14T12:18:48.651885+0000","last_undegraded":"2023-10-14T12:18:48.651885+0000","last_fullsized":"2023-10-14T12:18:48.651885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.505913+0000","last_change":"2023-10-14T12:18:47.502596+0000","last_active":"2023-10-14T12:18:47.505913+0000","last_peered":"2023-10-14T12:18:47.505913+0000","last_clean":"2023-10-14T12:18:47.505913+0000","last_became_active":"2023-10-14T12:18:47.502274+0000","last_became_peered":"2023-10-14T12:18:47.502274+0000","last_unstale":"2023-10-14T12:18:47.505913+0000","last_undegraded":"2023-10-14T12:18:47.505913+0000","last_fullsized":"2023-10-14T12:18:47.505913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501296+0000","last_change":"2023-10-14T12:18:47.517714+0000","last_active":"2023-10-14T12:18:48.501296+0000","last_peered":"2023-10-14T12:18:48.501296+0000","last_clean":"2023-10-14T12:18:48.501296+0000","last_became_active":"2023-10-14T12:18:47.512963+0000","last_became_peered":"2023-10-14T12:18:47.512963+0000","last_unstale":"2023-10-14T12:18:48.501296+0000","last_undegraded":"2023-10-14T12:18:48.501296+0000","last_fullsized":"2023-10-14T12:18:48.501296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:47.569087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.513079+0000","last_change":"2023-10-14T12:18:47.505586+0000","last_active":"2023-10-14T12:18:47.513079+0000","last_peered":"2023-10-14T12:18:47.513079+0000","last_clean":"2023-10-14T12:18:47.513079+0000","last_became_active":"2023-10-14T12:18:47.505317+0000","last_became_peered":"2023-10-14T12:18:47.505317+0000","last_unstale":"2023-10-14T12:18:47.513079+0000","last_undegraded":"2023-10-14T12:18:47.513079+0000","last_fullsized":"2023-10-14T12:18:47.513079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501003+0000","last_change":"2023-10-14T12:18:47.518702+0000","last_active":"2023-10-14T12:18:48.501003+0000","last_peered":"2023-10-14T12:18:48.501003+0000","last_clean":"2023-10-14T12:18:48.501003+0000","last_became_active":"2023-10-14T12:18:47.512637+0000","last_became_peered":"2023-10-14T12:18:47.512637+0000","last_unstale":"2023-10-14T12:18:48.501003+0000","last_undegraded":"2023-10-14T12:18:48.501003+0000","last_fullsized":"2023-10-14T12:18:48.501003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.513811+0000","last_change":"2023-10-14T12:18:47.508247+0000","last_active":"2023-10-14T12:18:47.513811+0000","last_peered":"2023-10-14T12:18:47.513811+0000","last_clean":"2023-10-14T12:18:47.513811+0000","last_became_active":"2023-10-14T12:18:47.507971+0000","last_became_peered":"2023-10-14T12:18:47.507971+0000","last_unstale":"2023-10-14T12:18:47.513811+0000","last_undegraded":"2023-10-14T12:18:47.513811+0000","last_fullsized":"2023-10-14T12:18:47.513811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500163+0000","last_change":"2023-10-14T12:18:47.512408+0000","last_active":"2023-10-14T12:18:48.500163+0000","last_peered":"2023-10-14T12:18:48.500163+0000","last_clean":"2023-10-14T12:18:48.500163+0000","last_became_active":"2023-10-14T12:18:47.512170+0000","last_became_peered":"2023-10-14T12:18:47.512170+0000","last_unstale":"2023-10-14T12:18:48.500163+0000","last_undegraded":"2023-10-14T12:18:48.500163+0000","last_fullsized":"2023-10-14T12:18:48.500163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.519910+0000","last_change":"2023-10-14T12:18:47.518549+0000","last_active":"2023-10-14T12:18:47.519910+0000","last_peered":"2023-10-14T12:18:47.519910+0000","last_clean":"2023-10-14T12:18:47.519910+0000","last_became_active":"2023-10-14T12:18:47.517982+0000","last_became_peered":"2023-10-14T12:18:47.517982+0000","last_unstale":"2023-10-14T12:18:47.519910+0000","last_undegraded":"2023-10-14T12:18:47.519910+0000","last_fullsized":"2023-10-14T12:18:47.519910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444405+0000","last_change":"2023-10-14T12:18:47.512949+0000","last_active":"2023-10-14T12:18:49.444405+0000","last_peered":"2023-10-14T12:18:49.444405+0000","last_clean":"2023-10-14T12:18:49.444405+0000","last_became_active":"2023-10-14T12:18:47.512703+0000","last_became_peered":"2023-10-14T12:18:47.512703+0000","last_unstale":"2023-10-14T12:18:49.444405+0000","last_undegraded":"2023-10-14T12:18:49.444405+0000","last_fullsized":"2023-10-14T12:18:49.444405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444355+0000","last_change":"2023-10-14T12:18:47.518785+0000","last_active":"2023-10-14T12:18:49.444355+0000","last_peered":"2023-10-14T12:18:49.444355+0000","last_clean":"2023-10-14T12:18:49.444355+0000","last_became_active":"2023-10-14T12:18:47.518508+0000","last_became_peered":"2023-10-14T12:18:47.518508+0000","last_unstale":"2023-10-14T12:18:49.444355+0000","last_undegraded":"2023-10-14T12:18:49.444355+0000","last_fullsized":"2023-10-14T12:18:49.444355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769191+0000","last_change":"2023-10-14T12:18:47.504920+0000","last_active":"2023-10-14T12:18:49.769191+0000","last_peered":"2023-10-14T12:18:49.769191+0000","last_clean":"2023-10-14T12:18:49.769191+0000","last_became_active":"2023-10-14T12:18:47.504633+0000","last_became_peered":"2023-10-14T12:18:47.504633+0000","last_unstale":"2023-10-14T12:18:49.769191+0000","last_undegraded":"2023-10-14T12:18:49.769191+0000","last_fullsized":"2023-10-14T12:18:49.769191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500384+0000","last_change":"2023-10-14T12:18:47.505034+0000","last_active":"2023-10-14T12:18:48.500384+0000","last_peered":"2023-10-14T12:18:48.500384+0000","last_clean":"2023-10-14T12:18:48.500384+0000","last_became_active":"2023-10-14T12:18:47.504655+0000","last_became_peered":"2023-10-14T12:18:47.504655+0000","last_unstale":"2023-10-14T12:18:48.500384+0000","last_undegraded":"2023-10-14T12:18:48.500384+0000","last_fullsized":"2023-10-14T12:18:48.500384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.504922+0000","last_change":"2023-10-14T12:18:47.499576+0000","last_active":"2023-10-14T12:18:47.504922+0000","last_peered":"2023-10-14T12:18:47.504922+0000","last_clean":"2023-10-14T12:18:47.504922+0000","last_became_active":"2023-10-14T12:18:47.499249+0000","last_became_peered":"2023-10-14T12:18:47.499249+0000","last_unstale":"2023-10-14T12:18:47.504922+0000","last_undegraded":"2023-10-14T12:18:47.504922+0000","last_fullsized":"2023-10-14T12:18:47.504922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651648+0000","last_change":"2023-10-14T12:18:47.508453+0000","last_active":"2023-10-14T12:18:48.651648+0000","last_peered":"2023-10-14T12:18:48.651648+0000","last_clean":"2023-10-14T12:18:48.651648+0000","last_became_active":"2023-10-14T12:18:47.508081+0000","last_became_peered":"2023-10-14T12:18:47.508081+0000","last_unstale":"2023-10-14T12:18:48.651648+0000","last_undegraded":"2023-10-14T12:18:48.651648+0000","last_fullsized":"2023-10-14T12:18:48.651648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500721+0000","last_change":"2023-10-14T12:18:47.505739+0000","last_active":"2023-10-14T12:18:48.500721+0000","last_peered":"2023-10-14T12:18:48.500721+0000","last_clean":"2023-10-14T12:18:48.500721+0000","last_became_active":"2023-10-14T12:18:47.505456+0000","last_became_peered":"2023-10-14T12:18:47.505456+0000","last_unstale":"2023-10-14T12:18:48.500721+0000","last_undegraded":"2023-10-14T12:18:48.500721+0000","last_fullsized":"2023-10-14T12:18:48.500721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501605+0000","last_change":"2023-10-14T12:18:47.516673+0000","last_active":"2023-10-14T12:18:48.501605+0000","last_peered":"2023-10-14T12:18:48.501605+0000","last_clean":"2023-10-14T12:18:48.501605+0000","last_became_active":"2023-10-14T12:18:47.516312+0000","last_became_peered":"2023-10-14T12:18:47.516312+0000","last_unstale":"2023-10-14T12:18:48.501605+0000","last_undegraded":"2023-10-14T12:18:48.501605+0000","last_fullsized":"2023-10-14T12:18:48.501605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:15.401442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499582+0000","last_change":"2023-10-14T12:18:47.505601+0000","last_active":"2023-10-14T12:18:48.499582+0000","last_peered":"2023-10-14T12:18:48.499582+0000","last_clean":"2023-10-14T12:18:48.499582+0000","last_became_active":"2023-10-14T12:18:47.505242+0000","last_became_peered":"2023-10-14T12:18:47.505242+0000","last_unstale":"2023-10-14T12:18:48.499582+0000","last_undegraded":"2023-10-14T12:18:48.499582+0000","last_fullsized":"2023-10-14T12:18:48.499582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514476+0000","last_change":"2023-10-14T12:18:47.506070+0000","last_active":"2023-10-14T12:18:47.514476+0000","last_peered":"2023-10-14T12:18:47.514476+0000","last_clean":"2023-10-14T12:18:47.514476+0000","last_became_active":"2023-10-14T12:18:47.505784+0000","last_became_peered":"2023-10-14T12:18:47.505784+0000","last_unstale":"2023-10-14T12:18:47.514476+0000","last_undegraded":"2023-10-14T12:18:47.514476+0000","last_fullsized":"2023-10-14T12:18:47.514476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:40.565801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525126+0000","last_change":"2023-10-14T12:18:46.489704+0000","last_active":"2023-10-14T12:18:47.525126+0000","last_peered":"2023-10-14T12:18:47.525126+0000","last_clean":"2023-10-14T12:18:47.525126+0000","last_became_active":"2023-10-14T12:18:46.489418+0000","last_became_peered":"2023-10-14T12:18:46.489418+0000","last_unstale":"2023-10-14T12:18:47.525126+0000","last_undegraded":"2023-10-14T12:18:47.525126+0000","last_fullsized":"2023-10-14T12:18:47.525126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500871+0000","last_change":"2023-10-14T12:18:47.506025+0000","last_active":"2023-10-14T12:18:48.500871+0000","last_peered":"2023-10-14T12:18:48.500871+0000","last_clean":"2023-10-14T12:18:48.500871+0000","last_became_active":"2023-10-14T12:18:47.505700+0000","last_became_peered":"2023-10-14T12:18:47.505700+0000","last_unstale":"2023-10-14T12:18:48.500871+0000","last_undegraded":"2023-10-14T12:18:48.500871+0000","last_fullsized":"2023-10-14T12:18:48.500871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500977+0000","last_change":"2023-10-14T12:18:46.486371+0000","last_active":"2023-10-14T12:18:48.500977+0000","last_peered":"2023-10-14T12:18:48.500977+0000","last_clean":"2023-10-14T12:18:48.500977+0000","last_became_active":"2023-10-14T12:18:46.486098+0000","last_became_peered":"2023-10-14T12:18:46.486098+0000","last_unstale":"2023-10-14T12:18:48.500977+0000","last_undegraded":"2023-10-14T12:18:48.500977+0000","last_fullsized":"2023-10-14T12:18:48.500977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.520511+0000","last_change":"2023-10-14T12:18:47.517540+0000","last_active":"2023-10-14T12:18:47.520511+0000","last_peered":"2023-10-14T12:18:47.520511+0000","last_clean":"2023-10-14T12:18:47.520511+0000","last_became_active":"2023-10-14T12:18:47.517283+0000","last_became_peered":"2023-10-14T12:18:47.517283+0000","last_unstale":"2023-10-14T12:18:47.520511+0000","last_undegraded":"2023-10-14T12:18:47.520511+0000","last_fullsized":"2023-10-14T12:18:47.520511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:00.146988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525133+0000","last_change":"2023-10-14T12:18:46.492599+0000","last_active":"2023-10-14T12:18:47.525133+0000","last_peered":"2023-10-14T12:18:47.525133+0000","last_clean":"2023-10-14T12:18:47.525133+0000","last_became_active":"2023-10-14T12:18:46.492296+0000","last_became_peered":"2023-10-14T12:18:46.492296+0000","last_unstale":"2023-10-14T12:18:47.525133+0000","last_undegraded":"2023-10-14T12:18:47.525133+0000","last_fullsized":"2023-10-14T12:18:47.525133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501088+0000","last_change":"2023-10-14T12:18:47.517351+0000","last_active":"2023-10-14T12:18:48.501088+0000","last_peered":"2023-10-14T12:18:48.501088+0000","last_clean":"2023-10-14T12:18:48.501088+0000","last_became_active":"2023-10-14T12:18:47.516208+0000","last_became_peered":"2023-10-14T12:18:47.516208+0000","last_unstale":"2023-10-14T12:18:48.501088+0000","last_undegraded":"2023-10-14T12:18:48.501088+0000","last_fullsized":"2023-10-14T12:18:48.501088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525264+0000","last_change":"2023-10-14T12:18:46.489437+0000","last_active":"2023-10-14T12:18:47.525264+0000","last_peered":"2023-10-14T12:18:47.525264+0000","last_clean":"2023-10-14T12:18:47.525264+0000","last_became_active":"2023-10-14T12:18:46.489122+0000","last_became_peered":"2023-10-14T12:18:46.489122+0000","last_unstale":"2023-10-14T12:18:47.525264+0000","last_undegraded":"2023-10-14T12:18:47.525264+0000","last_fullsized":"2023-10-14T12:18:47.525264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501421+0000","last_change":"2023-10-14T12:18:47.512921+0000","last_active":"2023-10-14T12:18:48.501421+0000","last_peered":"2023-10-14T12:18:48.501421+0000","last_clean":"2023-10-14T12:18:48.501421+0000","last_became_active":"2023-10-14T12:18:47.512426+0000","last_became_peered":"2023-10-14T12:18:47.512426+0000","last_unstale":"2023-10-14T12:18:48.501421+0000","last_undegraded":"2023-10-14T12:18:48.501421+0000","last_fullsized":"2023-10-14T12:18:48.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:30.575773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500674+0000","last_change":"2023-10-14T12:18:46.489840+0000","last_active":"2023-10-14T12:18:48.500674+0000","last_peered":"2023-10-14T12:18:48.500674+0000","last_clean":"2023-10-14T12:18:48.500674+0000","last_became_active":"2023-10-14T12:18:46.489548+0000","last_became_peered":"2023-10-14T12:18:46.489548+0000","last_unstale":"2023-10-14T12:18:48.500674+0000","last_undegraded":"2023-10-14T12:18:48.500674+0000","last_fullsized":"2023-10-14T12:18:48.500674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.768871+0000","last_change":"2023-10-14T12:18:47.505062+0000","last_active":"2023-10-14T12:18:49.768871+0000","last_peered":"2023-10-14T12:18:49.768871+0000","last_clean":"2023-10-14T12:18:49.768871+0000","last_became_active":"2023-10-14T12:18:47.504744+0000","last_became_peered":"2023-10-14T12:18:47.504744+0000","last_unstale":"2023-10-14T12:18:49.768871+0000","last_undegraded":"2023-10-14T12:18:49.768871+0000","last_fullsized":"2023-10-14T12:18:49.768871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444107+0000","last_change":"2023-10-14T12:18:46.495580+0000","last_active":"2023-10-14T12:18:49.444107+0000","last_peered":"2023-10-14T12:18:49.444107+0000","last_clean":"2023-10-14T12:18:49.444107+0000","last_became_active":"2023-10-14T12:18:46.495262+0000","last_became_peered":"2023-10-14T12:18:46.495262+0000","last_unstale":"2023-10-14T12:18:49.444107+0000","last_undegraded":"2023-10-14T12:18:49.444107+0000","last_fullsized":"2023-10-14T12:18:49.444107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.509932+0000","last_change":"2023-10-14T12:18:47.509133+0000","last_active":"2023-10-14T12:18:47.509932+0000","last_peered":"2023-10-14T12:18:47.509932+0000","last_clean":"2023-10-14T12:18:47.509932+0000","last_became_active":"2023-10-14T12:18:47.508824+0000","last_became_peered":"2023-10-14T12:18:47.508824+0000","last_unstale":"2023-10-14T12:18:47.509932+0000","last_undegraded":"2023-10-14T12:18:47.509932+0000","last_fullsized":"2023-10-14T12:18:47.509932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:26.807733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500305+0000","last_change":"2023-10-14T12:18:46.489498+0000","last_active":"2023-10-14T12:18:48.500305+0000","last_peered":"2023-10-14T12:18:48.500305+0000","last_clean":"2023-10-14T12:18:48.500305+0000","last_became_active":"2023-10-14T12:18:46.489134+0000","last_became_peered":"2023-10-14T12:18:46.489134+0000","last_unstale":"2023-10-14T12:18:48.500305+0000","last_undegraded":"2023-10-14T12:18:48.500305+0000","last_fullsized":"2023-10-14T12:18:48.500305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500304+0000","last_change":"2023-10-14T12:18:47.500917+0000","last_active":"2023-10-14T12:18:48.500304+0000","last_peered":"2023-10-14T12:18:48.500304+0000","last_clean":"2023-10-14T12:18:48.500304+0000","last_became_active":"2023-10-14T12:18:47.500513+0000","last_became_peered":"2023-10-14T12:18:47.500513+0000","last_unstale":"2023-10-14T12:18:48.500304+0000","last_undegraded":"2023-10-14T12:18:48.500304+0000","last_fullsized":"2023-10-14T12:18:48.500304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500764+0000","last_change":"2023-10-14T12:18:46.485701+0000","last_active":"2023-10-14T12:18:48.500764+0000","last_peered":"2023-10-14T12:18:48.500764+0000","last_clean":"2023-10-14T12:18:48.500764+0000","last_became_active":"2023-10-14T12:18:46.485368+0000","last_became_peered":"2023-10-14T12:18:46.485368+0000","last_unstale":"2023-10-14T12:18:48.500764+0000","last_undegraded":"2023-10-14T12:18:48.500764+0000","last_fullsized":"2023-10-14T12:18:48.500764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:19.585802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651760+0000","last_change":"2023-10-14T12:18:47.497548+0000","last_active":"2023-10-14T12:18:48.651760+0000","last_peered":"2023-10-14T12:18:48.651760+0000","last_clean":"2023-10-14T12:18:48.651760+0000","last_became_active":"2023-10-14T12:18:47.497227+0000","last_became_peered":"2023-10-14T12:18:47.497227+0000","last_unstale":"2023-10-14T12:18:48.651760+0000","last_undegraded":"2023-10-14T12:18:48.651760+0000","last_fullsized":"2023-10-14T12:18:48.651760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444253+0000","last_change":"2023-10-14T12:18:46.491993+0000","last_active":"2023-10-14T12:18:49.444253+0000","last_peered":"2023-10-14T12:18:49.444253+0000","last_clean":"2023-10-14T12:18:49.444253+0000","last_became_active":"2023-10-14T12:18:46.491478+0000","last_became_peered":"2023-10-14T12:18:46.491478+0000","last_unstale":"2023-10-14T12:18:49.444253+0000","last_undegraded":"2023-10-14T12:18:49.444253+0000","last_fullsized":"2023-10-14T12:18:49.444253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501636+0000","last_change":"2023-10-14T12:18:47.510673+0000","last_active":"2023-10-14T12:18:48.501636+0000","last_peered":"2023-10-14T12:18:48.501636+0000","last_clean":"2023-10-14T12:18:48.501636+0000","last_became_active":"2023-10-14T12:18:47.510382+0000","last_became_peered":"2023-10-14T12:18:47.510382+0000","last_unstale":"2023-10-14T12:18:48.501636+0000","last_undegraded":"2023-10-14T12:18:48.501636+0000","last_fullsized":"2023-10-14T12:18:48.501636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:47.215959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501549+0000","last_change":"2023-10-14T12:18:46.487677+0000","last_active":"2023-10-14T12:18:48.501549+0000","last_peered":"2023-10-14T12:18:48.501549+0000","last_clean":"2023-10-14T12:18:48.501549+0000","last_became_active":"2023-10-14T12:18:46.487359+0000","last_became_peered":"2023-10-14T12:18:46.487359+0000","last_unstale":"2023-10-14T12:18:48.501549+0000","last_undegraded":"2023-10-14T12:18:48.501549+0000","last_fullsized":"2023-10-14T12:18:48.501549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:50.124419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.522123+0000","last_change":"2023-10-14T12:18:47.521313+0000","last_active":"2023-10-14T12:18:47.522123+0000","last_peered":"2023-10-14T12:18:47.522123+0000","last_clean":"2023-10-14T12:18:47.522123+0000","last_became_active":"2023-10-14T12:18:47.521124+0000","last_became_peered":"2023-10-14T12:18:47.521124+0000","last_unstale":"2023-10-14T12:18:47.522123+0000","last_undegraded":"2023-10-14T12:18:47.522123+0000","last_fullsized":"2023-10-14T12:18:47.522123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:41.163623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651865+0000","last_change":"2023-10-14T12:18:46.488148+0000","last_active":"2023-10-14T12:18:48.651865+0000","last_peered":"2023-10-14T12:18:48.651865+0000","last_clean":"2023-10-14T12:18:48.651865+0000","last_became_active":"2023-10-14T12:18:46.487791+0000","last_became_peered":"2023-10-14T12:18:46.487791+0000","last_unstale":"2023-10-14T12:18:48.651865+0000","last_undegraded":"2023-10-14T12:18:48.651865+0000","last_fullsized":"2023-10-14T12:18:48.651865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:45.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769286+0000","last_change":"2023-10-14T12:18:47.512765+0000","last_active":"2023-10-14T12:18:49.769286+0000","last_peered":"2023-10-14T12:18:49.769286+0000","last_clean":"2023-10-14T12:18:49.769286+0000","last_became_active":"2023-10-14T12:18:47.512114+0000","last_became_peered":"2023-10-14T12:18:47.512114+0000","last_unstale":"2023-10-14T12:18:49.769286+0000","last_undegraded":"2023-10-14T12:18:49.769286+0000","last_fullsized":"2023-10-14T12:18:49.769286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444132+0000","last_change":"2023-10-14T12:18:46.493265+0000","last_active":"2023-10-14T12:18:49.444132+0000","last_peered":"2023-10-14T12:18:49.444132+0000","last_clean":"2023-10-14T12:18:49.444132+0000","last_became_active":"2023-10-14T12:18:46.493012+0000","last_became_peered":"2023-10-14T12:18:46.493012+0000","last_unstale":"2023-10-14T12:18:49.444132+0000","last_undegraded":"2023-10-14T12:18:49.444132+0000","last_fullsized":"2023-10-14T12:18:49.444132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514498+0000","last_change":"2023-10-14T12:18:47.510386+0000","last_active":"2023-10-14T12:18:47.514498+0000","last_peered":"2023-10-14T12:18:47.514498+0000","last_clean":"2023-10-14T12:18:47.514498+0000","last_became_active":"2023-10-14T12:18:47.510098+0000","last_became_peered":"2023-10-14T12:18:47.510098+0000","last_unstale":"2023-10-14T12:18:47.514498+0000","last_undegraded":"2023-10-14T12:18:47.514498+0000","last_fullsized":"2023-10-14T12:18:47.514498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:05.100753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525962+0000","last_change":"2023-10-14T12:18:46.490324+0000","last_active":"2023-10-14T12:18:47.525962+0000","last_peered":"2023-10-14T12:18:47.525962+0000","last_clean":"2023-10-14T12:18:47.525962+0000","last_became_active":"2023-10-14T12:18:46.489914+0000","last_became_peered":"2023-10-14T12:18:46.489914+0000","last_unstale":"2023-10-14T12:18:47.525962+0000","last_undegraded":"2023-10-14T12:18:47.525962+0000","last_fullsized":"2023-10-14T12:18:47.525962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.511663+0000","last_change":"2023-10-14T12:18:47.511080+0000","last_active":"2023-10-14T12:18:47.511663+0000","last_peered":"2023-10-14T12:18:47.511663+0000","last_clean":"2023-10-14T12:18:47.511663+0000","last_became_active":"2023-10-14T12:18:47.510729+0000","last_became_peered":"2023-10-14T12:18:47.510729+0000","last_unstale":"2023-10-14T12:18:47.511663+0000","last_undegraded":"2023-10-14T12:18:47.511663+0000","last_fullsized":"2023-10-14T12:18:47.511663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:03.106457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501219+0000","last_change":"2023-10-14T12:18:46.492854+0000","last_active":"2023-10-14T12:18:48.501219+0000","last_peered":"2023-10-14T12:18:48.501219+0000","last_clean":"2023-10-14T12:18:48.501219+0000","last_became_active":"2023-10-14T12:18:46.492536+0000","last_became_peered":"2023-10-14T12:18:46.492536+0000","last_unstale":"2023-10-14T12:18:48.501219+0000","last_undegraded":"2023-10-14T12:18:48.501219+0000","last_fullsized":"2023-10-14T12:18:48.501219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.520004+0000","last_change":"2023-10-14T12:18:47.513637+0000","last_active":"2023-10-14T12:18:47.520004+0000","last_peered":"2023-10-14T12:18:47.520004+0000","last_clean":"2023-10-14T12:18:47.520004+0000","last_became_active":"2023-10-14T12:18:47.513263+0000","last_became_peered":"2023-10-14T12:18:47.513263+0000","last_unstale":"2023-10-14T12:18:47.520004+0000","last_undegraded":"2023-10-14T12:18:47.520004+0000","last_fullsized":"2023-10-14T12:18:47.520004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443932+0000","last_change":"2023-10-14T12:18:46.495076+0000","last_active":"2023-10-14T12:18:49.443932+0000","last_peered":"2023-10-14T12:18:49.443932+0000","last_clean":"2023-10-14T12:18:49.443932+0000","last_became_active":"2023-10-14T12:18:46.494780+0000","last_became_peered":"2023-10-14T12:18:46.494780+0000","last_unstale":"2023-10-14T12:18:49.443932+0000","last_undegraded":"2023-10-14T12:18:49.443932+0000","last_fullsized":"2023-10-14T12:18:49.443932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444027+0000","last_change":"2023-10-14T12:18:47.506950+0000","last_active":"2023-10-14T12:18:49.444027+0000","last_peered":"2023-10-14T12:18:49.444027+0000","last_clean":"2023-10-14T12:18:49.444027+0000","last_became_active":"2023-10-14T12:18:47.506480+0000","last_became_peered":"2023-10-14T12:18:47.506480+0000","last_unstale":"2023-10-14T12:18:49.444027+0000","last_undegraded":"2023-10-14T12:18:49.444027+0000","last_fullsized":"2023-10-14T12:18:49.444027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499104+0000","last_change":"2023-10-14T12:18:46.486865+0000","last_active":"2023-10-14T12:18:48.499104+0000","last_peered":"2023-10-14T12:18:48.499104+0000","last_clean":"2023-10-14T12:18:48.499104+0000","last_became_active":"2023-10-14T12:18:46.486537+0000","last_became_peered":"2023-10-14T12:18:46.486537+0000","last_unstale":"2023-10-14T12:18:48.499104+0000","last_undegraded":"2023-10-14T12:18:48.499104+0000","last_fullsized":"2023-10-14T12:18:48.499104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:59.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514136+0000","last_change":"2023-10-14T12:18:47.511494+0000","last_active":"2023-10-14T12:18:47.514136+0000","last_peered":"2023-10-14T12:18:47.514136+0000","last_clean":"2023-10-14T12:18:47.514136+0000","last_became_active":"2023-10-14T12:18:47.511109+0000","last_became_peered":"2023-10-14T12:18:47.511109+0000","last_unstale":"2023-10-14T12:18:47.514136+0000","last_undegraded":"2023-10-14T12:18:47.514136+0000","last_fullsized":"2023-10-14T12:18:47.514136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769115+0000","last_change":"2023-10-14T12:18:46.488089+0000","last_active":"2023-10-14T12:18:49.769115+0000","last_peered":"2023-10-14T12:18:49.769115+0000","last_clean":"2023-10-14T12:18:49.769115+0000","last_became_active":"2023-10-14T12:18:46.487778+0000","last_became_peered":"2023-10-14T12:18:46.487778+0000","last_unstale":"2023-10-14T12:18:49.769115+0000","last_undegraded":"2023-10-14T12:18:49.769115+0000","last_fullsized":"2023-10-14T12:18:49.769115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:51:57.421458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514526+0000","last_change":"2023-10-14T12:18:47.508911+0000","last_active":"2023-10-14T12:18:47.514526+0000","last_peered":"2023-10-14T12:18:47.514526+0000","last_clean":"2023-10-14T12:18:47.514526+0000","last_became_active":"2023-10-14T12:18:47.508621+0000","last_became_peered":"2023-10-14T12:18:47.508621+0000","last_unstale":"2023-10-14T12:18:47.514526+0000","last_undegraded":"2023-10-14T12:18:47.514526+0000","last_fullsized":"2023-10-14T12:18:47.514526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651805+0000","last_change":"2023-10-14T12:18:46.488275+0000","last_active":"2023-10-14T12:18:48.651805+0000","last_peered":"2023-10-14T12:18:48.651805+0000","last_clean":"2023-10-14T12:18:48.651805+0000","last_became_active":"2023-10-14T12:18:46.487981+0000","last_became_peered":"2023-10-14T12:18:46.487981+0000","last_unstale":"2023-10-14T12:18:48.651805+0000","last_undegraded":"2023-10-14T12:18:48.651805+0000","last_fullsized":"2023-10-14T12:18:48.651805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501360+0000","last_change":"2023-10-14T12:18:47.512865+0000","last_active":"2023-10-14T12:18:48.501360+0000","last_peered":"2023-10-14T12:18:48.501360+0000","last_clean":"2023-10-14T12:18:48.501360+0000","last_became_active":"2023-10-14T12:18:47.512117+0000","last_became_peered":"2023-10-14T12:18:47.512117+0000","last_unstale":"2023-10-14T12:18:48.501360+0000","last_undegraded":"2023-10-14T12:18:48.501360+0000","last_fullsized":"2023-10-14T12:18:48.501360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:20.704090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501126+0000","last_change":"2023-10-14T12:18:46.488158+0000","last_active":"2023-10-14T12:18:48.501126+0000","last_peered":"2023-10-14T12:18:48.501126+0000","last_clean":"2023-10-14T12:18:48.501126+0000","last_became_active":"2023-10-14T12:18:46.487808+0000","last_became_peered":"2023-10-14T12:18:46.487808+0000","last_unstale":"2023-10-14T12:18:48.501126+0000","last_undegraded":"2023-10-14T12:18:48.501126+0000","last_fullsized":"2023-10-14T12:18:48.501126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769274+0000","last_change":"2023-10-14T12:18:47.506873+0000","last_active":"2023-10-14T12:18:49.769274+0000","last_peered":"2023-10-14T12:18:49.769274+0000","last_clean":"2023-10-14T12:18:49.769274+0000","last_became_active":"2023-10-14T12:18:47.506563+0000","last_became_peered":"2023-10-14T12:18:47.506563+0000","last_unstale":"2023-10-14T12:18:49.769274+0000","last_undegraded":"2023-10-14T12:18:49.769274+0000","last_fullsized":"2023-10-14T12:18:49.769274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651592+0000","last_change":"2023-10-14T12:18:47.494275+0000","last_active":"2023-10-14T12:18:48.651592+0000","last_peered":"2023-10-14T12:18:48.651592+0000","last_clean":"2023-10-14T12:18:48.651592+0000","last_became_active":"2023-10-14T12:18:47.493948+0000","last_became_peered":"2023-10-14T12:18:47.493948+0000","last_unstale":"2023-10-14T12:18:48.651592+0000","last_undegraded":"2023-10-14T12:18:48.651592+0000","last_fullsized":"2023-10-14T12:18:48.651592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499214+0000","last_change":"2023-10-14T12:18:46.485430+0000","last_active":"2023-10-14T12:18:48.499214+0000","last_peered":"2023-10-14T12:18:48.499214+0000","last_clean":"2023-10-14T12:18:48.499214+0000","last_became_active":"2023-10-14T12:18:46.485097+0000","last_became_peered":"2023-10-14T12:18:46.485097+0000","last_unstale":"2023-10-14T12:18:48.499214+0000","last_undegraded":"2023-10-14T12:18:48.499214+0000","last_fullsized":"2023-10-14T12:18:48.499214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:35.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500519+0000","last_change":"2023-10-14T12:18:47.520808+0000","last_active":"2023-10-14T12:18:48.500519+0000","last_peered":"2023-10-14T12:18:48.500519+0000","last_clean":"2023-10-14T12:18:48.500519+0000","last_became_active":"2023-10-14T12:18:47.520421+0000","last_became_peered":"2023-10-14T12:18:47.520421+0000","last_unstale":"2023-10-14T12:18:48.500519+0000","last_undegraded":"2023-10-14T12:18:48.500519+0000","last_fullsized":"2023-10-14T12:18:48.500519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500975+0000","last_change":"2023-10-14T12:18:46.487688+0000","last_active":"2023-10-14T12:18:48.500975+0000","last_peered":"2023-10-14T12:18:48.500975+0000","last_clean":"2023-10-14T12:18:48.500975+0000","last_became_active":"2023-10-14T12:18:46.487378+0000","last_became_peered":"2023-10-14T12:18:46.487378+0000","last_unstale":"2023-10-14T12:18:48.500975+0000","last_undegraded":"2023-10-14T12:18:48.500975+0000","last_fullsized":"2023-10-14T12:18:48.500975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T12:18:46.481801+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:18:46.481801+0000","last_peered":"2023-10-14T12:18:46.481801+0000","last_clean":"2023-10-14T12:18:46.481801+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:18:46.481801+0000","last_undegraded":"2023-10-14T12:18:46.481801+0000","last_fullsized":"2023-10-14T12:18:46.481801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.509776+0000","last_change":"2023-10-14T12:18:47.508543+0000","last_active":"2023-10-14T12:18:47.509776+0000","last_peered":"2023-10-14T12:18:47.509776+0000","last_clean":"2023-10-14T12:18:47.509776+0000","last_became_active":"2023-10-14T12:18:47.508263+0000","last_became_peered":"2023-10-14T12:18:47.508263+0000","last_unstale":"2023-10-14T12:18:47.509776+0000","last_undegraded":"2023-10-14T12:18:47.509776+0000","last_fullsized":"2023-10-14T12:18:47.509776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:09.878545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.494883+0000","last_change":"2023-10-14T12:18:46.489896+0000","last_active":"2023-10-14T12:18:47.494883+0000","last_peered":"2023-10-14T12:18:47.494883+0000","last_clean":"2023-10-14T12:18:47.494883+0000","last_became_active":"2023-10-14T12:18:46.489571+0000","last_became_peered":"2023-10-14T12:18:46.489571+0000","last_unstale":"2023-10-14T12:18:47.494883+0000","last_undegraded":"2023-10-14T12:18:47.494883+0000","last_fullsized":"2023-10-14T12:18:47.494883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.503884+0000","last_change":"2023-10-14T12:18:46.490891+0000","last_active":"2023-10-14T12:18:47.503884+0000","last_peered":"2023-10-14T12:18:47.503884+0000","last_clean":"2023-10-14T12:18:47.503884+0000","last_became_active":"2023-10-14T12:18:46.490638+0000","last_became_peered":"2023-10-14T12:18:46.490638+0000","last_unstale":"2023-10-14T12:18:47.503884+0000","last_undegraded":"2023-10-14T12:18:47.503884+0000","last_fullsized":"2023-10-14T12:18:47.503884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651814+0000","last_change":"2023-10-14T12:18:47.494381+0000","last_active":"2023-10-14T12:18:48.651814+0000","last_peered":"2023-10-14T12:18:48.651814+0000","last_clean":"2023-10-14T12:18:48.651814+0000","last_became_active":"2023-10-14T12:18:47.493740+0000","last_became_peered":"2023-10-14T12:18:47.493740+0000","last_unstale":"2023-10-14T12:18:48.651814+0000","last_undegraded":"2023-10-14T12:18:48.651814+0000","last_fullsized":"2023-10-14T12:18:48.651814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651788+0000","last_change":"2023-10-14T12:18:46.492626+0000","last_active":"2023-10-14T12:18:48.651788+0000","last_peered":"2023-10-14T12:18:48.651788+0000","last_clean":"2023-10-14T12:18:48.651788+0000","last_became_active":"2023-10-14T12:18:46.492238+0000","last_became_peered":"2023-10-14T12:18:46.492238+0000","last_unstale":"2023-10-14T12:18:48.651788+0000","last_undegraded":"2023-10-14T12:18:48.651788+0000","last_fullsized":"2023-10-14T12:18:48.651788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500978+0000","last_change":"2023-10-14T12:18:47.505508+0000","last_active":"2023-10-14T12:18:48.500978+0000","last_peered":"2023-10-14T12:18:48.500978+0000","last_clean":"2023-10-14T12:18:48.500978+0000","last_became_active":"2023-10-14T12:18:47.505204+0000","last_became_peered":"2023-10-14T12:18:47.505204+0000","last_unstale":"2023-10-14T12:18:48.500978+0000","last_undegraded":"2023-10-14T12:18:48.500978+0000","last_fullsized":"2023-10-14T12:18:48.500978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444144+0000","last_change":"2023-10-14T12:18:46.489860+0000","last_active":"2023-10-14T12:18:49.444144+0000","last_peered":"2023-10-14T12:18:49.444144+0000","last_clean":"2023-10-14T12:18:49.444144+0000","last_became_active":"2023-10-14T12:18:46.489554+0000","last_became_peered":"2023-10-14T12:18:46.489554+0000","last_unstale":"2023-10-14T12:18:49.444144+0000","last_undegraded":"2023-10-14T12:18:49.444144+0000","last_fullsized":"2023-10-14T12:18:49.444144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.506118+0000","last_change":"2023-10-14T12:18:47.501705+0000","last_active":"2023-10-14T12:18:47.506118+0000","last_peered":"2023-10-14T12:18:47.506118+0000","last_clean":"2023-10-14T12:18:47.506118+0000","last_became_active":"2023-10-14T12:18:47.499259+0000","last_became_peered":"2023-10-14T12:18:47.499259+0000","last_unstale":"2023-10-14T12:18:47.506118+0000","last_undegraded":"2023-10-14T12:18:47.506118+0000","last_fullsized":"2023-10-14T12:18:47.506118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:36.231154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.494521+0000","last_change":"2023-10-14T12:18:46.489770+0000","last_active":"2023-10-14T12:18:47.494521+0000","last_peered":"2023-10-14T12:18:47.494521+0000","last_clean":"2023-10-14T12:18:47.494521+0000","last_became_active":"2023-10-14T12:18:46.489289+0000","last_became_peered":"2023-10-14T12:18:46.489289+0000","last_unstale":"2023-10-14T12:18:47.494521+0000","last_undegraded":"2023-10-14T12:18:47.494521+0000","last_fullsized":"2023-10-14T12:18:47.494521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769054+0000","last_change":"2023-10-14T12:18:47.506908+0000","last_active":"2023-10-14T12:18:49.769054+0000","last_peered":"2023-10-14T12:18:49.769054+0000","last_clean":"2023-10-14T12:18:49.769054+0000","last_became_active":"2023-10-14T12:18:47.506651+0000","last_became_peered":"2023-10-14T12:18:47.506651+0000","last_unstale":"2023-10-14T12:18:49.769054+0000","last_undegraded":"2023-10-14T12:18:49.769054+0000","last_fullsized":"2023-10-14T12:18:49.769054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651573+0000","last_change":"2023-10-14T12:18:46.491315+0000","last_active":"2023-10-14T12:18:48.651573+0000","last_peered":"2023-10-14T12:18:48.651573+0000","last_clean":"2023-10-14T12:18:48.651573+0000","last_became_active":"2023-10-14T12:18:46.490992+0000","last_became_peered":"2023-10-14T12:18:46.490992+0000","last_unstale":"2023-10-14T12:18:48.651573+0000","last_undegraded":"2023-10-14T12:18:48.651573+0000","last_fullsized":"2023-10-14T12:18:48.651573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:39.561079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.496045+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.495676+0000","last_became_peered":"2023-10-14T12:18:47.495676+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651651+0000","last_change":"2023-10-14T12:18:46.493273+0000","last_active":"2023-10-14T12:18:48.651651+0000","last_peered":"2023-10-14T12:18:48.651651+0000","last_clean":"2023-10-14T12:18:48.651651+0000","last_became_active":"2023-10-14T12:18:46.492945+0000","last_became_peered":"2023-10-14T12:18:46.492945+0000","last_unstale":"2023-10-14T12:18:48.651651+0000","last_undegraded":"2023-10-14T12:18:48.651651+0000","last_fullsized":"2023-10-14T12:18:48.651651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500822+0000","last_change":"2023-10-14T12:18:47.504495+0000","last_active":"2023-10-14T12:18:48.500822+0000","last_peered":"2023-10-14T12:18:48.500822+0000","last_clean":"2023-10-14T12:18:48.500822+0000","last_became_active":"2023-10-14T12:18:47.504117+0000","last_became_peered":"2023-10-14T12:18:47.504117+0000","last_unstale":"2023-10-14T12:18:48.500822+0000","last_undegraded":"2023-10-14T12:18:48.500822+0000","last_fullsized":"2023-10-14T12:18:48.500822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525717+0000","last_change":"2023-10-14T12:18:46.489933+0000","last_active":"2023-10-14T12:18:47.525717+0000","last_peered":"2023-10-14T12:18:47.525717+0000","last_clean":"2023-10-14T12:18:47.525717+0000","last_became_active":"2023-10-14T12:18:46.489656+0000","last_became_peered":"2023-10-14T12:18:46.489656+0000","last_unstale":"2023-10-14T12:18:47.525717+0000","last_undegraded":"2023-10-14T12:18:47.525717+0000","last_fullsized":"2023-10-14T12:18:47.525717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444202+0000","last_change":"2023-10-14T12:18:47.510691+0000","last_active":"2023-10-14T12:18:49.444202+0000","last_peered":"2023-10-14T12:18:49.444202+0000","last_clean":"2023-10-14T12:18:49.444202+0000","last_became_active":"2023-10-14T12:18:47.510404+0000","last_became_peered":"2023-10-14T12:18:47.510404+0000","last_unstale":"2023-10-14T12:18:49.444202+0000","last_undegraded":"2023-10-14T12:18:49.444202+0000","last_fullsized":"2023-10-14T12:18:49.444202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499536+0000","last_change":"2023-10-14T12:18:46.480875+0000","last_active":"2023-10-14T12:18:48.499536+0000","last_peered":"2023-10-14T12:18:48.499536+0000","last_clean":"2023-10-14T12:18:48.499536+0000","last_became_active":"2023-10-14T12:18:46.480351+0000","last_became_peered":"2023-10-14T12:18:46.480351+0000","last_unstale":"2023-10-14T12:18:48.499536+0000","last_undegraded":"2023-10-14T12:18:48.499536+0000","last_fullsized":"2023-10-14T12:18:48.499536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.518819+0000","last_change":"2023-10-14T12:18:47.513547+0000","last_active":"2023-10-14T12:18:47.518819+0000","last_peered":"2023-10-14T12:18:47.518819+0000","last_clean":"2023-10-14T12:18:47.518819+0000","last_became_active":"2023-10-14T12:18:47.513269+0000","last_became_peered":"2023-10-14T12:18:47.513269+0000","last_unstale":"2023-10-14T12:18:47.518819+0000","last_undegraded":"2023-10-14T12:18:47.518819+0000","last_fullsized":"2023-10-14T12:18:47.518819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651762+0000","last_change":"2023-10-14T12:18:46.489993+0000","last_active":"2023-10-14T12:18:48.651762+0000","last_peered":"2023-10-14T12:18:48.651762+0000","last_clean":"2023-10-14T12:18:48.651762+0000","last_became_active":"2023-10-14T12:18:46.489684+0000","last_became_peered":"2023-10-14T12:18:46.489684+0000","last_unstale":"2023-10-14T12:18:48.651762+0000","last_undegraded":"2023-10-14T12:18:48.651762+0000","last_fullsized":"2023-10-14T12:18:48.651762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501154+0000","last_change":"2023-10-14T12:18:47.503531+0000","last_active":"2023-10-14T12:18:48.501154+0000","last_peered":"2023-10-14T12:18:48.501154+0000","last_clean":"2023-10-14T12:18:48.501154+0000","last_became_active":"2023-10-14T12:18:47.503243+0000","last_became_peered":"2023-10-14T12:18:47.503243+0000","last_unstale":"2023-10-14T12:18:48.501154+0000","last_undegraded":"2023-10-14T12:18:48.501154+0000","last_fullsized":"2023-10-14T12:18:48.501154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:18.615845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499451+0000","last_change":"2023-10-14T12:18:46.488590+0000","last_active":"2023-10-14T12:18:48.499451+0000","last_peered":"2023-10-14T12:18:48.499451+0000","last_clean":"2023-10-14T12:18:48.499451+0000","last_became_active":"2023-10-14T12:18:46.487442+0000","last_became_peered":"2023-10-14T12:18:46.487442+0000","last_unstale":"2023-10-14T12:18:48.499451+0000","last_undegraded":"2023-10-14T12:18:48.499451+0000","last_fullsized":"2023-10-14T12:18:48.499451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514049+0000","last_change":"2023-10-14T12:18:47.510800+0000","last_active":"2023-10-14T12:18:47.514049+0000","last_peered":"2023-10-14T12:18:47.514049+0000","last_clean":"2023-10-14T12:18:47.514049+0000","last_became_active":"2023-10-14T12:18:47.510526+0000","last_became_peered":"2023-10-14T12:18:47.510526+0000","last_unstale":"2023-10-14T12:18:47.514049+0000","last_undegraded":"2023-10-14T12:18:47.514049+0000","last_fullsized":"2023-10-14T12:18:47.514049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443979+0000","last_change":"2023-10-14T12:18:47.506751+0000","last_active":"2023-10-14T12:18:49.443979+0000","last_peered":"2023-10-14T12:18:49.443979+0000","last_clean":"2023-10-14T12:18:49.443979+0000","last_became_active":"2023-10-14T12:18:47.506062+0000","last_became_peered":"2023-10-14T12:18:47.506062+0000","last_unstale":"2023-10-14T12:18:49.443979+0000","last_undegraded":"2023-10-14T12:18:49.443979+0000","last_fullsized":"2023-10-14T12:18:49.443979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499359+0000","last_change":"2023-10-14T12:18:47.512676+0000","last_active":"2023-10-14T12:18:48.499359+0000","last_peered":"2023-10-14T12:18:48.499359+0000","last_clean":"2023-10-14T12:18:48.499359+0000","last_became_active":"2023-10-14T12:18:47.512314+0000","last_became_peered":"2023-10-14T12:18:47.512314+0000","last_unstale":"2023-10-14T12:18:48.499359+0000","last_undegraded":"2023-10-14T12:18:48.499359+0000","last_fullsized":"2023-10-14T12:18:48.499359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501459+0000","last_change":"2023-10-14T12:18:47.517326+0000","last_active":"2023-10-14T12:18:48.501459+0000","last_peered":"2023-10-14T12:18:48.501459+0000","last_clean":"2023-10-14T12:18:48.501459+0000","last_became_active":"2023-10-14T12:18:47.512255+0000","last_became_peered":"2023-10-14T12:18:47.512255+0000","last_unstale":"2023-10-14T12:18:48.501459+0000","last_undegraded":"2023-10-14T12:18:48.501459+0000","last_fullsized":"2023-10-14T12:18:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:10.981380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.506028+0000","last_change":"2023-10-14T12:18:47.501741+0000","last_active":"2023-10-14T12:18:47.506028+0000","last_peered":"2023-10-14T12:18:47.506028+0000","last_clean":"2023-10-14T12:18:47.506028+0000","last_became_active":"2023-10-14T12:18:47.501392+0000","last_became_peered":"2023-10-14T12:18:47.501392+0000","last_unstale":"2023-10-14T12:18:47.506028+0000","last_undegraded":"2023-10-14T12:18:47.506028+0000","last_fullsized":"2023-10-14T12:18:47.506028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500920+0000","last_change":"2023-10-14T12:18:47.510665+0000","last_active":"2023-10-14T12:18:48.500920+0000","last_peered":"2023-10-14T12:18:48.500920+0000","last_clean":"2023-10-14T12:18:48.500920+0000","last_became_active":"2023-10-14T12:18:47.510347+0000","last_became_peered":"2023-10-14T12:18:47.510347+0000","last_unstale":"2023-10-14T12:18:48.500920+0000","last_undegraded":"2023-10-14T12:18:48.500920+0000","last_fullsized":"2023-10-14T12:18:48.500920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651786+0000","last_change":"2023-10-14T12:18:47.497457+0000","last_active":"2023-10-14T12:18:48.651786+0000","last_peered":"2023-10-14T12:18:48.651786+0000","last_clean":"2023-10-14T12:18:48.651786+0000","last_became_active":"2023-10-14T12:18:47.497154+0000","last_became_peered":"2023-10-14T12:18:47.497154+0000","last_unstale":"2023-10-14T12:18:48.651786+0000","last_undegraded":"2023-10-14T12:18:48.651786+0000","last_fullsized":"2023-10-14T12:18:48.651786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444383+0000","last_change":"2023-10-14T12:18:47.509170+0000","last_active":"2023-10-14T12:18:49.444383+0000","last_peered":"2023-10-14T12:18:49.444383+0000","last_clean":"2023-10-14T12:18:49.444383+0000","last_became_active":"2023-10-14T12:18:47.508882+0000","last_became_peered":"2023-10-14T12:18:47.508882+0000","last_unstale":"2023-10-14T12:18:49.444383+0000","last_undegraded":"2023-10-14T12:18:49.444383+0000","last_fullsized":"2023-10-14T12:18:49.444383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500863+0000","last_change":"2023-10-14T12:18:47.505965+0000","last_active":"2023-10-14T12:18:48.500863+0000","last_peered":"2023-10-14T12:18:48.500863+0000","last_clean":"2023-10-14T12:18:48.500863+0000","last_became_active":"2023-10-14T12:18:47.505663+0000","last_became_peered":"2023-10-14T12:18:47.505663+0000","last_unstale":"2023-10-14T12:18:48.500863+0000","last_undegraded":"2023-10-14T12:18:48.500863+0000","last_fullsized":"2023-10-14T12:18:48.500863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500816+0000","last_change":"2023-10-14T12:18:47.503352+0000","last_active":"2023-10-14T12:18:48.500816+0000","last_peered":"2023-10-14T12:18:48.500816+0000","last_clean":"2023-10-14T12:18:48.500816+0000","last_became_active":"2023-10-14T12:18:47.502998+0000","last_became_peered":"2023-10-14T12:18:47.502998+0000","last_unstale":"2023-10-14T12:18:48.500816+0000","last_undegraded":"2023-10-14T12:18:48.500816+0000","last_fullsized":"2023-10-14T12:18:48.500816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.509290+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.508938+0000","last_became_peered":"2023-10-14T12:18:47.508938+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501012+0000","last_change":"2023-10-14T12:18:47.517756+0000","last_active":"2023-10-14T12:18:48.501012+0000","last_peered":"2023-10-14T12:18:48.501012+0000","last_clean":"2023-10-14T12:18:48.501012+0000","last_became_active":"2023-10-14T12:18:47.516277+0000","last_became_peered":"2023-10-14T12:18:47.516277+0000","last_unstale":"2023-10-14T12:18:48.501012+0000","last_undegraded":"2023-10-14T12:18:48.501012+0000","last_fullsized":"2023-10-14T12:18:48.501012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.519819+0000","last_change":"2023-10-14T12:18:47.518451+0000","last_active":"2023-10-14T12:18:47.519819+0000","last_peered":"2023-10-14T12:18:47.519819+0000","last_clean":"2023-10-14T12:18:47.519819+0000","last_became_active":"2023-10-14T12:18:47.518127+0000","last_became_peered":"2023-10-14T12:18:47.518127+0000","last_unstale":"2023-10-14T12:18:47.519819+0000","last_undegraded":"2023-10-14T12:18:47.519819+0000","last_fullsized":"2023-10-14T12:18:47.519819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444296+0000","last_change":"2023-10-14T12:18:47.510708+0000","last_active":"2023-10-14T12:18:49.444296+0000","last_peered":"2023-10-14T12:18:49.444296+0000","last_clean":"2023-10-14T12:18:49.444296+0000","last_became_active":"2023-10-14T12:18:47.510385+0000","last_became_peered":"2023-10-14T12:18:47.510385+0000","last_unstale":"2023-10-14T12:18:49.444296+0000","last_undegraded":"2023-10-14T12:18:49.444296+0000","last_fullsized":"2023-10-14T12:18:49.444296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:18:51.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:18:51.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.798+0000 7ff3e28f0700 1 Processor -- start 2023-10-14T12:18:51.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.798+0000 7ff3e28f0700 1 -- start start 2023-10-14T12:18:51.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3e28f0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3dc15eab0 0x7ff3dc0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3e28f0700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc0d2170 con 0x7ff3dc0d1d90 2023-10-14T12:18:51.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3e28f0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc15ee90 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3e28f0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0cfb60 con 0x7ff3dc15eab0 2023-10-14T12:18:51.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3dbfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3dc15eab0 0x7ff3dc0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3e0e8d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff3dc0d1d90 0x7ff3dc0cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55052/0 (socket says 172.21.15.32:55052) 2023-10-14T12:18:51.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3e0e8d700 1 -- 172.21.15.32:0/2569744167 learned_addr learned my addr 172.21.15.32:0/2569744167 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:51.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3dbfff700 1 -- 172.21.15.32:0/2569744167 >> v1:172.21.15.92:6789/0 conn(0x7ff3dc0cf6d0 legacy=0x7ff3dc0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3dbfff700 1 -- 172.21.15.32:0/2569744167 >> v1:172.21.15.32:6789/0 conn(0x7ff3dc0d1d90 legacy=0x7ff3dc0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3dbfff700 1 -- 172.21.15.32:0/2569744167 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc158370 con 0x7ff3dc15eab0 2023-10-14T12:18:51.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.799+0000 7ff3daffd700 1 -- 172.21.15.32:0/2569744167 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479805535 0 0) 0x7ff3d4001490 con 0x7ff3dc0d1d90 2023-10-14T12:18:51.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3dbfff700 1 --2- 172.21.15.32:0/2569744167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc15eab0 0x7ff3dc0cf190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009840 tx=0x7ff3c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ddff8921f26370 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3daffd700 1 -- 172.21.15.32:0/2569744167 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4011830 con 0x7ff3dc15eab0 2023-10-14T12:18:51.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3daffd700 1 -- 172.21.15.32:0/2569744167 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c4011990 con 0x7ff3dc15eab0 2023-10-14T12:18:51.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3daffd700 1 -- 172.21.15.32:0/2569744167 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4011d20 con 0x7ff3dc15eab0 2023-10-14T12:18:51.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 -- 172.21.15.32:0/2569744167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc15eab0 msgr2=0x7ff3dc0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/2569744167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc15eab0 0x7ff3dc0cf190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009840 tx=0x7ff3c4009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:51.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 -- 172.21.15.32:0/2569744167 shutdown_connections 2023-10-14T12:18:51.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/2569744167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc15eab0 0x7ff3dc0cf190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 -- 172.21.15.32:0/2569744167 >> 172.21.15.32:0/2569744167 conn(0x7ff3dc0665a0 msgr2=0x7ff3dc066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:51.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 -- 172.21.15.32:0/2569744167 shutdown_connections 2023-10-14T12:18:51.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.800+0000 7ff3e28f0700 1 -- 172.21.15.32:0/2569744167 wait complete. 2023-10-14T12:18:51.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.802+0000 7ff3e28f0700 1 Processor -- start 2023-10-14T12:18:51.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.802+0000 7ff3e28f0700 1 -- start start 2023-10-14T12:18:51.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e28f0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 0x7ff3dc1e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e28f0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3dc0d1d90 0x7ff3dc156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e28f0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3dc15eab0 0x7ff3dc157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e28f0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc1e8ec0 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e28f0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc161000 con 0x7ff3dc0d1d90 2023-10-14T12:18:51.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e28f0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc1e9160 con 0x7ff3dc15eab0 2023-10-14T12:18:51.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 0x7ff3dc1e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 0x7ff3dc1e9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38030/0 (socket says 172.21.15.32:38030) 2023-10-14T12:18:51.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 -- 172.21.15.32:0/1522112897 learned_addr learned my addr 172.21.15.32:0/1522112897 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:51.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3e0e8d700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3dc15eab0 0x7ff3dc157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3db7fe700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3dc0d1d90 0x7ff3dc156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 -- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3dc15eab0 msgr2=0x7ff3dc157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3dc15eab0 0x7ff3dc157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 -- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3dc0d1d90 msgr2=0x7ff3dc156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:51.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3dc0d1d90 0x7ff3dc156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:51.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.803+0000 7ff3dbfff700 1 -- 172.21.15.32:0/1522112897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40094a0 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.804+0000 7ff3dbfff700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 0x7ff3dc1e9960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40090b0 tx=0x7ff3c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.804+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c401a900 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.804+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c401aa60 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.804+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc1e9440 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.804+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c401add0 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.804+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc157080 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.805+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc0b7540 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.805+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3c4022070 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.806+0000 7ff3d8ff9700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3bc06af00 0x7ff3bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:51.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.806+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3c408a7f0 con 0x7ff3dc0cf6d0 2023-10-14T12:18:51.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.806+0000 7ff3db7fe700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3bc06af00 0x7ff3bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:51.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.806+0000 7ff3db7fe700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3bc06af00 0x7ff3bc06d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0b7140 tx=0x7ff3cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:51.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:51.810+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3c40559e0 con 0x7ff3dc0cf6d0 2023-10-14T12:18:52.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.005+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3dc0cda20 con 0x7ff3bc06af00 2023-10-14T12:18:52.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.013+0000 7ff3d8ff9700 1 -- 172.21.15.32:0/1522112897 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264590 (secure 0 0 0) 0x7ff3cc0013f0 con 0x7ff3bc06af00 2023-10-14T12:18:52.018 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:52.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3bc06af00 msgr2=0x7ff3bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3bc06af00 0x7ff3bc06d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0b7140 tx=0x7ff3cc009040 comp rx=0 tx=0).stop 2023-10-14T12:18:52.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 msgr2=0x7ff3dc1e9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 0x7ff3dc1e9960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40090b0 tx=0x7ff3c4004750 comp rx=0 tx=0).stop 2023-10-14T12:18:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 shutdown_connections 2023-10-14T12:18:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3dc15eab0 0x7ff3dc157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3dc0cf6d0 0x7ff3dc1e9960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3bc06af00 0x7ff3bc06d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 --2- 172.21.15.32:0/1522112897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3dc0d1d90 0x7ff3dc156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.015+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 >> 172.21.15.32:0/1522112897 conn(0x7ff3dc0665a0 msgr2=0x7ff3dc0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.016+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 shutdown_connections 2023-10-14T12:18:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.016+0000 7ff3e28f0700 1 -- 172.21.15.32:0/1522112897 wait complete. 2023-10-14T12:18:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:18:52.030 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T12:18:51.097305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2953216,"data_stored":1771208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.629403"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514013+0000","last_change":"2023-10-14T12:18:47.509049+0000","last_active":"2023-10-14T12:18:47.514013+0000","last_peered":"2023-10-14T12:18:47.514013+0000","last_clean":"2023-10-14T12:18:47.514013+0000","last_became_active":"2023-10-14T12:18:47.508659+0000","last_became_peered":"2023-10-14T12:18:47.508659+0000","last_unstale":"2023-10-14T12:18:47.514013+0000","last_undegraded":"2023-10-14T12:18:47.514013+0000","last_fullsized":"2023-10-14T12:18:47.514013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651885+0000","last_change":"2023-10-14T12:18:47.500830+0000","last_active":"2023-10-14T12:18:48.651885+0000","last_peered":"2023-10-14T12:18:48.651885+0000","last_clean":"2023-10-14T12:18:48.651885+0000","last_became_active":"2023-10-14T12:18:47.500534+0000","last_became_peered":"2023-10-14T12:18:47.500534+0000","last_unstale":"2023-10-14T12:18:48.651885+0000","last_undegraded":"2023-10-14T12:18:48.651885+0000","last_fullsized":"2023-10-14T12:18:48.651885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.505913+0000","last_change":"2023-10-14T12:18:47.502596+0000","last_active":"2023-10-14T12:18:47.505913+0000","last_peered":"2023-10-14T12:18:47.505913+0000","last_clean":"2023-10-14T12:18:47.505913+0000","last_became_active":"2023-10-14T12:18:47.502274+0000","last_became_peered":"2023-10-14T12:18:47.502274+0000","last_unstale":"2023-10-14T12:18:47.505913+0000","last_undegraded":"2023-10-14T12:18:47.505913+0000","last_fullsized":"2023-10-14T12:18:47.505913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501296+0000","last_change":"2023-10-14T12:18:47.517714+0000","last_active":"2023-10-14T12:18:48.501296+0000","last_peered":"2023-10-14T12:18:48.501296+0000","last_clean":"2023-10-14T12:18:48.501296+0000","last_became_active":"2023-10-14T12:18:47.512963+0000","last_became_peered":"2023-10-14T12:18:47.512963+0000","last_unstale":"2023-10-14T12:18:48.501296+0000","last_undegraded":"2023-10-14T12:18:48.501296+0000","last_fullsized":"2023-10-14T12:18:48.501296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:47.569087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.513079+0000","last_change":"2023-10-14T12:18:47.505586+0000","last_active":"2023-10-14T12:18:47.513079+0000","last_peered":"2023-10-14T12:18:47.513079+0000","last_clean":"2023-10-14T12:18:47.513079+0000","last_became_active":"2023-10-14T12:18:47.505317+0000","last_became_peered":"2023-10-14T12:18:47.505317+0000","last_unstale":"2023-10-14T12:18:47.513079+0000","last_undegraded":"2023-10-14T12:18:47.513079+0000","last_fullsized":"2023-10-14T12:18:47.513079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501003+0000","last_change":"2023-10-14T12:18:47.518702+0000","last_active":"2023-10-14T12:18:48.501003+0000","last_peered":"2023-10-14T12:18:48.501003+0000","last_clean":"2023-10-14T12:18:48.501003+0000","last_became_active":"2023-10-14T12:18:47.512637+0000","last_became_peered":"2023-10-14T12:18:47.512637+0000","last_unstale":"2023-10-14T12:18:48.501003+0000","last_undegraded":"2023-10-14T12:18:48.501003+0000","last_fullsized":"2023-10-14T12:18:48.501003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.513811+0000","last_change":"2023-10-14T12:18:47.508247+0000","last_active":"2023-10-14T12:18:47.513811+0000","last_peered":"2023-10-14T12:18:47.513811+0000","last_clean":"2023-10-14T12:18:47.513811+0000","last_became_active":"2023-10-14T12:18:47.507971+0000","last_became_peered":"2023-10-14T12:18:47.507971+0000","last_unstale":"2023-10-14T12:18:47.513811+0000","last_undegraded":"2023-10-14T12:18:47.513811+0000","last_fullsized":"2023-10-14T12:18:47.513811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500163+0000","last_change":"2023-10-14T12:18:47.512408+0000","last_active":"2023-10-14T12:18:48.500163+0000","last_peered":"2023-10-14T12:18:48.500163+0000","last_clean":"2023-10-14T12:18:48.500163+0000","last_became_active":"2023-10-14T12:18:47.512170+0000","last_became_peered":"2023-10-14T12:18:47.512170+0000","last_unstale":"2023-10-14T12:18:48.500163+0000","last_undegraded":"2023-10-14T12:18:48.500163+0000","last_fullsized":"2023-10-14T12:18:48.500163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.519910+0000","last_change":"2023-10-14T12:18:47.518549+0000","last_active":"2023-10-14T12:18:47.519910+0000","last_peered":"2023-10-14T12:18:47.519910+0000","last_clean":"2023-10-14T12:18:47.519910+0000","last_became_active":"2023-10-14T12:18:47.517982+0000","last_became_peered":"2023-10-14T12:18:47.517982+0000","last_unstale":"2023-10-14T12:18:47.519910+0000","last_undegraded":"2023-10-14T12:18:47.519910+0000","last_fullsized":"2023-10-14T12:18:47.519910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444405+0000","last_change":"2023-10-14T12:18:47.512949+0000","last_active":"2023-10-14T12:18:49.444405+0000","last_peered":"2023-10-14T12:18:49.444405+0000","last_clean":"2023-10-14T12:18:49.444405+0000","last_became_active":"2023-10-14T12:18:47.512703+0000","last_became_peered":"2023-10-14T12:18:47.512703+0000","last_unstale":"2023-10-14T12:18:49.444405+0000","last_undegraded":"2023-10-14T12:18:49.444405+0000","last_fullsized":"2023-10-14T12:18:49.444405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444355+0000","last_change":"2023-10-14T12:18:47.518785+0000","last_active":"2023-10-14T12:18:49.444355+0000","last_peered":"2023-10-14T12:18:49.444355+0000","last_clean":"2023-10-14T12:18:49.444355+0000","last_became_active":"2023-10-14T12:18:47.518508+0000","last_became_peered":"2023-10-14T12:18:47.518508+0000","last_unstale":"2023-10-14T12:18:49.444355+0000","last_undegraded":"2023-10-14T12:18:49.444355+0000","last_fullsized":"2023-10-14T12:18:49.444355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769191+0000","last_change":"2023-10-14T12:18:47.504920+0000","last_active":"2023-10-14T12:18:49.769191+0000","last_peered":"2023-10-14T12:18:49.769191+0000","last_clean":"2023-10-14T12:18:49.769191+0000","last_became_active":"2023-10-14T12:18:47.504633+0000","last_became_peered":"2023-10-14T12:18:47.504633+0000","last_unstale":"2023-10-14T12:18:49.769191+0000","last_undegraded":"2023-10-14T12:18:49.769191+0000","last_fullsized":"2023-10-14T12:18:49.769191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500384+0000","last_change":"2023-10-14T12:18:47.505034+0000","last_active":"2023-10-14T12:18:48.500384+0000","last_peered":"2023-10-14T12:18:48.500384+0000","last_clean":"2023-10-14T12:18:48.500384+0000","last_became_active":"2023-10-14T12:18:47.504655+0000","last_became_peered":"2023-10-14T12:18:47.504655+0000","last_unstale":"2023-10-14T12:18:48.500384+0000","last_undegraded":"2023-10-14T12:18:48.500384+0000","last_fullsized":"2023-10-14T12:18:48.500384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.504922+0000","last_change":"2023-10-14T12:18:47.499576+0000","last_active":"2023-10-14T12:18:47.504922+0000","last_peered":"2023-10-14T12:18:47.504922+0000","last_clean":"2023-10-14T12:18:47.504922+0000","last_became_active":"2023-10-14T12:18:47.499249+0000","last_became_peered":"2023-10-14T12:18:47.499249+0000","last_unstale":"2023-10-14T12:18:47.504922+0000","last_undegraded":"2023-10-14T12:18:47.504922+0000","last_fullsized":"2023-10-14T12:18:47.504922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651648+0000","last_change":"2023-10-14T12:18:47.508453+0000","last_active":"2023-10-14T12:18:48.651648+0000","last_peered":"2023-10-14T12:18:48.651648+0000","last_clean":"2023-10-14T12:18:48.651648+0000","last_became_active":"2023-10-14T12:18:47.508081+0000","last_became_peered":"2023-10-14T12:18:47.508081+0000","last_unstale":"2023-10-14T12:18:48.651648+0000","last_undegraded":"2023-10-14T12:18:48.651648+0000","last_fullsized":"2023-10-14T12:18:48.651648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500721+0000","last_change":"2023-10-14T12:18:47.505739+0000","last_active":"2023-10-14T12:18:48.500721+0000","last_peered":"2023-10-14T12:18:48.500721+0000","last_clean":"2023-10-14T12:18:48.500721+0000","last_became_active":"2023-10-14T12:18:47.505456+0000","last_became_peered":"2023-10-14T12:18:47.505456+0000","last_unstale":"2023-10-14T12:18:48.500721+0000","last_undegraded":"2023-10-14T12:18:48.500721+0000","last_fullsized":"2023-10-14T12:18:48.500721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501605+0000","last_change":"2023-10-14T12:18:47.516673+0000","last_active":"2023-10-14T12:18:48.501605+0000","last_peered":"2023-10-14T12:18:48.501605+0000","last_clean":"2023-10-14T12:18:48.501605+0000","last_became_active":"2023-10-14T12:18:47.516312+0000","last_became_peered":"2023-10-14T12:18:47.516312+0000","last_unstale":"2023-10-14T12:18:48.501605+0000","last_undegraded":"2023-10-14T12:18:48.501605+0000","last_fullsized":"2023-10-14T12:18:48.501605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:15.401442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499582+0000","last_change":"2023-10-14T12:18:47.505601+0000","last_active":"2023-10-14T12:18:48.499582+0000","last_peered":"2023-10-14T12:18:48.499582+0000","last_clean":"2023-10-14T12:18:48.499582+0000","last_became_active":"2023-10-14T12:18:47.505242+0000","last_became_peered":"2023-10-14T12:18:47.505242+0000","last_unstale":"2023-10-14T12:18:48.499582+0000","last_undegraded":"2023-10-14T12:18:48.499582+0000","last_fullsized":"2023-10-14T12:18:48.499582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514476+0000","last_change":"2023-10-14T12:18:47.506070+0000","last_active":"2023-10-14T12:18:47.514476+0000","last_peered":"2023-10-14T12:18:47.514476+0000","last_clean":"2023-10-14T12:18:47.514476+0000","last_became_active":"2023-10-14T12:18:47.505784+0000","last_became_peered":"2023-10-14T12:18:47.505784+0000","last_unstale":"2023-10-14T12:18:47.514476+0000","last_undegraded":"2023-10-14T12:18:47.514476+0000","last_fullsized":"2023-10-14T12:18:47.514476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:40.565801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525126+0000","last_change":"2023-10-14T12:18:46.489704+0000","last_active":"2023-10-14T12:18:47.525126+0000","last_peered":"2023-10-14T12:18:47.525126+0000","last_clean":"2023-10-14T12:18:47.525126+0000","last_became_active":"2023-10-14T12:18:46.489418+0000","last_became_peered":"2023-10-14T12:18:46.489418+0000","last_unstale":"2023-10-14T12:18:47.525126+0000","last_undegraded":"2023-10-14T12:18:47.525126+0000","last_fullsized":"2023-10-14T12:18:47.525126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500871+0000","last_change":"2023-10-14T12:18:47.506025+0000","last_active":"2023-10-14T12:18:48.500871+0000","last_peered":"2023-10-14T12:18:48.500871+0000","last_clean":"2023-10-14T12:18:48.500871+0000","last_became_active":"2023-10-14T12:18:47.505700+0000","last_became_peered":"2023-10-14T12:18:47.505700+0000","last_unstale":"2023-10-14T12:18:48.500871+0000","last_undegraded":"2023-10-14T12:18:48.500871+0000","last_fullsized":"2023-10-14T12:18:48.500871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500977+0000","last_change":"2023-10-14T12:18:46.486371+0000","last_active":"2023-10-14T12:18:48.500977+0000","last_peered":"2023-10-14T12:18:48.500977+0000","last_clean":"2023-10-14T12:18:48.500977+0000","last_became_active":"2023-10-14T12:18:46.486098+0000","last_became_peered":"2023-10-14T12:18:46.486098+0000","last_unstale":"2023-10-14T12:18:48.500977+0000","last_undegraded":"2023-10-14T12:18:48.500977+0000","last_fullsized":"2023-10-14T12:18:48.500977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.520511+0000","last_change":"2023-10-14T12:18:47.517540+0000","last_active":"2023-10-14T12:18:47.520511+0000","last_peered":"2023-10-14T12:18:47.520511+0000","last_clean":"2023-10-14T12:18:47.520511+0000","last_became_active":"2023-10-14T12:18:47.517283+0000","last_became_peered":"2023-10-14T12:18:47.517283+0000","last_unstale":"2023-10-14T12:18:47.520511+0000","last_undegraded":"2023-10-14T12:18:47.520511+0000","last_fullsized":"2023-10-14T12:18:47.520511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:00.146988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525133+0000","last_change":"2023-10-14T12:18:46.492599+0000","last_active":"2023-10-14T12:18:47.525133+0000","last_peered":"2023-10-14T12:18:47.525133+0000","last_clean":"2023-10-14T12:18:47.525133+0000","last_became_active":"2023-10-14T12:18:46.492296+0000","last_became_peered":"2023-10-14T12:18:46.492296+0000","last_unstale":"2023-10-14T12:18:47.525133+0000","last_undegraded":"2023-10-14T12:18:47.525133+0000","last_fullsized":"2023-10-14T12:18:47.525133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501088+0000","last_change":"2023-10-14T12:18:47.517351+0000","last_active":"2023-10-14T12:18:48.501088+0000","last_peered":"2023-10-14T12:18:48.501088+0000","last_clean":"2023-10-14T12:18:48.501088+0000","last_became_active":"2023-10-14T12:18:47.516208+0000","last_became_peered":"2023-10-14T12:18:47.516208+0000","last_unstale":"2023-10-14T12:18:48.501088+0000","last_undegraded":"2023-10-14T12:18:48.501088+0000","last_fullsized":"2023-10-14T12:18:48.501088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525264+0000","last_change":"2023-10-14T12:18:46.489437+0000","last_active":"2023-10-14T12:18:47.525264+0000","last_peered":"2023-10-14T12:18:47.525264+0000","last_clean":"2023-10-14T12:18:47.525264+0000","last_became_active":"2023-10-14T12:18:46.489122+0000","last_became_peered":"2023-10-14T12:18:46.489122+0000","last_unstale":"2023-10-14T12:18:47.525264+0000","last_undegraded":"2023-10-14T12:18:47.525264+0000","last_fullsized":"2023-10-14T12:18:47.525264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501421+0000","last_change":"2023-10-14T12:18:47.512921+0000","last_active":"2023-10-14T12:18:48.501421+0000","last_peered":"2023-10-14T12:18:48.501421+0000","last_clean":"2023-10-14T12:18:48.501421+0000","last_became_active":"2023-10-14T12:18:47.512426+0000","last_became_peered":"2023-10-14T12:18:47.512426+0000","last_unstale":"2023-10-14T12:18:48.501421+0000","last_undegraded":"2023-10-14T12:18:48.501421+0000","last_fullsized":"2023-10-14T12:18:48.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:30.575773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500674+0000","last_change":"2023-10-14T12:18:46.489840+0000","last_active":"2023-10-14T12:18:48.500674+0000","last_peered":"2023-10-14T12:18:48.500674+0000","last_clean":"2023-10-14T12:18:48.500674+0000","last_became_active":"2023-10-14T12:18:46.489548+0000","last_became_peered":"2023-10-14T12:18:46.489548+0000","last_unstale":"2023-10-14T12:18:48.500674+0000","last_undegraded":"2023-10-14T12:18:48.500674+0000","last_fullsized":"2023-10-14T12:18:48.500674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.768871+0000","last_change":"2023-10-14T12:18:47.505062+0000","last_active":"2023-10-14T12:18:49.768871+0000","last_peered":"2023-10-14T12:18:49.768871+0000","last_clean":"2023-10-14T12:18:49.768871+0000","last_became_active":"2023-10-14T12:18:47.504744+0000","last_became_peered":"2023-10-14T12:18:47.504744+0000","last_unstale":"2023-10-14T12:18:49.768871+0000","last_undegraded":"2023-10-14T12:18:49.768871+0000","last_fullsized":"2023-10-14T12:18:49.768871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444107+0000","last_change":"2023-10-14T12:18:46.495580+0000","last_active":"2023-10-14T12:18:49.444107+0000","last_peered":"2023-10-14T12:18:49.444107+0000","last_clean":"2023-10-14T12:18:49.444107+0000","last_became_active":"2023-10-14T12:18:46.495262+0000","last_became_peered":"2023-10-14T12:18:46.495262+0000","last_unstale":"2023-10-14T12:18:49.444107+0000","last_undegraded":"2023-10-14T12:18:49.444107+0000","last_fullsized":"2023-10-14T12:18:49.444107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.509932+0000","last_change":"2023-10-14T12:18:47.509133+0000","last_active":"2023-10-14T12:18:47.509932+0000","last_peered":"2023-10-14T12:18:47.509932+0000","last_clean":"2023-10-14T12:18:47.509932+0000","last_became_active":"2023-10-14T12:18:47.508824+0000","last_became_peered":"2023-10-14T12:18:47.508824+0000","last_unstale":"2023-10-14T12:18:47.509932+0000","last_undegraded":"2023-10-14T12:18:47.509932+0000","last_fullsized":"2023-10-14T12:18:47.509932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:26.807733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500305+0000","last_change":"2023-10-14T12:18:46.489498+0000","last_active":"2023-10-14T12:18:48.500305+0000","last_peered":"2023-10-14T12:18:48.500305+0000","last_clean":"2023-10-14T12:18:48.500305+0000","last_became_active":"2023-10-14T12:18:46.489134+0000","last_became_peered":"2023-10-14T12:18:46.489134+0000","last_unstale":"2023-10-14T12:18:48.500305+0000","last_undegraded":"2023-10-14T12:18:48.500305+0000","last_fullsized":"2023-10-14T12:18:48.500305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500304+0000","last_change":"2023-10-14T12:18:47.500917+0000","last_active":"2023-10-14T12:18:48.500304+0000","last_peered":"2023-10-14T12:18:48.500304+0000","last_clean":"2023-10-14T12:18:48.500304+0000","last_became_active":"2023-10-14T12:18:47.500513+0000","last_became_peered":"2023-10-14T12:18:47.500513+0000","last_unstale":"2023-10-14T12:18:48.500304+0000","last_undegraded":"2023-10-14T12:18:48.500304+0000","last_fullsized":"2023-10-14T12:18:48.500304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500764+0000","last_change":"2023-10-14T12:18:46.485701+0000","last_active":"2023-10-14T12:18:48.500764+0000","last_peered":"2023-10-14T12:18:48.500764+0000","last_clean":"2023-10-14T12:18:48.500764+0000","last_became_active":"2023-10-14T12:18:46.485368+0000","last_became_peered":"2023-10-14T12:18:46.485368+0000","last_unstale":"2023-10-14T12:18:48.500764+0000","last_undegraded":"2023-10-14T12:18:48.500764+0000","last_fullsized":"2023-10-14T12:18:48.500764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:19.585802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651760+0000","last_change":"2023-10-14T12:18:47.497548+0000","last_active":"2023-10-14T12:18:48.651760+0000","last_peered":"2023-10-14T12:18:48.651760+0000","last_clean":"2023-10-14T12:18:48.651760+0000","last_became_active":"2023-10-14T12:18:47.497227+0000","last_became_peered":"2023-10-14T12:18:47.497227+0000","last_unstale":"2023-10-14T12:18:48.651760+0000","last_undegraded":"2023-10-14T12:18:48.651760+0000","last_fullsized":"2023-10-14T12:18:48.651760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444253+0000","last_change":"2023-10-14T12:18:46.491993+0000","last_active":"2023-10-14T12:18:49.444253+0000","last_peered":"2023-10-14T12:18:49.444253+0000","last_clean":"2023-10-14T12:18:49.444253+0000","last_became_active":"2023-10-14T12:18:46.491478+0000","last_became_peered":"2023-10-14T12:18:46.491478+0000","last_unstale":"2023-10-14T12:18:49.444253+0000","last_undegraded":"2023-10-14T12:18:49.444253+0000","last_fullsized":"2023-10-14T12:18:49.444253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501636+0000","last_change":"2023-10-14T12:18:47.510673+0000","last_active":"2023-10-14T12:18:48.501636+0000","last_peered":"2023-10-14T12:18:48.501636+0000","last_clean":"2023-10-14T12:18:48.501636+0000","last_became_active":"2023-10-14T12:18:47.510382+0000","last_became_peered":"2023-10-14T12:18:47.510382+0000","last_unstale":"2023-10-14T12:18:48.501636+0000","last_undegraded":"2023-10-14T12:18:48.501636+0000","last_fullsized":"2023-10-14T12:18:48.501636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:47.215959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501549+0000","last_change":"2023-10-14T12:18:46.487677+0000","last_active":"2023-10-14T12:18:48.501549+0000","last_peered":"2023-10-14T12:18:48.501549+0000","last_clean":"2023-10-14T12:18:48.501549+0000","last_became_active":"2023-10-14T12:18:46.487359+0000","last_became_peered":"2023-10-14T12:18:46.487359+0000","last_unstale":"2023-10-14T12:18:48.501549+0000","last_undegraded":"2023-10-14T12:18:48.501549+0000","last_fullsized":"2023-10-14T12:18:48.501549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:50.124419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.522123+0000","last_change":"2023-10-14T12:18:47.521313+0000","last_active":"2023-10-14T12:18:47.522123+0000","last_peered":"2023-10-14T12:18:47.522123+0000","last_clean":"2023-10-14T12:18:47.522123+0000","last_became_active":"2023-10-14T12:18:47.521124+0000","last_became_peered":"2023-10-14T12:18:47.521124+0000","last_unstale":"2023-10-14T12:18:47.522123+0000","last_undegraded":"2023-10-14T12:18:47.522123+0000","last_fullsized":"2023-10-14T12:18:47.522123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:41.163623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651865+0000","last_change":"2023-10-14T12:18:46.488148+0000","last_active":"2023-10-14T12:18:48.651865+0000","last_peered":"2023-10-14T12:18:48.651865+0000","last_clean":"2023-10-14T12:18:48.651865+0000","last_became_active":"2023-10-14T12:18:46.487791+0000","last_became_peered":"2023-10-14T12:18:46.487791+0000","last_unstale":"2023-10-14T12:18:48.651865+0000","last_undegraded":"2023-10-14T12:18:48.651865+0000","last_fullsized":"2023-10-14T12:18:48.651865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:45.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769286+0000","last_change":"2023-10-14T12:18:47.512765+0000","last_active":"2023-10-14T12:18:49.769286+0000","last_peered":"2023-10-14T12:18:49.769286+0000","last_clean":"2023-10-14T12:18:49.769286+0000","last_became_active":"2023-10-14T12:18:47.512114+0000","last_became_peered":"2023-10-14T12:18:47.512114+0000","last_unstale":"2023-10-14T12:18:49.769286+0000","last_undegraded":"2023-10-14T12:18:49.769286+0000","last_fullsized":"2023-10-14T12:18:49.769286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444132+0000","last_change":"2023-10-14T12:18:46.493265+0000","last_active":"2023-10-14T12:18:49.444132+0000","last_peered":"2023-10-14T12:18:49.444132+0000","last_clean":"2023-10-14T12:18:49.444132+0000","last_became_active":"2023-10-14T12:18:46.493012+0000","last_became_peered":"2023-10-14T12:18:46.493012+0000","last_unstale":"2023-10-14T12:18:49.444132+0000","last_undegraded":"2023-10-14T12:18:49.444132+0000","last_fullsized":"2023-10-14T12:18:49.444132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514498+0000","last_change":"2023-10-14T12:18:47.510386+0000","last_active":"2023-10-14T12:18:47.514498+0000","last_peered":"2023-10-14T12:18:47.514498+0000","last_clean":"2023-10-14T12:18:47.514498+0000","last_became_active":"2023-10-14T12:18:47.510098+0000","last_became_peered":"2023-10-14T12:18:47.510098+0000","last_unstale":"2023-10-14T12:18:47.514498+0000","last_undegraded":"2023-10-14T12:18:47.514498+0000","last_fullsized":"2023-10-14T12:18:47.514498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:05.100753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525962+0000","last_change":"2023-10-14T12:18:46.490324+0000","last_active":"2023-10-14T12:18:47.525962+0000","last_peered":"2023-10-14T12:18:47.525962+0000","last_clean":"2023-10-14T12:18:47.525962+0000","last_became_active":"2023-10-14T12:18:46.489914+0000","last_became_peered":"2023-10-14T12:18:46.489914+0000","last_unstale":"2023-10-14T12:18:47.525962+0000","last_undegraded":"2023-10-14T12:18:47.525962+0000","last_fullsized":"2023-10-14T12:18:47.525962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.511663+0000","last_change":"2023-10-14T12:18:47.511080+0000","last_active":"2023-10-14T12:18:47.511663+0000","last_peered":"2023-10-14T12:18:47.511663+0000","last_clean":"2023-10-14T12:18:47.511663+0000","last_became_active":"2023-10-14T12:18:47.510729+0000","last_became_peered":"2023-10-14T12:18:47.510729+0000","last_unstale":"2023-10-14T12:18:47.511663+0000","last_undegraded":"2023-10-14T12:18:47.511663+0000","last_fullsized":"2023-10-14T12:18:47.511663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:03.106457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501219+0000","last_change":"2023-10-14T12:18:46.492854+0000","last_active":"2023-10-14T12:18:48.501219+0000","last_peered":"2023-10-14T12:18:48.501219+0000","last_clean":"2023-10-14T12:18:48.501219+0000","last_became_active":"2023-10-14T12:18:46.492536+0000","last_became_peered":"2023-10-14T12:18:46.492536+0000","last_unstale":"2023-10-14T12:18:48.501219+0000","last_undegraded":"2023-10-14T12:18:48.501219+0000","last_fullsized":"2023-10-14T12:18:48.501219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.520004+0000","last_change":"2023-10-14T12:18:47.513637+0000","last_active":"2023-10-14T12:18:47.520004+0000","last_peered":"2023-10-14T12:18:47.520004+0000","last_clean":"2023-10-14T12:18:47.520004+0000","last_became_active":"2023-10-14T12:18:47.513263+0000","last_became_peered":"2023-10-14T12:18:47.513263+0000","last_unstale":"2023-10-14T12:18:47.520004+0000","last_undegraded":"2023-10-14T12:18:47.520004+0000","last_fullsized":"2023-10-14T12:18:47.520004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443932+0000","last_change":"2023-10-14T12:18:46.495076+0000","last_active":"2023-10-14T12:18:49.443932+0000","last_peered":"2023-10-14T12:18:49.443932+0000","last_clean":"2023-10-14T12:18:49.443932+0000","last_became_active":"2023-10-14T12:18:46.494780+0000","last_became_peered":"2023-10-14T12:18:46.494780+0000","last_unstale":"2023-10-14T12:18:49.443932+0000","last_undegraded":"2023-10-14T12:18:49.443932+0000","last_fullsized":"2023-10-14T12:18:49.443932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444027+0000","last_change":"2023-10-14T12:18:47.506950+0000","last_active":"2023-10-14T12:18:49.444027+0000","last_peered":"2023-10-14T12:18:49.444027+0000","last_clean":"2023-10-14T12:18:49.444027+0000","last_became_active":"2023-10-14T12:18:47.506480+0000","last_became_peered":"2023-10-14T12:18:47.506480+0000","last_unstale":"2023-10-14T12:18:49.444027+0000","last_undegraded":"2023-10-14T12:18:49.444027+0000","last_fullsized":"2023-10-14T12:18:49.444027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499104+0000","last_change":"2023-10-14T12:18:46.486865+0000","last_active":"2023-10-14T12:18:48.499104+0000","last_peered":"2023-10-14T12:18:48.499104+0000","last_clean":"2023-10-14T12:18:48.499104+0000","last_became_active":"2023-10-14T12:18:46.486537+0000","last_became_peered":"2023-10-14T12:18:46.486537+0000","last_unstale":"2023-10-14T12:18:48.499104+0000","last_undegraded":"2023-10-14T12:18:48.499104+0000","last_fullsized":"2023-10-14T12:18:48.499104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:59.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514136+0000","last_change":"2023-10-14T12:18:47.511494+0000","last_active":"2023-10-14T12:18:47.514136+0000","last_peered":"2023-10-14T12:18:47.514136+0000","last_clean":"2023-10-14T12:18:47.514136+0000","last_became_active":"2023-10-14T12:18:47.511109+0000","last_became_peered":"2023-10-14T12:18:47.511109+0000","last_unstale":"2023-10-14T12:18:47.514136+0000","last_undegraded":"2023-10-14T12:18:47.514136+0000","last_fullsized":"2023-10-14T12:18:47.514136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769115+0000","last_change":"2023-10-14T12:18:46.488089+0000","last_active":"2023-10-14T12:18:49.769115+0000","last_peered":"2023-10-14T12:18:49.769115+0000","last_clean":"2023-10-14T12:18:49.769115+0000","last_became_active":"2023-10-14T12:18:46.487778+0000","last_became_peered":"2023-10-14T12:18:46.487778+0000","last_unstale":"2023-10-14T12:18:49.769115+0000","last_undegraded":"2023-10-14T12:18:49.769115+0000","last_fullsized":"2023-10-14T12:18:49.769115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:51:57.421458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514526+0000","last_change":"2023-10-14T12:18:47.508911+0000","last_active":"2023-10-14T12:18:47.514526+0000","last_peered":"2023-10-14T12:18:47.514526+0000","last_clean":"2023-10-14T12:18:47.514526+0000","last_became_active":"2023-10-14T12:18:47.508621+0000","last_became_peered":"2023-10-14T12:18:47.508621+0000","last_unstale":"2023-10-14T12:18:47.514526+0000","last_undegraded":"2023-10-14T12:18:47.514526+0000","last_fullsized":"2023-10-14T12:18:47.514526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651805+0000","last_change":"2023-10-14T12:18:46.488275+0000","last_active":"2023-10-14T12:18:48.651805+0000","last_peered":"2023-10-14T12:18:48.651805+0000","last_clean":"2023-10-14T12:18:48.651805+0000","last_became_active":"2023-10-14T12:18:46.487981+0000","last_became_peered":"2023-10-14T12:18:46.487981+0000","last_unstale":"2023-10-14T12:18:48.651805+0000","last_undegraded":"2023-10-14T12:18:48.651805+0000","last_fullsized":"2023-10-14T12:18:48.651805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501360+0000","last_change":"2023-10-14T12:18:47.512865+0000","last_active":"2023-10-14T12:18:48.501360+0000","last_peered":"2023-10-14T12:18:48.501360+0000","last_clean":"2023-10-14T12:18:48.501360+0000","last_became_active":"2023-10-14T12:18:47.512117+0000","last_became_peered":"2023-10-14T12:18:47.512117+0000","last_unstale":"2023-10-14T12:18:48.501360+0000","last_undegraded":"2023-10-14T12:18:48.501360+0000","last_fullsized":"2023-10-14T12:18:48.501360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:20.704090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501126+0000","last_change":"2023-10-14T12:18:46.488158+0000","last_active":"2023-10-14T12:18:48.501126+0000","last_peered":"2023-10-14T12:18:48.501126+0000","last_clean":"2023-10-14T12:18:48.501126+0000","last_became_active":"2023-10-14T12:18:46.487808+0000","last_became_peered":"2023-10-14T12:18:46.487808+0000","last_unstale":"2023-10-14T12:18:48.501126+0000","last_undegraded":"2023-10-14T12:18:48.501126+0000","last_fullsized":"2023-10-14T12:18:48.501126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769274+0000","last_change":"2023-10-14T12:18:47.506873+0000","last_active":"2023-10-14T12:18:49.769274+0000","last_peered":"2023-10-14T12:18:49.769274+0000","last_clean":"2023-10-14T12:18:49.769274+0000","last_became_active":"2023-10-14T12:18:47.506563+0000","last_became_peered":"2023-10-14T12:18:47.506563+0000","last_unstale":"2023-10-14T12:18:49.769274+0000","last_undegraded":"2023-10-14T12:18:49.769274+0000","last_fullsized":"2023-10-14T12:18:49.769274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651592+0000","last_change":"2023-10-14T12:18:47.494275+0000","last_active":"2023-10-14T12:18:48.651592+0000","last_peered":"2023-10-14T12:18:48.651592+0000","last_clean":"2023-10-14T12:18:48.651592+0000","last_became_active":"2023-10-14T12:18:47.493948+0000","last_became_peered":"2023-10-14T12:18:47.493948+0000","last_unstale":"2023-10-14T12:18:48.651592+0000","last_undegraded":"2023-10-14T12:18:48.651592+0000","last_fullsized":"2023-10-14T12:18:48.651592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499214+0000","last_change":"2023-10-14T12:18:46.485430+0000","last_active":"2023-10-14T12:18:48.499214+0000","last_peered":"2023-10-14T12:18:48.499214+0000","last_clean":"2023-10-14T12:18:48.499214+0000","last_became_active":"2023-10-14T12:18:46.485097+0000","last_became_peered":"2023-10-14T12:18:46.485097+0000","last_unstale":"2023-10-14T12:18:48.499214+0000","last_undegraded":"2023-10-14T12:18:48.499214+0000","last_fullsized":"2023-10-14T12:18:48.499214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:35.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500519+0000","last_change":"2023-10-14T12:18:47.520808+0000","last_active":"2023-10-14T12:18:48.500519+0000","last_peered":"2023-10-14T12:18:48.500519+0000","last_clean":"2023-10-14T12:18:48.500519+0000","last_became_active":"2023-10-14T12:18:47.520421+0000","last_became_peered":"2023-10-14T12:18:47.520421+0000","last_unstale":"2023-10-14T12:18:48.500519+0000","last_undegraded":"2023-10-14T12:18:48.500519+0000","last_fullsized":"2023-10-14T12:18:48.500519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500975+0000","last_change":"2023-10-14T12:18:46.487688+0000","last_active":"2023-10-14T12:18:48.500975+0000","last_peered":"2023-10-14T12:18:48.500975+0000","last_clean":"2023-10-14T12:18:48.500975+0000","last_became_active":"2023-10-14T12:18:46.487378+0000","last_became_peered":"2023-10-14T12:18:46.487378+0000","last_unstale":"2023-10-14T12:18:48.500975+0000","last_undegraded":"2023-10-14T12:18:48.500975+0000","last_fullsized":"2023-10-14T12:18:48.500975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T12:18:46.481801+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:18:46.481801+0000","last_peered":"2023-10-14T12:18:46.481801+0000","last_clean":"2023-10-14T12:18:46.481801+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:18:46.481801+0000","last_undegraded":"2023-10-14T12:18:46.481801+0000","last_fullsized":"2023-10-14T12:18:46.481801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.509776+0000","last_change":"2023-10-14T12:18:47.508543+0000","last_active":"2023-10-14T12:18:47.509776+0000","last_peered":"2023-10-14T12:18:47.509776+0000","last_clean":"2023-10-14T12:18:47.509776+0000","last_became_active":"2023-10-14T12:18:47.508263+0000","last_became_peered":"2023-10-14T12:18:47.508263+0000","last_unstale":"2023-10-14T12:18:47.509776+0000","last_undegraded":"2023-10-14T12:18:47.509776+0000","last_fullsized":"2023-10-14T12:18:47.509776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:09.878545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.494883+0000","last_change":"2023-10-14T12:18:46.489896+0000","last_active":"2023-10-14T12:18:47.494883+0000","last_peered":"2023-10-14T12:18:47.494883+0000","last_clean":"2023-10-14T12:18:47.494883+0000","last_became_active":"2023-10-14T12:18:46.489571+0000","last_became_peered":"2023-10-14T12:18:46.489571+0000","last_unstale":"2023-10-14T12:18:47.494883+0000","last_undegraded":"2023-10-14T12:18:47.494883+0000","last_fullsized":"2023-10-14T12:18:47.494883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.503884+0000","last_change":"2023-10-14T12:18:46.490891+0000","last_active":"2023-10-14T12:18:47.503884+0000","last_peered":"2023-10-14T12:18:47.503884+0000","last_clean":"2023-10-14T12:18:47.503884+0000","last_became_active":"2023-10-14T12:18:46.490638+0000","last_became_peered":"2023-10-14T12:18:46.490638+0000","last_unstale":"2023-10-14T12:18:47.503884+0000","last_undegraded":"2023-10-14T12:18:47.503884+0000","last_fullsized":"2023-10-14T12:18:47.503884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651814+0000","last_change":"2023-10-14T12:18:47.494381+0000","last_active":"2023-10-14T12:18:48.651814+0000","last_peered":"2023-10-14T12:18:48.651814+0000","last_clean":"2023-10-14T12:18:48.651814+0000","last_became_active":"2023-10-14T12:18:47.493740+0000","last_became_peered":"2023-10-14T12:18:47.493740+0000","last_unstale":"2023-10-14T12:18:48.651814+0000","last_undegraded":"2023-10-14T12:18:48.651814+0000","last_fullsized":"2023-10-14T12:18:48.651814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651788+0000","last_change":"2023-10-14T12:18:46.492626+0000","last_active":"2023-10-14T12:18:48.651788+0000","last_peered":"2023-10-14T12:18:48.651788+0000","last_clean":"2023-10-14T12:18:48.651788+0000","last_became_active":"2023-10-14T12:18:46.492238+0000","last_became_peered":"2023-10-14T12:18:46.492238+0000","last_unstale":"2023-10-14T12:18:48.651788+0000","last_undegraded":"2023-10-14T12:18:48.651788+0000","last_fullsized":"2023-10-14T12:18:48.651788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500978+0000","last_change":"2023-10-14T12:18:47.505508+0000","last_active":"2023-10-14T12:18:48.500978+0000","last_peered":"2023-10-14T12:18:48.500978+0000","last_clean":"2023-10-14T12:18:48.500978+0000","last_became_active":"2023-10-14T12:18:47.505204+0000","last_became_peered":"2023-10-14T12:18:47.505204+0000","last_unstale":"2023-10-14T12:18:48.500978+0000","last_undegraded":"2023-10-14T12:18:48.500978+0000","last_fullsized":"2023-10-14T12:18:48.500978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444144+0000","last_change":"2023-10-14T12:18:46.489860+0000","last_active":"2023-10-14T12:18:49.444144+0000","last_peered":"2023-10-14T12:18:49.444144+0000","last_clean":"2023-10-14T12:18:49.444144+0000","last_became_active":"2023-10-14T12:18:46.489554+0000","last_became_peered":"2023-10-14T12:18:46.489554+0000","last_unstale":"2023-10-14T12:18:49.444144+0000","last_undegraded":"2023-10-14T12:18:49.444144+0000","last_fullsized":"2023-10-14T12:18:49.444144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.506118+0000","last_change":"2023-10-14T12:18:47.501705+0000","last_active":"2023-10-14T12:18:47.506118+0000","last_peered":"2023-10-14T12:18:47.506118+0000","last_clean":"2023-10-14T12:18:47.506118+0000","last_became_active":"2023-10-14T12:18:47.499259+0000","last_became_peered":"2023-10-14T12:18:47.499259+0000","last_unstale":"2023-10-14T12:18:47.506118+0000","last_undegraded":"2023-10-14T12:18:47.506118+0000","last_fullsized":"2023-10-14T12:18:47.506118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:36.231154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.494521+0000","last_change":"2023-10-14T12:18:46.489770+0000","last_active":"2023-10-14T12:18:47.494521+0000","last_peered":"2023-10-14T12:18:47.494521+0000","last_clean":"2023-10-14T12:18:47.494521+0000","last_became_active":"2023-10-14T12:18:46.489289+0000","last_became_peered":"2023-10-14T12:18:46.489289+0000","last_unstale":"2023-10-14T12:18:47.494521+0000","last_undegraded":"2023-10-14T12:18:47.494521+0000","last_fullsized":"2023-10-14T12:18:47.494521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769054+0000","last_change":"2023-10-14T12:18:47.506908+0000","last_active":"2023-10-14T12:18:49.769054+0000","last_peered":"2023-10-14T12:18:49.769054+0000","last_clean":"2023-10-14T12:18:49.769054+0000","last_became_active":"2023-10-14T12:18:47.506651+0000","last_became_peered":"2023-10-14T12:18:47.506651+0000","last_unstale":"2023-10-14T12:18:49.769054+0000","last_undegraded":"2023-10-14T12:18:49.769054+0000","last_fullsized":"2023-10-14T12:18:49.769054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651573+0000","last_change":"2023-10-14T12:18:46.491315+0000","last_active":"2023-10-14T12:18:48.651573+0000","last_peered":"2023-10-14T12:18:48.651573+0000","last_clean":"2023-10-14T12:18:48.651573+0000","last_became_active":"2023-10-14T12:18:46.490992+0000","last_became_peered":"2023-10-14T12:18:46.490992+0000","last_unstale":"2023-10-14T12:18:48.651573+0000","last_undegraded":"2023-10-14T12:18:48.651573+0000","last_fullsized":"2023-10-14T12:18:48.651573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:39.561079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.496045+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.495676+0000","last_became_peered":"2023-10-14T12:18:47.495676+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651651+0000","last_change":"2023-10-14T12:18:46.493273+0000","last_active":"2023-10-14T12:18:48.651651+0000","last_peered":"2023-10-14T12:18:48.651651+0000","last_clean":"2023-10-14T12:18:48.651651+0000","last_became_active":"2023-10-14T12:18:46.492945+0000","last_became_peered":"2023-10-14T12:18:46.492945+0000","last_unstale":"2023-10-14T12:18:48.651651+0000","last_undegraded":"2023-10-14T12:18:48.651651+0000","last_fullsized":"2023-10-14T12:18:48.651651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500822+0000","last_change":"2023-10-14T12:18:47.504495+0000","last_active":"2023-10-14T12:18:48.500822+0000","last_peered":"2023-10-14T12:18:48.500822+0000","last_clean":"2023-10-14T12:18:48.500822+0000","last_became_active":"2023-10-14T12:18:47.504117+0000","last_became_peered":"2023-10-14T12:18:47.504117+0000","last_unstale":"2023-10-14T12:18:48.500822+0000","last_undegraded":"2023-10-14T12:18:48.500822+0000","last_fullsized":"2023-10-14T12:18:48.500822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.525717+0000","last_change":"2023-10-14T12:18:46.489933+0000","last_active":"2023-10-14T12:18:47.525717+0000","last_peered":"2023-10-14T12:18:47.525717+0000","last_clean":"2023-10-14T12:18:47.525717+0000","last_became_active":"2023-10-14T12:18:46.489656+0000","last_became_peered":"2023-10-14T12:18:46.489656+0000","last_unstale":"2023-10-14T12:18:47.525717+0000","last_undegraded":"2023-10-14T12:18:47.525717+0000","last_fullsized":"2023-10-14T12:18:47.525717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444202+0000","last_change":"2023-10-14T12:18:47.510691+0000","last_active":"2023-10-14T12:18:49.444202+0000","last_peered":"2023-10-14T12:18:49.444202+0000","last_clean":"2023-10-14T12:18:49.444202+0000","last_became_active":"2023-10-14T12:18:47.510404+0000","last_became_peered":"2023-10-14T12:18:47.510404+0000","last_unstale":"2023-10-14T12:18:49.444202+0000","last_undegraded":"2023-10-14T12:18:49.444202+0000","last_fullsized":"2023-10-14T12:18:49.444202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499536+0000","last_change":"2023-10-14T12:18:46.480875+0000","last_active":"2023-10-14T12:18:48.499536+0000","last_peered":"2023-10-14T12:18:48.499536+0000","last_clean":"2023-10-14T12:18:48.499536+0000","last_became_active":"2023-10-14T12:18:46.480351+0000","last_became_peered":"2023-10-14T12:18:46.480351+0000","last_unstale":"2023-10-14T12:18:48.499536+0000","last_undegraded":"2023-10-14T12:18:48.499536+0000","last_fullsized":"2023-10-14T12:18:48.499536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.518819+0000","last_change":"2023-10-14T12:18:47.513547+0000","last_active":"2023-10-14T12:18:47.518819+0000","last_peered":"2023-10-14T12:18:47.518819+0000","last_clean":"2023-10-14T12:18:47.518819+0000","last_became_active":"2023-10-14T12:18:47.513269+0000","last_became_peered":"2023-10-14T12:18:47.513269+0000","last_unstale":"2023-10-14T12:18:47.518819+0000","last_undegraded":"2023-10-14T12:18:47.518819+0000","last_fullsized":"2023-10-14T12:18:47.518819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651762+0000","last_change":"2023-10-14T12:18:46.489993+0000","last_active":"2023-10-14T12:18:48.651762+0000","last_peered":"2023-10-14T12:18:48.651762+0000","last_clean":"2023-10-14T12:18:48.651762+0000","last_became_active":"2023-10-14T12:18:46.489684+0000","last_became_peered":"2023-10-14T12:18:46.489684+0000","last_unstale":"2023-10-14T12:18:48.651762+0000","last_undegraded":"2023-10-14T12:18:48.651762+0000","last_fullsized":"2023-10-14T12:18:48.651762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501154+0000","last_change":"2023-10-14T12:18:47.503531+0000","last_active":"2023-10-14T12:18:48.501154+0000","last_peered":"2023-10-14T12:18:48.501154+0000","last_clean":"2023-10-14T12:18:48.501154+0000","last_became_active":"2023-10-14T12:18:47.503243+0000","last_became_peered":"2023-10-14T12:18:47.503243+0000","last_unstale":"2023-10-14T12:18:48.501154+0000","last_undegraded":"2023-10-14T12:18:48.501154+0000","last_fullsized":"2023-10-14T12:18:48.501154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:18.615845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499451+0000","last_change":"2023-10-14T12:18:46.488590+0000","last_active":"2023-10-14T12:18:48.499451+0000","last_peered":"2023-10-14T12:18:48.499451+0000","last_clean":"2023-10-14T12:18:48.499451+0000","last_became_active":"2023-10-14T12:18:46.487442+0000","last_became_peered":"2023-10-14T12:18:46.487442+0000","last_unstale":"2023-10-14T12:18:48.499451+0000","last_undegraded":"2023-10-14T12:18:48.499451+0000","last_fullsized":"2023-10-14T12:18:48.499451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.514049+0000","last_change":"2023-10-14T12:18:47.510800+0000","last_active":"2023-10-14T12:18:47.514049+0000","last_peered":"2023-10-14T12:18:47.514049+0000","last_clean":"2023-10-14T12:18:47.514049+0000","last_became_active":"2023-10-14T12:18:47.510526+0000","last_became_peered":"2023-10-14T12:18:47.510526+0000","last_unstale":"2023-10-14T12:18:47.514049+0000","last_undegraded":"2023-10-14T12:18:47.514049+0000","last_fullsized":"2023-10-14T12:18:47.514049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443979+0000","last_change":"2023-10-14T12:18:47.506751+0000","last_active":"2023-10-14T12:18:49.443979+0000","last_peered":"2023-10-14T12:18:49.443979+0000","last_clean":"2023-10-14T12:18:49.443979+0000","last_became_active":"2023-10-14T12:18:47.506062+0000","last_became_peered":"2023-10-14T12:18:47.506062+0000","last_unstale":"2023-10-14T12:18:49.443979+0000","last_undegraded":"2023-10-14T12:18:49.443979+0000","last_fullsized":"2023-10-14T12:18:49.443979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499359+0000","last_change":"2023-10-14T12:18:47.512676+0000","last_active":"2023-10-14T12:18:48.499359+0000","last_peered":"2023-10-14T12:18:48.499359+0000","last_clean":"2023-10-14T12:18:48.499359+0000","last_became_active":"2023-10-14T12:18:47.512314+0000","last_became_peered":"2023-10-14T12:18:47.512314+0000","last_unstale":"2023-10-14T12:18:48.499359+0000","last_undegraded":"2023-10-14T12:18:48.499359+0000","last_fullsized":"2023-10-14T12:18:48.499359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501459+0000","last_change":"2023-10-14T12:18:47.517326+0000","last_active":"2023-10-14T12:18:48.501459+0000","last_peered":"2023-10-14T12:18:48.501459+0000","last_clean":"2023-10-14T12:18:48.501459+0000","last_became_active":"2023-10-14T12:18:47.512255+0000","last_became_peered":"2023-10-14T12:18:47.512255+0000","last_unstale":"2023-10-14T12:18:48.501459+0000","last_undegraded":"2023-10-14T12:18:48.501459+0000","last_fullsized":"2023-10-14T12:18:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:10.981380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.506028+0000","last_change":"2023-10-14T12:18:47.501741+0000","last_active":"2023-10-14T12:18:47.506028+0000","last_peered":"2023-10-14T12:18:47.506028+0000","last_clean":"2023-10-14T12:18:47.506028+0000","last_became_active":"2023-10-14T12:18:47.501392+0000","last_became_peered":"2023-10-14T12:18:47.501392+0000","last_unstale":"2023-10-14T12:18:47.506028+0000","last_undegraded":"2023-10-14T12:18:47.506028+0000","last_fullsized":"2023-10-14T12:18:47.506028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500920+0000","last_change":"2023-10-14T12:18:47.510665+0000","last_active":"2023-10-14T12:18:48.500920+0000","last_peered":"2023-10-14T12:18:48.500920+0000","last_clean":"2023-10-14T12:18:48.500920+0000","last_became_active":"2023-10-14T12:18:47.510347+0000","last_became_peered":"2023-10-14T12:18:47.510347+0000","last_unstale":"2023-10-14T12:18:48.500920+0000","last_undegraded":"2023-10-14T12:18:48.500920+0000","last_fullsized":"2023-10-14T12:18:48.500920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651786+0000","last_change":"2023-10-14T12:18:47.497457+0000","last_active":"2023-10-14T12:18:48.651786+0000","last_peered":"2023-10-14T12:18:48.651786+0000","last_clean":"2023-10-14T12:18:48.651786+0000","last_became_active":"2023-10-14T12:18:47.497154+0000","last_became_peered":"2023-10-14T12:18:47.497154+0000","last_unstale":"2023-10-14T12:18:48.651786+0000","last_undegraded":"2023-10-14T12:18:48.651786+0000","last_fullsized":"2023-10-14T12:18:48.651786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444383+0000","last_change":"2023-10-14T12:18:47.509170+0000","last_active":"2023-10-14T12:18:49.444383+0000","last_peered":"2023-10-14T12:18:49.444383+0000","last_clean":"2023-10-14T12:18:49.444383+0000","last_became_active":"2023-10-14T12:18:47.508882+0000","last_became_peered":"2023-10-14T12:18:47.508882+0000","last_unstale":"2023-10-14T12:18:49.444383+0000","last_undegraded":"2023-10-14T12:18:49.444383+0000","last_fullsized":"2023-10-14T12:18:49.444383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500863+0000","last_change":"2023-10-14T12:18:47.505965+0000","last_active":"2023-10-14T12:18:48.500863+0000","last_peered":"2023-10-14T12:18:48.500863+0000","last_clean":"2023-10-14T12:18:48.500863+0000","last_became_active":"2023-10-14T12:18:47.505663+0000","last_became_peered":"2023-10-14T12:18:47.505663+0000","last_unstale":"2023-10-14T12:18:48.500863+0000","last_undegraded":"2023-10-14T12:18:48.500863+0000","last_fullsized":"2023-10-14T12:18:48.500863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500816+0000","last_change":"2023-10-14T12:18:47.503352+0000","last_active":"2023-10-14T12:18:48.500816+0000","last_peered":"2023-10-14T12:18:48.500816+0000","last_clean":"2023-10-14T12:18:48.500816+0000","last_became_active":"2023-10-14T12:18:47.502998+0000","last_became_peered":"2023-10-14T12:18:47.502998+0000","last_unstale":"2023-10-14T12:18:48.500816+0000","last_undegraded":"2023-10-14T12:18:48.500816+0000","last_fullsized":"2023-10-14T12:18:48.500816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.509290+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.508938+0000","last_became_peered":"2023-10-14T12:18:47.508938+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501012+0000","last_change":"2023-10-14T12:18:47.517756+0000","last_active":"2023-10-14T12:18:48.501012+0000","last_peered":"2023-10-14T12:18:48.501012+0000","last_clean":"2023-10-14T12:18:48.501012+0000","last_became_active":"2023-10-14T12:18:47.516277+0000","last_became_peered":"2023-10-14T12:18:47.516277+0000","last_unstale":"2023-10-14T12:18:48.501012+0000","last_undegraded":"2023-10-14T12:18:48.501012+0000","last_fullsized":"2023-10-14T12:18:48.501012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.519819+0000","last_change":"2023-10-14T12:18:47.518451+0000","last_active":"2023-10-14T12:18:47.519819+0000","last_peered":"2023-10-14T12:18:47.519819+0000","last_clean":"2023-10-14T12:18:47.519819+0000","last_became_active":"2023-10-14T12:18:47.518127+0000","last_became_peered":"2023-10-14T12:18:47.518127+0000","last_unstale":"2023-10-14T12:18:47.519819+0000","last_undegraded":"2023-10-14T12:18:47.519819+0000","last_fullsized":"2023-10-14T12:18:47.519819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444296+0000","last_change":"2023-10-14T12:18:47.510708+0000","last_active":"2023-10-14T12:18:49.444296+0000","last_peered":"2023-10-14T12:18:49.444296+0000","last_clean":"2023-10-14T12:18:49.444296+0000","last_became_active":"2023-10-14T12:18:47.510385+0000","last_became_peered":"2023-10-14T12:18:47.510385+0000","last_unstale":"2023-10-14T12:18:49.444296+0000","last_undegraded":"2023-10-14T12:18:49.444296+0000","last_fullsized":"2023-10-14T12:18:49.444296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:18:52.036 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T12:18:52.037 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T12:18:52.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T12:18:52.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T12:18:52.038 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T12:18:52.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.192+0000 7f9979ad2700 1 Processor -- start 2023-10-14T12:18:52.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 -- start start 2023-10-14T12:18:52.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9974160fb0 0x7f99740cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99740727b0 0x7f997406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f997406ad80 0x7f997406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997406b210 con 0x7f9974160fb0 2023-10-14T12:18:52.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9974161390 con 0x7f997406ad80 2023-10-14T12:18:52.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f9979ad2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b23f0 con 0x7f99740727b0 2023-10-14T12:18:52.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f99737fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9974160fb0 0x7f99740cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.193+0000 7f99737fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9974160fb0 0x7f99740cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38038/0 (socket says 172.21.15.32:38038) 2023-10-14T12:18:52.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 -- 172.21.15.32:0/1428869031 learned_addr learned my addr 172.21.15.32:0/1428869031 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:52.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f9972ffd700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99740727b0 0x7f997406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f9973fff700 1 --2- 172.21.15.32:0/1428869031 >> v2:172.21.15.92:3300/0 conn(0x7f997406ad80 0x7f997406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 -- 172.21.15.32:0/1428869031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99740727b0 msgr2=0x7f997406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:52.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99740727b0 0x7f997406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 -- 172.21.15.32:0/1428869031 >> v2:172.21.15.92:3300/0 conn(0x7f997406ad80 msgr2=0x7f997406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:52.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 --2- 172.21.15.32:0/1428869031 >> v2:172.21.15.92:3300/0 conn(0x7f997406ad80 0x7f997406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 -- 172.21.15.32:0/1428869031 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740b26b0 con 0x7f9974160fb0 2023-10-14T12:18:52.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f9973fff700 1 --2- 172.21.15.32:0/1428869031 >> v2:172.21.15.92:3300/0 conn(0x7f997406ad80 0x7f997406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:52.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f9972ffd700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99740727b0 0x7f997406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:52.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99737fe700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740cee40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9974072190 tx=0x7f9964009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d2a2e66c42da78 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99727fc700 1 -- 172.21.15.32:0/1428869031 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964005e30 con 0x7f9974160fb0 2023-10-14T12:18:52.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99727fc700 1 -- 172.21.15.32:0/1428869031 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964004030 con 0x7f9974160fb0 2023-10-14T12:18:52.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.194+0000 7f99727fc700 1 -- 172.21.15.32:0/1428869031 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640043e0 con 0x7f9974160fb0 2023-10-14T12:18:52.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 -- 172.21.15.32:0/1428869031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 msgr2=0x7f99740cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740cee40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9974072190 tx=0x7f9964009bd0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 -- 172.21.15.32:0/1428869031 shutdown_connections 2023-10-14T12:18:52.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 --2- 172.21.15.32:0/1428869031 >> v2:172.21.15.92:3300/0 conn(0x7f997406ad80 0x7f997406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740cee40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 --2- 172.21.15.32:0/1428869031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99740727b0 0x7f997406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 -- 172.21.15.32:0/1428869031 >> 172.21.15.32:0/1428869031 conn(0x7f99740cd270 msgr2=0x7f99740cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:52.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 -- 172.21.15.32:0/1428869031 shutdown_connections 2023-10-14T12:18:52.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.195+0000 7f9979ad2700 1 -- 172.21.15.32:0/1428869031 wait complete. 2023-10-14T12:18:52.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.196+0000 7f9979ad2700 1 Processor -- start 2023-10-14T12:18:52.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.196+0000 7f9979ad2700 1 -- start start 2023-10-14T12:18:52.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9979ad2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f997406ad80 0x7f99741f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9979ad2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99740727b0 0x7f99740b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9979ad2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9979ad2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b4cf0 con 0x7f9974160fb0 2023-10-14T12:18:52.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9979ad2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b40e0 con 0x7f99740727b0 2023-10-14T12:18:52.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9979ad2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b43c0 con 0x7f997406ad80 2023-10-14T12:18:52.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38048/0 (socket says 172.21.15.32:38048) 2023-10-14T12:18:52.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 -- 172.21.15.32:0/2741142520 learned_addr learned my addr 172.21.15.32:0/2741142520 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:52.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9972ffd700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99740727b0 0x7f99740b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f99737fe700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f997406ad80 0x7f99741f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 -- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f997406ad80 msgr2=0x7f99741f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f997406ad80 0x7f99741f28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 -- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99740727b0 msgr2=0x7f99740b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99740727b0 0x7f99740b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 -- 172.21.15.32:0/2741142520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964009500 con 0x7f9974160fb0 2023-10-14T12:18:52.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9972ffd700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99740727b0 0x7f99740b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:52.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.197+0000 7f9973fff700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740b5db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f996c00cef0 tx=0x7f996c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.198+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00add0 con 0x7f9974160fb0 2023-10-14T12:18:52.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.198+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c015440 con 0x7f9974160fb0 2023-10-14T12:18:52.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.198+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0157f0 con 0x7f9974160fb0 2023-10-14T12:18:52.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.198+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99740b46a0 con 0x7f9974160fb0 2023-10-14T12:18:52.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.198+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99741f2e30 con 0x7f9974160fb0 2023-10-14T12:18:52.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.199+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740b4ea0 con 0x7f9974160fb0 2023-10-14T12:18:52.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.199+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f996c00d430 con 0x7f9974160fb0 2023-10-14T12:18:52.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.199+0000 7f995bfff700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f996006af00 0x7f996006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.200+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f996c089ba0 con 0x7f9974160fb0 2023-10-14T12:18:52.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.200+0000 7f99737fe700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f996006af00 0x7f996006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.200+0000 7f99737fe700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f996006af00 0x7f996006d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9974072190 tx=0x7f9964008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.204+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99740b4ea0 con 0x7f9974160fb0 2023-10-14T12:18:52.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.474+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f99740b4ea0 con 0x7f9974160fb0 2023-10-14T12:18:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.477+0000 7f995bfff700 1 -- 172.21.15.32:0/2741142520 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171029 (secure 0 0 0) 0x7f99740b4ea0 con 0x7f9974160fb0 2023-10-14T12:18:52.481 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:52.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f996006af00 msgr2=0x7f996006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f996006af00 0x7f996006d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9974072190 tx=0x7f9964008070 comp rx=0 tx=0).stop 2023-10-14T12:18:52.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 msgr2=0x7f99740b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740b5db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f996c00cef0 tx=0x7f996c00a340 comp rx=0 tx=0).stop 2023-10-14T12:18:52.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 shutdown_connections 2023-10-14T12:18:52.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9974160fb0 0x7f99740b5db0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f997406ad80 0x7f99741f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f996006af00 0x7f996006d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 --2- 172.21.15.32:0/2741142520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99740727b0 0x7f99740b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.479+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 >> 172.21.15.32:0/2741142520 conn(0x7f99740cd270 msgr2=0x7f99740cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:52.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.480+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 shutdown_connections 2023-10-14T12:18:52.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.480+0000 7f9979ad2700 1 -- 172.21.15.32:0/2741142520 wait complete. 2023-10-14T12:18:52.494 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2571467497},{"type":"v1","addr":"172.21.15.92:6833","nonce":2571467497}]},"active_addr":"172.21.15.92:6833/2571467497","active_change":"2023-10-14T12:18:35.088982+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":587619545}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3014422927}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3154274983}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3313866112}]}]} 2023-10-14T12:18:52.498 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T12:18:52.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T12:18:52.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:52.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.622+0000 7f1d1979b700 1 Processor -- start 2023-10-14T12:18:52.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.622+0000 7f1d1979b700 1 -- start start 2023-10-14T12:18:52.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.622+0000 7f1d1979b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 0x7f1d141688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.622+0000 7f1d1979b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d140ccc20 con 0x7f1d1415eab0 2023-10-14T12:18:52.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.622+0000 7f1d1979b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1415ee90 con 0x7f1d140cf8a0 2023-10-14T12:18:52.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.622+0000 7f1d1979b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14158370 con 0x7f1d140d1d90 2023-10-14T12:18:52.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d12ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1d1415eab0 0x7f1d140cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55076/0 (socket says 172.21.15.32:55076) 2023-10-14T12:18:52.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d12ffd700 1 -- 172.21.15.32:0/3019057254 learned_addr learned my addr 172.21.15.32:0/3019057254 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:52.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d137fe700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 0x7f1d141688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497234371 0 0) 0x7f1d140ccc20 con 0x7f1d1415eab0 2023-10-14T12:18:52.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cfc0035b0 con 0x7f1d1415eab0 2023-10-14T12:18:52.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095030496 0 0) 0x7f1cfc0035b0 con 0x7f1d1415eab0 2023-10-14T12:18:52.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 msgr2=0x7f1d141688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:52.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 0x7f1d141688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 >> v1:172.21.15.92:6789/0 conn(0x7f1d140cf8a0 legacy=0x7f1d140d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d140d23b0 con 0x7f1d1415eab0 2023-10-14T12:18:52.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f1d04001670 con 0x7f1d1415eab0 2023-10-14T12:18:52.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 >> v1:172.21.15.32:6789/0 conn(0x7f1d1415eab0 legacy=0x7f1d140cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cfc003a30 0x7f1cfc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1cfc0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 0x7f1cfc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14158370 con 0x7f1cfc004400 2023-10-14T12:18:52.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc00ba70 con 0x7f1cfc003a30 2023-10-14T12:18:52.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc00bc30 con 0x7f1d140d1d90 2023-10-14T12:18:52.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d127fc700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1cfc0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d12ffd700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cfc003a30 0x7f1cfc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.623+0000 7f1d137fe700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 0x7f1cfc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d127fc700 1 -- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 msgr2=0x7f1cfc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:52.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d127fc700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d140d1d90 0x7f1cfc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d127fc700 1 -- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cfc003a30 msgr2=0x7f1cfc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:52.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d127fc700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cfc003a30 0x7f1cfc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d127fc700 1 -- 172.21.15.32:0/3019057254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0035b0 con 0x7f1cfc004400 2023-10-14T12:18:52.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d127fc700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1cfc0048d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d08001980 tx=0x7f1cfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6bcac8a9eedf87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08016070 con 0x7f1cfc004400 2023-10-14T12:18:52.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08006860 con 0x7f1cfc004400 2023-10-14T12:18:52.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d11ffb700 1 -- 172.21.15.32:0/3019057254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08001420 con 0x7f1cfc004400 2023-10-14T12:18:52.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d1979b700 1 -- 172.21.15.32:0/3019057254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 msgr2=0x7f1cfc0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d1979b700 1 --2- 172.21.15.32:0/3019057254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1cfc0048d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d08001980 tx=0x7f1cfc005880 comp rx=0 tx=0).stop 2023-10-14T12:18:52.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d137fe700 1 -- 172.21.15.32:0/3019057254 reap_dead start 2023-10-14T12:18:52.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d1979b700 1 -- 172.21.15.32:0/3019057254 shutdown_connections 2023-10-14T12:18:52.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d1979b700 1 -- 172.21.15.32:0/3019057254 >> 172.21.15.32:0/3019057254 conn(0x7f1d140665a0 msgr2=0x7f1d14066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:52.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d1979b700 1 -- 172.21.15.32:0/3019057254 shutdown_connections 2023-10-14T12:18:52.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.624+0000 7f1d1979b700 1 -- 172.21.15.32:0/3019057254 wait complete. 2023-10-14T12:18:52.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.626+0000 7f1d1979b700 1 Processor -- start 2023-10-14T12:18:52.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.626+0000 7f1d1979b700 1 -- start start 2023-10-14T12:18:52.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1d14157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d14161010 0x7f1d140cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d140b0320 0x7f1d140b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14161490 con 0x7f1cfc004400 2023-10-14T12:18:52.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1415ee90 con 0x7f1d140b0320 2023-10-14T12:18:52.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140ccbf0 con 0x7f1d14161010 2023-10-14T12:18:52.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1d14157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1d14157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38064/0 (socket says 172.21.15.32:38064) 2023-10-14T12:18:52.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 -- 172.21.15.32:0/2949663706 learned_addr learned my addr 172.21.15.32:0/2949663706 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:52.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d137fe700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d140b0320 0x7f1d140b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 -- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d14161010 msgr2=0x7f1d140cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d14161010 0x7f1d140cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 -- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d140b0320 msgr2=0x7f1d140b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d140b0320 0x7f1d140b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 -- 172.21.15.32:0/2949663706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d141616a0 con 0x7f1cfc004400 2023-10-14T12:18:52.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d137fe700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d140b0320 0x7f1d140b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:52.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d12ffd700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1d14157bc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d040072c0 tx=0x7f1d040075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400f5e0 con 0x7f1cfc004400 2023-10-14T12:18:52.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0400f760 con 0x7f1cfc004400 2023-10-14T12:18:52.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400fb10 con 0x7f1cfc004400 2023-10-14T12:18:52.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d14161980 con 0x7f1cfc004400 2023-10-14T12:18:52.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.627+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1415f0e0 con 0x7f1cfc004400 2023-10-14T12:18:52.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.628+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d140b7540 con 0x7f1cfc004400 2023-10-14T12:18:52.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.629+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d0400fc70 con 0x7f1cfc004400 2023-10-14T12:18:52.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.629+0000 7f1cfb7fe700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d0006af00 0x7f1d0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.629+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d04089540 con 0x7f1cfc004400 2023-10-14T12:18:52.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.629+0000 7f1d127fc700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d0006af00 0x7f1d0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.630+0000 7f1d127fc700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d0006af00 0x7f1d0006d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d141f6560 tx=0x7f1d08011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.634+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d040545f0 con 0x7f1cfc004400 2023-10-14T12:18:52.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.833+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d140b3d70 con 0x7f1cfc004400 2023-10-14T12:18:52.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.835+0000 7f1cfb7fe700 1 -- 172.21.15.32:0/2949663706 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1d04057c10 con 0x7f1cfc004400 2023-10-14T12:18:52.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:52.837 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d0006af00 msgr2=0x7f1d0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d0006af00 0x7f1d0006d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d141f6560 tx=0x7f1d08011000 comp rx=0 tx=0).stop 2023-10-14T12:18:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 msgr2=0x7f1d14157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1d14157bc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d040072c0 tx=0x7f1d040075d0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 shutdown_connections 2023-10-14T12:18:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d0006af00 0x7f1d0006d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d140b0320 0x7f1d140b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cfc004400 0x7f1d14157bc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 --2- 172.21.15.32:0/2949663706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d14161010 0x7f1d140cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 >> 172.21.15.32:0/2949663706 conn(0x7f1d140665a0 msgr2=0x7f1d140b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 shutdown_connections 2023-10-14T12:18:52.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.837+0000 7f1d1979b700 1 -- 172.21.15.32:0/2949663706 wait complete. 2023-10-14T12:18:52.852 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T12:18:52.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:52.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.975+0000 7f427ee62700 1 Processor -- start 2023-10-14T12:18:52.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.975+0000 7f427ee62700 1 -- start start 2023-10-14T12:18:52.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427ee62700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f427815dbc0 0x7f427815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427ee62700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f42780b7050 0x7f42780d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427ee62700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427815e4e0 con 0x7f42780d3fc0 2023-10-14T12:18:52.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427ee62700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780b7560 con 0x7f42780b7050 2023-10-14T12:18:52.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427ee62700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780b7840 con 0x7f427815dbc0 2023-10-14T12:18:52.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f42780b7050 0x7f42780d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f42780b7050 0x7f42780d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38076/0 (socket says 172.21.15.32:38076) 2023-10-14T12:18:52.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 -- 172.21.15.32:0/3909294262 learned_addr learned my addr 172.21.15.32:0/3909294262 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:52.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427cbfe700 1 --2- 172.21.15.32:0/3909294262 >> v2:172.21.15.92:3300/0 conn(0x7f427815dbc0 0x7f427815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 -- 172.21.15.32:0/3909294262 >> v2:172.21.15.92:3300/0 conn(0x7f427815dbc0 msgr2=0x7f427815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:52.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 --2- 172.21.15.32:0/3909294262 >> v2:172.21.15.92:3300/0 conn(0x7f427815dbc0 0x7f427815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 -- 172.21.15.32:0/3909294262 >> v1:172.21.15.92:6789/0 conn(0x7f42780d3fc0 legacy=0x7f42780d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 -- 172.21.15.32:0/3909294262 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780b7b20 con 0x7f42780b7050 2023-10-14T12:18:52.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f427d3ff700 1 --2- 172.21.15.32:0/3909294262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780b7050 0x7f42780d21d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4278072db0 tx=0x7f427000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb039d6388a3d0e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f42777fe700 1 -- 172.21.15.32:0/3909294262 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000e070 con 0x7f42780b7050 2023-10-14T12:18:52.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f42777fe700 1 -- 172.21.15.32:0/3909294262 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000b910 con 0x7f42780b7050 2023-10-14T12:18:52.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.977+0000 7f42777fe700 1 -- 172.21.15.32:0/3909294262 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000bcc0 con 0x7f42780b7050 2023-10-14T12:18:52.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 -- 172.21.15.32:0/3909294262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780b7050 msgr2=0x7f42780d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 --2- 172.21.15.32:0/3909294262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780b7050 0x7f42780d21d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4278072db0 tx=0x7f427000b330 comp rx=0 tx=0).stop 2023-10-14T12:18:52.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 -- 172.21.15.32:0/3909294262 shutdown_connections 2023-10-14T12:18:52.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 --2- 172.21.15.32:0/3909294262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780b7050 0x7f42780d21d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 --2- 172.21.15.32:0/3909294262 >> v2:172.21.15.92:3300/0 conn(0x7f427815dbc0 0x7f427815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 -- 172.21.15.32:0/3909294262 >> 172.21.15.32:0/3909294262 conn(0x7f427809cb40 msgr2=0x7f42780d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:52.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 -- 172.21.15.32:0/3909294262 shutdown_connections 2023-10-14T12:18:52.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.978+0000 7f427ee62700 1 -- 172.21.15.32:0/3909294262 wait complete. 2023-10-14T12:18:52.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.980+0000 7f427ee62700 1 Processor -- start 2023-10-14T12:18:52.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.980+0000 7f427ee62700 1 -- start start 2023-10-14T12:18:52.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427ee62700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42780b7050 0x7f42780b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427ee62700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 0x7f427815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427ee62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f427815dbc0 0x7f42780a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427ee62700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781f6230 con 0x7f42780d3fc0 2023-10-14T12:18:52.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427ee62700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781f64d0 con 0x7f42780b7050 2023-10-14T12:18:52.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427ee62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42781f67b0 con 0x7f427815dbc0 2023-10-14T12:18:52.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 0x7f427815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 0x7f427815b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38080/0 (socket says 172.21.15.32:38080) 2023-10-14T12:18:52.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 -- 172.21.15.32:0/176192659 learned_addr learned my addr 172.21.15.32:0/176192659 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:52.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427cbfe700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42780b7050 0x7f42780b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f427d3ff700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f427815dbc0 0x7f42780a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 -- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f427815dbc0 msgr2=0x7f42780a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f427815dbc0 0x7f42780a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 -- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42780b7050 msgr2=0x7f42780b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:52.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42780b7050 0x7f42780b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:52.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 -- 172.21.15.32:0/176192659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009b30 con 0x7f42780d3fc0 2023-10-14T12:18:52.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.981+0000 7f4277fff700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 0x7f427815b380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f426000c4e0 tx=0x7f426000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.982+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600052d0 con 0x7f42780d3fc0 2023-10-14T12:18:52.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.982+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260005430 con 0x7f42780d3fc0 2023-10-14T12:18:52.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.982+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42781f6a90 con 0x7f42780d3fc0 2023-10-14T12:18:52.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.982+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600038c0 con 0x7f42780d3fc0 2023-10-14T12:18:52.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.982+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427815b8c0 con 0x7f42780d3fc0 2023-10-14T12:18:52.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.983+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427809f680 con 0x7f42780d3fc0 2023-10-14T12:18:52.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.983+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4260003a20 con 0x7f42780d3fc0 2023-10-14T12:18:52.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.983+0000 7f42757fa700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f425806af00 0x7f425806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:52.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.983+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4260088a30 con 0x7f42780d3fc0 2023-10-14T12:18:52.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.984+0000 7f427cbfe700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f425806af00 0x7f425806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:52.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.984+0000 7f427cbfe700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f425806af00 0x7f425806d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4268009b20 tx=0x7f42680091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:52.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:52.988+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f427809f680 con 0x7f42780d3fc0 2023-10-14T12:18:53.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.189+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f427809f680 con 0x7f42780d3fc0 2023-10-14T12:18:53.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.190+0000 7f42757fa700 1 -- 172.21.15.32:0/176192659 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f427809f680 con 0x7f42780d3fc0 2023-10-14T12:18:53.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:53.195 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:53.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.192+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f425806af00 msgr2=0x7f425806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.192+0000 7f427ee62700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f425806af00 0x7f425806d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4268009b20 tx=0x7f42680091c0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 msgr2=0x7f427815b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 0x7f427815b380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f426000c4e0 tx=0x7f426000c7f0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 shutdown_connections 2023-10-14T12:18:53.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f427815dbc0 0x7f42780a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f425806af00 0x7f425806d3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42780b7050 0x7f42780b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 --2- 172.21.15.32:0/176192659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42780d3fc0 0x7f427815b380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 >> 172.21.15.32:0/176192659 conn(0x7f427809cb40 msgr2=0x7f42780b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 shutdown_connections 2023-10-14T12:18:53.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.193+0000 7f427ee62700 1 -- 172.21.15.32:0/176192659 wait complete. 2023-10-14T12:18:53.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T12:18:53.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T12:18:53.209 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T12:18:53.209 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T12:18:53.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T12:18:53.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T12:18:53.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T12:18:53.212 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T12:18:53.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.428+0000 7f9bf2a60700 1 Processor -- start 2023-10-14T12:18:53.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.428+0000 7f9bf2a60700 1 -- start start 2023-10-14T12:18:53.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf2a60700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9bec15ddc0 0x7f9bec161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf2a60700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec167b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf2a60700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0ce350 con 0x7f9bec15d9e0 2023-10-14T12:18:53.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf2a60700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec1621f0 con 0x7f9bec15ddc0 2023-10-14T12:18:53.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf2a60700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0b5140 con 0x7f9bec161d40 2023-10-14T12:18:53.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf0ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec167b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf0ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec167b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43778/0 (socket says 172.21.15.32:43778) 2023-10-14T12:18:53.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf0ffd700 1 -- 172.21.15.32:0/1646099939 learned_addr learned my addr 172.21.15.32:0/1646099939 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.428+0000 7ff02f479700 1 Processor -- start 2023-10-14T12:18:53.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.429+0000 7ff02f479700 1 -- start start 2023-10-14T12:18:53.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7ff02f479700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0280cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7ff02f479700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0280ced00 0x7ff02806d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7ff02f479700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280cf1d0 con 0x7ff02806d390 2023-10-14T12:18:53.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7ff02f479700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02806dd80 con 0x7ff0280ced00 2023-10-14T12:18:53.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7ff02f479700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff028072200 con 0x7ff02815a280 2023-10-14T12:18:53.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf0ffd700 1 -- 172.21.15.32:0/1646099939 >> v2:172.21.15.92:3300/0 conn(0x7f9bec15ddc0 msgr2=0x7f9bec161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf0ffd700 1 --2- 172.21.15.32:0/1646099939 >> v2:172.21.15.92:3300/0 conn(0x7f9bec15ddc0 0x7f9bec161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.430+0000 7f9bf0ffd700 1 -- 172.21.15.32:0/1646099939 >> v1:172.21.15.32:6789/0 conn(0x7f9bec15d9e0 legacy=0x7f9bec0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7f9bf0ffd700 1 -- 172.21.15.32:0/1646099939 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec162630 con 0x7f9bec161d40 2023-10-14T12:18:53.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7f9bf0ffd700 1 --2- 172.21.15.32:0/1646099939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec167b30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009e50 tx=0x7f9be400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9bb0fd2492dc3fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7ff02ca14700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff02806d390 0x7ff0280ce5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55120/0 (socket says 172.21.15.32:55120) 2023-10-14T12:18:53.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7ff02ca14700 1 -- 172.21.15.32:0/3156495539 learned_addr learned my addr 172.21.15.32:0/3156495539 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7ff02da16700 1 --2- 172.21.15.32:0/3156495539 >> v2:172.21.15.32:3300/0 conn(0x7ff0280ced00 0x7ff02806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7ff01ffff700 1 -- 172.21.15.32:0/3156495539 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458028260 0 0) 0x7ff0280cf1d0 con 0x7ff02806d390 2023-10-14T12:18:53.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.431+0000 7ff01ffff700 1 -- 172.21.15.32:0/3156495539 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0140035b0 con 0x7ff02806d390 2023-10-14T12:18:53.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff02da16700 1 -- 172.21.15.32:0/3156495539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 msgr2=0x7ff0280cbd70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:18:53.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff02da16700 1 --2- 172.21.15.32:0/3156495539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0280cbd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff02da16700 1 -- 172.21.15.32:0/3156495539 >> v1:172.21.15.32:6789/0 conn(0x7ff02806d390 legacy=0x7ff0280ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff01ffff700 1 -- 172.21.15.32:0/3156495539 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935850837 0 0) 0x7ff0140035b0 con 0x7ff02806d390 2023-10-14T12:18:53.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff02da16700 1 -- 172.21.15.32:0/3156495539 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280cafb0 con 0x7ff0280ced00 2023-10-14T12:18:53.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff02da16700 1 --2- 172.21.15.32:0/3156495539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0280ced00 0x7ff02806d840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff02000bfa0 tx=0x7ff02000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2692a4e032fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff01ffff700 1 -- 172.21.15.32:0/3156495539 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020010070 con 0x7ff0280ced00 2023-10-14T12:18:53.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff01ffff700 1 -- 172.21.15.32:0/3156495539 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff020003a20 con 0x7ff0280ced00 2023-10-14T12:18:53.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.432+0000 7ff01ffff700 1 -- 172.21.15.32:0/3156495539 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018001670 con 0x7ff0280ced00 2023-10-14T12:18:53.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.433+0000 7ff02f479700 1 -- 172.21.15.32:0/3156495539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0280ced00 msgr2=0x7ff02806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.433+0000 7ff02f479700 1 --2- 172.21.15.32:0/3156495539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0280ced00 0x7ff02806d840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff02000bfa0 tx=0x7ff02000d330 comp rx=0 tx=0).stop 2023-10-14T12:18:53.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7ff02f479700 1 -- 172.21.15.32:0/3156495539 shutdown_connections 2023-10-14T12:18:53.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7ff02f479700 1 --2- 172.21.15.32:0/3156495539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0280ced00 0x7ff02806d840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7ff02f479700 1 --2- 172.21.15.32:0/3156495539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0280cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7ff02f479700 1 -- 172.21.15.32:0/3156495539 >> 172.21.15.32:0/3156495539 conn(0x7ff0280cfc40 msgr2=0x7ff0280d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.433+0000 7f9beaffd700 1 -- 172.21.15.32:0/1646099939 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400e070 con 0x7f9bec161d40 2023-10-14T12:18:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.433+0000 7f9beaffd700 1 -- 172.21.15.32:0/1646099939 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400b9c0 con 0x7f9bec161d40 2023-10-14T12:18:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.433+0000 7f9beaffd700 1 -- 172.21.15.32:0/1646099939 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400bd70 con 0x7f9bec161d40 2023-10-14T12:18:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f9bf2a60700 1 -- 172.21.15.32:0/1646099939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 msgr2=0x7f9bec167b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f9bf2a60700 1 --2- 172.21.15.32:0/1646099939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec167b30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009e50 tx=0x7f9be400b330 comp rx=0 tx=0).stop 2023-10-14T12:18:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7ff02f479700 1 -- 172.21.15.32:0/3156495539 shutdown_connections 2023-10-14T12:18:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f9bf2a60700 1 -- 172.21.15.32:0/1646099939 shutdown_connections 2023-10-14T12:18:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f9bf2a60700 1 --2- 172.21.15.32:0/1646099939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec167b30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f9bf2a60700 1 --2- 172.21.15.32:0/1646099939 >> v2:172.21.15.92:3300/0 conn(0x7f9bec15ddc0 0x7f9bec161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f9bf2a60700 1 -- 172.21.15.32:0/1646099939 >> 172.21.15.32:0/1646099939 conn(0x7f9bec09cb40 msgr2=0x7f9bec0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7ff02f479700 1 -- 172.21.15.32:0/3156495539 wait complete. 2023-10-14T12:18:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f0af1a7b700 1 Processor -- start 2023-10-14T12:18:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.434+0000 7f0af1a7b700 1 -- start start 2023-10-14T12:18:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0af1a7b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0aec15da70 0x7f0aec0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0af1a7b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0ce360 con 0x7f0aec06d0c0 2023-10-14T12:18:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0af1a7b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0cd790 con 0x7f0aec0ccfc0 2023-10-14T12:18:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0af1a7b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec0cf040 con 0x7f0aec15da70 2023-10-14T12:18:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0aeaffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0aec0ccfc0 0x7f0aec06c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:53998/0 (socket says 172.21.15.32:53998) 2023-10-14T12:18:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0aeaffd700 1 -- 172.21.15.32:0/1997920862 learned_addr learned my addr 172.21.15.32:0/1997920862 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0aeb7fe700 1 --2- 172.21.15.32:0/1997920862 >> v2:172.21.15.32:3300/0 conn(0x7f0aec15da70 0x7f0aec0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.435+0000 7fab21214700 1 Processor -- start 2023-10-14T12:18:53.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.435+0000 7ff02f479700 1 Processor -- start 2023-10-14T12:18:53.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0bcf34c700 1 Processor -- start 2023-10-14T12:18:53.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.435+0000 7fab21214700 1 -- start start 2023-10-14T12:18:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7fab21214700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab1c162050 0x7fab1c09cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7fab21214700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab1c0c2340 0x7fab1c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7fab21214700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c06e800 con 0x7fab1c0cd270 2023-10-14T12:18:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7fab21214700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0cd9e0 con 0x7fab1c0c2340 2023-10-14T12:18:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.435+0000 7ff02f479700 1 -- start start 2023-10-14T12:18:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7ff02f479700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02806d390 0x7ff0280c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7ff02f479700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0280ced00 0x7ff0280c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7ff02f479700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0281f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7fab21214700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0c2c90 con 0x7fab1c162050 2023-10-14T12:18:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7ff02f479700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280c5420 con 0x7ff02806d390 2023-10-14T12:18:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7ff02f479700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280c5700 con 0x7ff0280ced00 2023-10-14T12:18:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7ff02f479700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280c59e0 con 0x7ff02815a280 2023-10-14T12:18:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7fab1ad9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab1c162050 0x7fab1c09cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab1c162050 0x7fab1c09cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42374/0 (socket says 172.21.15.32:42374) 2023-10-14T12:18:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 -- 172.21.15.32:0/2565684281 learned_addr learned my addr 172.21.15.32:0/2565684281 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1b59e700 1 --2- 172.21.15.32:0/2565684281 >> v2:172.21.15.32:3300/0 conn(0x7fab1c0c2340 0x7fab1c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0aea7fc700 1 -- 172.21.15.32:0/1997920862 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231561842 0 0) 0x7f0aec0cd790 con 0x7f0aec0ccfc0 2023-10-14T12:18:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aea7fc700 1 -- 172.21.15.32:0/1997920862 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad40035b0 con 0x7f0aec0ccfc0 2023-10-14T12:18:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02da16700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0281f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02da16700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0281f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43804/0 (socket says 172.21.15.32:43804) 2023-10-14T12:18:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02da16700 1 -- 172.21.15.32:0/3047709306 learned_addr learned my addr 172.21.15.32:0/3047709306 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aea7fc700 1 -- 172.21.15.32:0/1997920862 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670783259 0 0) 0x7f0ad40035b0 con 0x7f0aec0ccfc0 2023-10-14T12:18:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aeb7fe700 1 -- 172.21.15.32:0/1997920862 >> v1:172.21.15.92:6789/0 conn(0x7f0aec0ccfc0 legacy=0x7f0aec06c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aeb7fe700 1 -- 172.21.15.32:0/1997920862 >> v1:172.21.15.32:6789/0 conn(0x7f0aec06d0c0 legacy=0x7f0aec161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aeb7fe700 1 -- 172.21.15.32:0/1997920862 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0cda30 con 0x7f0aec15da70 2023-10-14T12:18:53.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 -- 172.21.15.32:0/2565684281 >> v2:172.21.15.32:3300/0 conn(0x7fab1c0c2340 msgr2=0x7fab1c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 --2- 172.21.15.32:0/2565684281 >> v2:172.21.15.32:3300/0 conn(0x7fab1c0c2340 0x7fab1c0c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 -- 172.21.15.32:0/2565684281 >> v1:172.21.15.32:6789/0 conn(0x7fab1c0cd270 legacy=0x7fab1c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aeb7fe700 1 --2- 172.21.15.32:0/1997920862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 0x7f0aec0ca660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0097c0 tx=0x7f0adc009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaec2558bf7f90d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 -- 172.21.15.32:0/2565684281 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c06e280 con 0x7fab1c162050 2023-10-14T12:18:53.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02d215700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02806d390 0x7ff0280c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.436+0000 7f0bcf34c700 1 -- start start 2023-10-14T12:18:53.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0bcf34c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80c27d0 0x7f0bc80ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0bcf34c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0bc80ca150 0x7f0bc80b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0bcf34c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc8165e40 con 0x7f0bc80b0e70 2023-10-14T12:18:53.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0bcf34c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80cdbe0 con 0x7f0bc80ca150 2023-10-14T12:18:53.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0bcf34c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80b1830 con 0x7f0bc80c27d0 2023-10-14T12:18:53.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab1ad9d700 1 --2- 172.21.15.32:0/2565684281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c162050 0x7fab1c09cd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0cff10 tx=0x7fab0c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68d4a56a9e1f040f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02d215700 1 -- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 msgr2=0x7ff0281f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02d215700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff02815a280 0x7ff0281f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02d215700 1 -- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0280ced00 msgr2=0x7ff0280c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02ca14700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0280ced00 0x7ff0280c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aea7fc700 1 -- 172.21.15.32:0/1997920862 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0001670 con 0x7f0aec15da70 2023-10-14T12:18:53.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aea7fc700 1 -- 172.21.15.32:0/1997920862 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc004030 con 0x7f0aec15da70 2023-10-14T12:18:53.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7fab19d9b700 1 -- 172.21.15.32:0/2565684281 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c011830 con 0x7fab1c162050 2023-10-14T12:18:53.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7f0aea7fc700 1 -- 172.21.15.32:0/1997920862 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0043c0 con 0x7f0aec15da70 2023-10-14T12:18:53.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd8e9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0bc80ca150 0x7f0bc80b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcc8e7700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0bc80b0e70 0x7f0bc80c9a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54018/0 (socket says 172.21.15.32:54018) 2023-10-14T12:18:53.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcc8e7700 1 -- 172.21.15.32:0/300281987 learned_addr learned my addr 172.21.15.32:0/300281987 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd0e8700 1 --2- 172.21.15.32:0/300281987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80c27d0 0x7f0bc80ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7fab19d9b700 1 -- 172.21.15.32:0/2565684281 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c011990 con 0x7fab1c162050 2023-10-14T12:18:53.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7fab19d9b700 1 -- 172.21.15.32:0/2565684281 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c011d20 con 0x7fab1c162050 2023-10-14T12:18:53.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02d215700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0280ced00 0x7ff0280c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02d215700 1 -- 172.21.15.32:0/3047709306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02000bc80 con 0x7ff02806d390 2023-10-14T12:18:53.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.437+0000 7ff02ca14700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0280ced00 0x7ff0280c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:53.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7ff02d215700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02806d390 0x7ff0280c64c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff024006fd0 tx=0x7ff02400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd0e8700 1 -- 172.21.15.32:0/300281987 >> v2:172.21.15.92:3300/0 conn(0x7f0bc80ca150 msgr2=0x7f0bc80b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd0e8700 1 --2- 172.21.15.32:0/300281987 >> v2:172.21.15.92:3300/0 conn(0x7f0bc80ca150 0x7f0bc80b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd0e8700 1 -- 172.21.15.32:0/300281987 >> v1:172.21.15.92:6789/0 conn(0x7f0bc80b0e70 legacy=0x7f0bc80c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd0e8700 1 -- 172.21.15.32:0/300281987 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80cd560 con 0x7f0bc80c27d0 2023-10-14T12:18:53.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024011830 con 0x7ff02806d390 2023-10-14T12:18:53.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0240119b0 con 0x7ff02806d390 2023-10-14T12:18:53.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024011d60 con 0x7ff02806d390 2023-10-14T12:18:53.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bcd0e8700 1 --2- 172.21.15.32:0/300281987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80c27d0 0x7f0bc80ce000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009840 tx=0x7f0bc4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e997aad4241899 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0af1a7b700 1 -- 172.21.15.32:0/1997920862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 msgr2=0x7f0aec0ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0af1a7b700 1 --2- 172.21.15.32:0/1997920862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 0x7f0aec0ca660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0097c0 tx=0x7f0adc009ad0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.438+0000 7f0bbffff700 1 -- 172.21.15.32:0/300281987 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011830 con 0x7f0bc80c27d0 2023-10-14T12:18:53.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7fab21214700 1 -- 172.21.15.32:0/2565684281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c162050 msgr2=0x7fab1c09cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7fab21214700 1 --2- 172.21.15.32:0/2565684281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c162050 0x7fab1c09cd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0cff10 tx=0x7fab0c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7fab21214700 1 -- 172.21.15.32:0/2565684281 shutdown_connections 2023-10-14T12:18:53.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7fab21214700 1 --2- 172.21.15.32:0/2565684281 >> v2:172.21.15.32:3300/0 conn(0x7fab1c0c2340 0x7fab1c0c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7fab21214700 1 --2- 172.21.15.32:0/2565684281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c162050 0x7fab1c09cd00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7fab21214700 1 -- 172.21.15.32:0/2565684281 >> 172.21.15.32:0/2565684281 conn(0x7fab1c06aa20 msgr2=0x7fab1c06ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7f9bf2a60700 1 -- 172.21.15.32:0/1646099939 shutdown_connections 2023-10-14T12:18:53.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7f0bbffff700 1 -- 172.21.15.32:0/300281987 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4011990 con 0x7f0bc80c27d0 2023-10-14T12:18:53.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.439+0000 7f0bbffff700 1 -- 172.21.15.32:0/300281987 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011d00 con 0x7f0bc80c27d0 2023-10-14T12:18:53.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0af1a7b700 1 -- 172.21.15.32:0/1997920862 shutdown_connections 2023-10-14T12:18:53.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0af1a7b700 1 --2- 172.21.15.32:0/1997920862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 0x7f0aec0ca660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0af1a7b700 1 -- 172.21.15.32:0/1997920862 >> 172.21.15.32:0/1997920862 conn(0x7f0aec0cf3f0 msgr2=0x7f0aec0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7fab21214700 1 -- 172.21.15.32:0/2565684281 shutdown_connections 2023-10-14T12:18:53.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7fab21214700 1 -- 172.21.15.32:0/2565684281 wait complete. 2023-10-14T12:18:53.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f9bf2a60700 1 -- 172.21.15.32:0/1646099939 wait complete. 2023-10-14T12:18:53.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0280c5cc0 con 0x7ff02806d390 2023-10-14T12:18:53.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0280c6a00 con 0x7ff02806d390 2023-10-14T12:18:53.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0bcf34c700 1 -- 172.21.15.32:0/300281987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80c27d0 msgr2=0x7f0bc80ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0bcf34c700 1 --2- 172.21.15.32:0/300281987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80c27d0 0x7f0bc80ce000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009840 tx=0x7f0bc4009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:53.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0bcf34c700 1 -- 172.21.15.32:0/300281987 shutdown_connections 2023-10-14T12:18:53.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0bcf34c700 1 --2- 172.21.15.32:0/300281987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80c27d0 0x7f0bc80ce000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0bcf34c700 1 --2- 172.21.15.32:0/300281987 >> v2:172.21.15.92:3300/0 conn(0x7f0bc80ca150 0x7f0bc80b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0bcf34c700 1 -- 172.21.15.32:0/300281987 >> 172.21.15.32:0/300281987 conn(0x7f0bc806afb0 msgr2=0x7f0bc80cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.441+0000 7f0bcf34c700 1 -- 172.21.15.32:0/300281987 shutdown_connections 2023-10-14T12:18:53.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.440+0000 7f0af1a7b700 1 -- 172.21.15.32:0/1997920862 shutdown_connections 2023-10-14T12:18:53.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.441+0000 7f0af1a7b700 1 -- 172.21.15.32:0/1997920862 wait complete. 2023-10-14T12:18:53.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.441+0000 7f9bf2a60700 1 Processor -- start 2023-10-14T12:18:53.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.441+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0280c5870 con 0x7ff02806d390 2023-10-14T12:18:53.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.441+0000 7f0bcf34c700 1 -- 172.21.15.32:0/300281987 wait complete. 2023-10-14T12:18:53.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f0bcf34c700 1 Processor -- start 2023-10-14T12:18:53.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7fab21214700 1 Processor -- start 2023-10-14T12:18:53.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f0af1a7b700 1 Processor -- start 2023-10-14T12:18:53.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.442+0000 7f9bf2a60700 1 -- start start 2023-10-14T12:18:53.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bf2a60700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec15d9e0 0x7f9bec0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bf2a60700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bec15ddc0 0x7f9bec15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bf2a60700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bf2a60700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15b340 con 0x7f9bec15ddc0 2023-10-14T12:18:53.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bf2a60700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0cae80 con 0x7f9bec15d9e0 2023-10-14T12:18:53.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bf2a60700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0cb160 con 0x7f9bec161d40 2023-10-14T12:18:53.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec15d9e0 0x7f9bec0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9beb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bec15ddc0 0x7f9bec15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec15d9e0 0x7f9bec0ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42390/0 (socket says 172.21.15.32:42390) 2023-10-14T12:18:53.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9bebfff700 1 -- 172.21.15.32:0/943260105 learned_addr learned my addr 172.21.15.32:0/943260105 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f9beb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bec15ddc0 0x7f9bec15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38124/0 (socket says 172.21.15.32:38124) 2023-10-14T12:18:53.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9bebfff700 1 -- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 msgr2=0x7f9bec0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9bebfff700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec161d40 0x7f9bec0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9bebfff700 1 -- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bec15ddc0 msgr2=0x7f9bec15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9bebfff700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9bec15ddc0 0x7f9bec15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9bebfff700 1 -- 172.21.15.32:0/943260105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009b30 con 0x7f9bec15d9e0 2023-10-14T12:18:53.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9bebfff700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec15d9e0 0x7f9bec0ca8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c510 tx=0x7f9bdc00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0052d0 con 0x7f9bec15d9e0 2023-10-14T12:18:53.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc005430 con 0x7f9bec15d9e0 2023-10-14T12:18:53.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0038c0 con 0x7f9bec15d9e0 2023-10-14T12:18:53.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7fab21214700 1 -- start start 2023-10-14T12:18:53.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab21214700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab1c0c2340 0x7fab1c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab21214700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0cd270 0x7fab1c0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab21214700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c162050 0x7fab1c0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab21214700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0c3070 con 0x7fab1c162050 2023-10-14T12:18:53.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab21214700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c15ee80 con 0x7fab1c0cd270 2023-10-14T12:18:53.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab21214700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cb0c0 con 0x7fab1c0c2340 2023-10-14T12:18:53.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab1b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c162050 0x7fab1c0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab1b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c162050 0x7fab1c0c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38132/0 (socket says 172.21.15.32:38132) 2023-10-14T12:18:53.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7fab1b59e700 1 -- 172.21.15.32:0/514717367 learned_addr learned my addr 172.21.15.32:0/514717367 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f0af1a7b700 1 -- start start 2023-10-14T12:18:53.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0af1a7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec06d0c0 0x7f0aec1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0af1a7b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0aec0ccfc0 0x7f0aec0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0af1a7b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 0x7f0aec1fac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0af1a7b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0b3a70 con 0x7f0aec15da70 2023-10-14T12:18:53.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0af1a7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0b1de0 con 0x7f0aec06d0c0 2023-10-14T12:18:53.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0af1a7b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0b3cc0 con 0x7f0aec0ccfc0 2023-10-14T12:18:53.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0aec0ccfc0 0x7f0aec0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0aec0ccfc0 0x7f0aec0aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43836/0 (socket says 172.21.15.32:43836) 2023-10-14T12:18:53.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0aeaffd700 1 -- 172.21.15.32:0/763301949 learned_addr learned my addr 172.21.15.32:0/763301949 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0cb440 con 0x7f9bec15d9e0 2023-10-14T12:18:53.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0b7210 con 0x7f9bec15d9e0 2023-10-14T12:18:53.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff02401a400 con 0x7ff02806d390 2023-10-14T12:18:53.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7ff01dffb700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff00c06af00 0x7ff00c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0240895c0 con 0x7ff02806d390 2023-10-14T12:18:53.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7ff01dffb700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7ff00c0730a0 0x7ff00c0754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 --> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff00c075b70 con 0x7ff00c0730a0 2023-10-14T12:18:53.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7ff02ca14700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff00c06af00 0x7ff00c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7ff02da16700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7ff00c0730a0 0x7ff00c0754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0240545d0 con 0x7ff02806d390 2023-10-14T12:18:53.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f3f5557e700 1 Processor -- start 2023-10-14T12:18:53.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f3f5557e700 1 -- start start 2023-10-14T12:18:53.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f3f5557e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f5006daa0 0x7f3f500cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.444+0000 7f3f5557e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500ce5f0 0x7f3f500cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f3f5557e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500cef80 con 0x7f3f5015a280 2023-10-14T12:18:53.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f3f5557e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f50072200 con 0x7f3f5006daa0 2023-10-14T12:18:53.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f3f5557e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500cf1d0 con 0x7f3f500ce5f0 2023-10-14T12:18:53.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f3f4effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3f5015a280 0x7f3f5006d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54034/0 (socket says 172.21.15.32:54034) 2023-10-14T12:18:53.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f3f4effd700 1 -- 172.21.15.32:0/2751640877 learned_addr learned my addr 172.21.15.32:0/2751640877 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371822064 0 0) 0x7f3f500cef80 con 0x7f3f5015a280 2023-10-14T12:18:53.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f380034d0 con 0x7f3f5015a280 2023-10-14T12:18:53.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0bcf34c700 1 -- start start 2023-10-14T12:18:53.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.441+0000 7f4dab885700 1 Processor -- start 2023-10-14T12:18:53.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.442+0000 7f4dab885700 1 -- start start 2023-10-14T12:18:53.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f4dab885700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4da408a700 0x7f4da40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f4dab885700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4da406d0c0 0x7f4da40ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f4dab885700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da40ca990 con 0x7f4da40ceae0 2023-10-14T12:18:53.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f4dab885700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da40cf250 con 0x7f4da406d0c0 2023-10-14T12:18:53.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.443+0000 7f4dab885700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da416ebd0 con 0x7f4da408a700 2023-10-14T12:18:53.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f4da8e20700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4da40ceae0 0x7f4da406c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54042/0 (socket says 172.21.15.32:54042) 2023-10-14T12:18:53.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f4da8e20700 1 -- 172.21.15.32:0/4084787281 learned_addr learned my addr 172.21.15.32:0/4084787281 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7fab1ad9d700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab1c0c2340 0x7fab1c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7fab1a59c700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0cd270 0x7fab1c0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7fab1b59e700 1 -- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab1c0c2340 msgr2=0x7fab1c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7fab1b59e700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab1c0c2340 0x7fab1c15e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7fab1b59e700 1 -- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0cd270 msgr2=0x7fab1c0c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7fab1b59e700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1c0cd270 0x7fab1c0c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7fab1b59e700 1 -- 172.21.15.32:0/514717367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c009550 con 0x7fab1c162050 2023-10-14T12:18:53.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7ff02da16700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7ff00c0730a0 0x7ff00c0754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f4da9e22700 1 --2- 172.21.15.32:0/4084787281 >> v2:172.21.15.32:3300/0 conn(0x7f4da406d0c0 0x7f4da40ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4e7fc700 1 --2- 172.21.15.32:0/2751640877 >> v2:172.21.15.92:3300/0 conn(0x7f3f5006daa0 0x7f3f500cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4f7fe700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500ce5f0 0x7f3f500cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.445+0000 7f0aeb7fe700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec06d0c0 0x7f0aec1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0aebfff700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 0x7f0aec1fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bec0ce8d0 con 0x7f9bec15d9e0 2023-10-14T12:18:53.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f4da9e22700 1 -- 172.21.15.32:0/4084787281 >> v2:172.21.15.92:3300/0 conn(0x7f4da408a700 msgr2=0x7f4da40ca450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:18:53.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f4da9e22700 1 --2- 172.21.15.32:0/4084787281 >> v2:172.21.15.92:3300/0 conn(0x7f4da408a700 0x7f4da40ca450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f4da9e22700 1 -- 172.21.15.32:0/4084787281 >> v1:172.21.15.92:6789/0 conn(0x7f4da40ceae0 legacy=0x7f4da406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f4da9e22700 1 -- 172.21.15.32:0/4084787281 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40cef70 con 0x7f4da406d0c0 2023-10-14T12:18:53.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0aeb7fe700 1 -- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0aec0ccfc0 msgr2=0x7f0aec0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0aeb7fe700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0aec0ccfc0 0x7f0aec0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0aeb7fe700 1 -- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 msgr2=0x7f0aec1fac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0aeb7fe700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aec15da70 0x7f0aec1fac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945956872 0 0) 0x7f3f380034d0 con 0x7f3f5015a280 2023-10-14T12:18:53.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500ce5f0 msgr2=0x7f3f500cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500ce5f0 0x7f3f500cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 >> v2:172.21.15.92:3300/0 conn(0x7f3f5006daa0 msgr2=0x7f3f500cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 --2- 172.21.15.32:0/2751640877 >> v2:172.21.15.92:3300/0 conn(0x7f3f5006daa0 0x7f3f500cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500cafb0 con 0x7f3f5015a280 2023-10-14T12:18:53.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f3f480019f0 con 0x7f3f5015a280 2023-10-14T12:18:53.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 >> v1:172.21.15.92:6789/0 conn(0x7f3f5015a280 legacy=0x7f3f5006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0aeb7fe700 1 -- 172.21.15.32:0/763301949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0094a0 con 0x7f0aec06d0c0 2023-10-14T12:18:53.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f38003af0 0x7f3f38003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f380067f0 0x7f3f38008c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38009440 0x7f3f380098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50072200 con 0x7f3f380067f0 2023-10-14T12:18:53.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500cf1d0 con 0x7f3f38009440 2023-10-14T12:18:53.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3800a220 con 0x7f3f38003af0 2023-10-14T12:18:53.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0bcf34c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc80b0e70 0x7f0bc80b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7f0bcf34c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bc80c27d0 0x7f0bc80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcf34c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80ca150 0x7f0bc80c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcf34c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80c8390 con 0x7f0bc80b0e70 2023-10-14T12:18:53.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcf34c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80c85e0 con 0x7f0bc80c27d0 2023-10-14T12:18:53.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcf34c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80c88c0 con 0x7f0bc80ca150 2023-10-14T12:18:53.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.446+0000 7ff02ca14700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff00c06af00 0x7ff00c06d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff018007fd0 tx=0x7ff018009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80ca150 0x7f0bc80c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80ca150 0x7f0bc80c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43848/0 (socket says 172.21.15.32:43848) 2023-10-14T12:18:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 -- 172.21.15.32:0/4002312037 learned_addr learned my addr 172.21.15.32:0/4002312037 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4effd700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f38003af0 0x7f3f38003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== osd.3 v2:172.21.15.32:6816/4217654174 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff00c075b70 con 0x7ff00c0730a0 2023-10-14T12:18:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcc8e7700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bc80c27d0 0x7f0bc80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4e7fc700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f380067f0 0x7f3f38008c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4f7fe700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38009440 0x7f3f380098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7fab1b59e700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c162050 0x7fab1c0c7bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab1000e7d0 tx=0x7fab1000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4effd700 1 -- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38009440 msgr2=0x7f3f380098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4effd700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38009440 0x7f3f380098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4effd700 1 -- 172.21.15.32:0/2751640877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f380067f0 msgr2=0x7f3f38008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4effd700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f380067f0 0x7f3f38008c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f3f4effd700 1 -- 172.21.15.32:0/2751640877 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380034d0 con 0x7f3f38003af0 2023-10-14T12:18:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 -- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bc80c27d0 msgr2=0x7f0bc80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bc80c27d0 0x7f0bc80c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 -- 172.21.15.32:0/4002312037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc80b0e70 msgr2=0x7f0bc80b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc80b0e70 0x7f0bc80b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0bcd8e9700 1 -- 172.21.15.32:0/4002312037 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40094a0 con 0x7f0bc80ca150 2023-10-14T12:18:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.447+0000 7f0aeb7fe700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec06d0c0 0x7f0aec1529e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0adc015000 tx=0x7f0adc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f0bcd8e9700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80ca150 0x7f0bc80c5010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800e810 tx=0x7f0bb800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f3f4effd700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f38003af0 0x7f3f38003f10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800a790 tx=0x7f3f38003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2a59dd903a903e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48012600 con 0x7f3f38003af0 2023-10-14T12:18:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48012760 con 0x7f3f38003af0 2023-10-14T12:18:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f3f4dffb700 1 -- 172.21.15.32:0/2751640877 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48012b10 con 0x7f3f38003af0 2023-10-14T12:18:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011630 con 0x7f0aec06d0c0 2023-10-14T12:18:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc011790 con 0x7f0aec06d0c0 2023-10-14T12:18:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011b40 con 0x7f0aec06d0c0 2023-10-14T12:18:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100095b0 con 0x7fab1c162050 2023-10-14T12:18:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f4da9e22700 1 --2- 172.21.15.32:0/4084787281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da406d0c0 0x7f4da40ccfc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4da406f4d0 tx=0x7f4d9c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3df884be1601642 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec0b3fa0 con 0x7f0aec06d0c0 2023-10-14T12:18:53.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec0b4560 con 0x7f0aec06d0c0 2023-10-14T12:18:53.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f3f5557e700 1 -- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f38003af0 msgr2=0x7f3f38003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f3f5557e700 1 --2- 172.21.15.32:0/2751640877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f38003af0 0x7f3f38003f10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800a790 tx=0x7f3f38003780 comp rx=0 tx=0).stop 2023-10-14T12:18:53.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0aec0cdff0 con 0x7f0aec06d0c0 2023-10-14T12:18:53.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10013680 con 0x7fab1c162050 2023-10-14T12:18:53.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10013a10 con 0x7fab1c162050 2023-10-14T12:18:53.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c0cb3a0 con 0x7fab1c162050 2023-10-14T12:18:53.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.448+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c0cb960 con 0x7fab1c162050 2023-10-14T12:18:53.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800c070 con 0x7f0bc80ca150 2023-10-14T12:18:53.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8013610 con 0x7f0bc80ca150 2023-10-14T12:18:53.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80139c0 con 0x7f0bc80ca150 2023-10-14T12:18:53.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc8163020 con 0x7f0bc80ca150 2023-10-14T12:18:53.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc81635e0 con 0x7f0bc80ca150 2023-10-14T12:18:53.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f4d9bfff700 1 -- 172.21.15.32:0/4084787281 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00ca80 con 0x7f4da406d0c0 2023-10-14T12:18:53.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0adc011ca0 con 0x7f0aec06d0c0 2023-10-14T12:18:53.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9bdc003a20 con 0x7f9bec15d9e0 2023-10-14T12:18:53.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f9be8ff9700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9bd806af00 0x7f9bd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bdc088ab0 con 0x7f9bec15d9e0 2023-10-14T12:18:53.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f9be8ff9700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7f9bd80730a0 0x7f9bd80754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 --> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bd8075b70 con 0x7f9bd80730a0 2023-10-14T12:18:53.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bdc053860 con 0x7f9bec15d9e0 2023-10-14T12:18:53.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f9beb7fe700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9bd806af00 0x7f9bd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f9bf0ffd700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7f9bd80730a0 0x7f9bd80754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f9bf0ffd700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7f9bd80730a0 0x7f9bd80754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab1c06e520 con 0x7fab1c162050 2023-10-14T12:18:53.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f3f4f7fe700 1 -- 172.21.15.32:0/2751640877 reap_dead start 2023-10-14T12:18:53.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0bc80ca620 con 0x7f0bc80ca150 2023-10-14T12:18:53.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f4d9bfff700 1 -- 172.21.15.32:0/4084787281 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c00cbe0 con 0x7f4da406d0c0 2023-10-14T12:18:53.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.449+0000 7f4d9bfff700 1 -- 172.21.15.32:0/4084787281 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011400 con 0x7f4da406d0c0 2023-10-14T12:18:53.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f4dab885700 1 -- 172.21.15.32:0/4084787281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da406d0c0 msgr2=0x7f4da40ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f4dab885700 1 --2- 172.21.15.32:0/4084787281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da406d0c0 0x7f4da40ccfc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4da406f4d0 tx=0x7f4d9c009f60 comp rx=0 tx=0).stop 2023-10-14T12:18:53.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f4dab885700 1 -- 172.21.15.32:0/4084787281 shutdown_connections 2023-10-14T12:18:53.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f4dab885700 1 --2- 172.21.15.32:0/4084787281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da406d0c0 0x7f4da40ccfc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f4dab885700 1 --2- 172.21.15.32:0/4084787281 >> v2:172.21.15.92:3300/0 conn(0x7f4da408a700 0x7f4da40ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7f4dab885700 1 -- 172.21.15.32:0/4084787281 >> 172.21.15.32:0/4084787281 conn(0x7f4da40cf3f0 msgr2=0x7f4da40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f4dab885700 1 -- 172.21.15.32:0/4084787281 shutdown_connections 2023-10-14T12:18:53.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7f4dab885700 1 -- 172.21.15.32:0/4084787281 wait complete. 2023-10-14T12:18:53.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7fdda63a0700 1 Processor -- start 2023-10-14T12:18:53.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.450+0000 7fdda63a0700 1 -- start start 2023-10-14T12:18:53.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda63a0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdda015b880 0x7fdda00d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda63a0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda015bc60 0x7fdda00ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda63a0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda00cf3c0 con 0x7fdda00ae750 2023-10-14T12:18:53.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda63a0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00cf6a0 con 0x7fdda015b880 2023-10-14T12:18:53.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda63a0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00cc540 con 0x7fdda015bc60 2023-10-14T12:18:53.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda493d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fdda00ae750 0x7fdda00ccd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54072/0 (socket says 172.21.15.32:54072) 2023-10-14T12:18:53.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.451+0000 7fdda493d700 1 -- 172.21.15.32:0/1671747824 learned_addr learned my addr 172.21.15.32:0/1671747824 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f0adbfff700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0ad006aed0 0x7f0ad006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0adc08aee0 con 0x7f0aec06d0c0 2023-10-14T12:18:53.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f0adbfff700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7f0ad00730f0 0x7f0ad0075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 --> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ad0075bc0 con 0x7f0ad00730f0 2023-10-14T12:18:53.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0adc08b290 con 0x7f0aec06d0c0 2023-10-14T12:18:53.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0aeaffd700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0ad006aed0 0x7f0ad006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7f9beb7fe700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9bd806af00 0x7f9bd806d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0ca630 tx=0x7f9be0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab10013b70 con 0x7fab1c162050 2023-10-14T12:18:53.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fab037fe700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab0806af00 0x7fab0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab100895a0 con 0x7fab1c162050 2023-10-14T12:18:53.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fab037fe700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7fab080730a0 0x7fab080754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 --> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab08075b70 con 0x7fab080730a0 2023-10-14T12:18:53.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fab1a59c700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7fab080730a0 0x7fab080754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7fab1a59c700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7fab080730a0 0x7fab080754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7fab1ad9d700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab0806af00 0x7fab0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f3f5557e700 1 -- 172.21.15.32:0/2751640877 shutdown_connections 2023-10-14T12:18:53.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f3f5557e700 1 -- 172.21.15.32:0/2751640877 >> 172.21.15.32:0/2751640877 conn(0x7f3f500cfc40 msgr2=0x7f3f500d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f3f5557e700 1 -- 172.21.15.32:0/2751640877 shutdown_connections 2023-10-14T12:18:53.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7f3f5557e700 1 -- 172.21.15.32:0/2751640877 wait complete. 2023-10-14T12:18:53.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0bb8013b20 con 0x7f0bc80ca150 2023-10-14T12:18:53.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bbdffb700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0bac06af00 0x7f0bac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bb8089360 con 0x7f0bc80ca150 2023-10-14T12:18:53.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bcd0e8700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0bac06af00 0x7f0bac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bbdffb700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f0bac073120 0x7f0bac075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 --> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bac075bf0 con 0x7f0bac073120 2023-10-14T12:18:53.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bb808b980 con 0x7f0bc80ca150 2023-10-14T12:18:53.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7f4dab885700 1 Processor -- start 2023-10-14T12:18:53.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7f4dab885700 1 -- start start 2023-10-14T12:18:53.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4dab885700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da406d0c0 0x7f4da416c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4dab885700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da408a700 0x7f4da40c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4dab885700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4da40c7960 0x7f4da40a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4dab885700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40c81a0 con 0x7f4da408a700 2023-10-14T12:18:53.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4dab885700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40c8480 con 0x7f4da406d0c0 2023-10-14T12:18:53.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4dab885700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40c8760 con 0x7f4da40c7960 2023-10-14T12:18:53.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4da9621700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da406d0c0 0x7f4da416c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4da9621700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da406d0c0 0x7f4da416c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42452/0 (socket says 172.21.15.32:42452) 2023-10-14T12:18:53.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4da9621700 1 -- 172.21.15.32:0/3201715300 learned_addr learned my addr 172.21.15.32:0/3201715300 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4da9e22700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4da40c7960 0x7f4da40a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.454+0000 7f4da8e20700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da408a700 0x7f4da40c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9f7fe700 1 --2- 172.21.15.32:0/1671747824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda015bc60 0x7fdda00ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9f7fe700 1 -- 172.21.15.32:0/1671747824 >> v2:172.21.15.32:3300/0 conn(0x7fdda015b880 msgr2=0x7fdda00d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9f7fe700 1 --2- 172.21.15.32:0/1671747824 >> v2:172.21.15.32:3300/0 conn(0x7fdda015b880 0x7fdda00d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9f7fe700 1 -- 172.21.15.32:0/1671747824 >> v1:172.21.15.92:6789/0 conn(0x7fdda00ae750 legacy=0x7fdda00ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9f7fe700 1 -- 172.21.15.32:0/1671747824 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00cc820 con 0x7fdda015bc60 2023-10-14T12:18:53.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9f7fe700 1 --2- 172.21.15.32:0/1671747824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda015bc60 0x7fdda00ae210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009d90 tx=0x7fdd9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=854faa82cd4a6582 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9effd700 1 -- 172.21.15.32:0/1671747824 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800e070 con 0x7fdda015bc60 2023-10-14T12:18:53.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9effd700 1 -- 172.21.15.32:0/1671747824 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800bbd0 con 0x7fdda015bc60 2023-10-14T12:18:53.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.452+0000 7fdd9effd700 1 -- 172.21.15.32:0/1671747824 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012430 con 0x7fdda015bc60 2023-10-14T12:18:53.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fdda63a0700 1 -- 172.21.15.32:0/1671747824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda015bc60 msgr2=0x7fdda00ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.453+0000 7fdda63a0700 1 --2- 172.21.15.32:0/1671747824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda015bc60 0x7fdda00ae210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009d90 tx=0x7fdd9800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:53.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fab1ad9d700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab0806af00 0x7fab0806d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0b97c0 tx=0x7fab0c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f3f5557e700 1 Processor -- start 2023-10-14T12:18:53.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9621700 1 -- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4da40c7960 msgr2=0x7f4da40a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9621700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4da40c7960 0x7f4da40a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9621700 1 -- 172.21.15.32:0/3201715300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da408a700 msgr2=0x7f4da40c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9621700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4da408a700 0x7f4da40c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9621700 1 -- 172.21.15.32:0/3201715300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c00d040 con 0x7f4da406d0c0 2023-10-14T12:18:53.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== osd.1 v2:172.21.15.32:6808/3306403672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9bd8075b70 con 0x7f9bd80730a0 2023-10-14T12:18:53.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f0aebfff700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7f0ad00730f0 0x7f0ad0075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f0aeaffd700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0ad006aed0 0x7f0ad006d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0c5b20 tx=0x7f0ae0001750 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab10054640 con 0x7fab1c162050 2023-10-14T12:18:53.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f0bcc8e7700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f0bac073120 0x7f0bac075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f0bcd0e8700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0bac06af00 0x7f0bac06d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80b4bf0 tx=0x7f0bc4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9e22700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4da40c7960 0x7f4da40a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:53.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4da9621700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da406d0c0 0x7f4da416c660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4da000b550 tx=0x7f4da000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0011830 con 0x7f4da406d0c0 2023-10-14T12:18:53.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da00119b0 con 0x7f4da406d0c0 2023-10-14T12:18:53.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0011d60 con 0x7f4da406d0c0 2023-10-14T12:18:53.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da40c8a40 con 0x7f4da406d0c0 2023-10-14T12:18:53.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fdda63a0700 1 -- 172.21.15.32:0/1671747824 shutdown_connections 2023-10-14T12:18:53.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fdda63a0700 1 --2- 172.21.15.32:0/1671747824 >> v2:172.21.15.32:3300/0 conn(0x7fdda015b880 0x7fdda00d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fdda63a0700 1 --2- 172.21.15.32:0/1671747824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda015bc60 0x7fdda00ae210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fdda63a0700 1 -- 172.21.15.32:0/1671747824 >> 172.21.15.32:0/1671747824 conn(0x7fdda00d15e0 msgr2=0x7fdda00d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da40c9240 con 0x7f4da406d0c0 2023-10-14T12:18:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== osd.2 v2:172.21.15.32:6819/2045586294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fab08075b70 con 0x7fab080730a0 2023-10-14T12:18:53.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f0bcc8e7700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f0bac073120 0x7f0bac075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7fdda63a0700 1 -- 172.21.15.32:0/1671747824 shutdown_connections 2023-10-14T12:18:53.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7fdda63a0700 1 -- 172.21.15.32:0/1671747824 wait complete. 2023-10-14T12:18:53.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.455+0000 7f3f5557e700 1 -- start start 2023-10-14T12:18:53.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f5557e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38003af0 0x7f3f501591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f5557e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500a96b0 0x7f3f500c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f5557e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500c5870 0x7f3f500c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f5557e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500c6260 con 0x7f3f500a96b0 2023-10-14T12:18:53.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f5557e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501ef130 con 0x7f3f38003af0 2023-10-14T12:18:53.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f5557e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50159700 con 0x7f3f500c5870 2023-10-14T12:18:53.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500c5870 0x7f3f500c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500c5870 0x7f3f500c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43890/0 (socket says 172.21.15.32:43890) 2023-10-14T12:18:53.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 -- 172.21.15.32:0/4025577441 learned_addr learned my addr 172.21.15.32:0/4025577441 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 -- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38003af0 msgr2=0x7f3f501591c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:18:53.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f38003af0 0x7f3f501591c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 -- 172.21.15.32:0/4025577441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500a96b0 msgr2=0x7f3f500c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500a96b0 0x7f3f500c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f3f4f7fe700 1 -- 172.21.15.32:0/4025577441 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500c96a0 con 0x7f3f500c5870 2023-10-14T12:18:53.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.457+0000 7f0aebfff700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7f0ad00730f0 0x7f0ad0075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.457+0000 7f3f4f7fe700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500c5870 0x7f3f500c5d20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f500ce5a0 tx=0x7f3f4000e790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.456+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4da416e860 con 0x7f4da406d0c0 2023-10-14T12:18:53.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.458+0000 7fdda63a0700 1 Processor -- start 2023-10-14T12:18:53.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.458+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== osd.5 v2:172.21.15.92:6808/2463723168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0bac075bf0 con 0x7f0bac073120 2023-10-14T12:18:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.458+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== osd.0 v2:172.21.15.32:6800/3987087050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0ad0075bc0 con 0x7f0ad00730f0 2023-10-14T12:18:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.458+0000 7fdda63a0700 1 -- start start 2023-10-14T12:18:53.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.458+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4da001a400 con 0x7f4da406d0c0 2023-10-14T12:18:53.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4d99ffb700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d8806af50 0x7f4d8806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4da0089b40 con 0x7f4da406d0c0 2023-10-14T12:18:53.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4da8e20700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d8806af50 0x7f4d8806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4d99ffb700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7f4d88073170 0x7f4d88075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 --> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d88075c40 con 0x7f4d88073170 2023-10-14T12:18:53.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da0089fe0 con 0x7f4da406d0c0 2023-10-14T12:18:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda63a0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda00ae750 0x7fdda01f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda63a0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda015b880 0x7fdda00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda63a0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdda015bc60 0x7fdda01f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda63a0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00b3010 con 0x7fdda015bc60 2023-10-14T12:18:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda63a0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c86b0 con 0x7fdda015b880 2023-10-14T12:18:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda63a0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00b2d40 con 0x7fdda00ae750 2023-10-14T12:18:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7f4da9e22700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7f4d88073170 0x7f4d88075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdda493d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdda015bc60 0x7fdda01f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.459+0000 7fdd9ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda00ae750 0x7fdda01f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda00ae750 0x7fdda01f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43896/0 (socket says 172.21.15.32:43896) 2023-10-14T12:18:53.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdda493d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdda015bc60 0x7fdda01f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38208/0 (socket says 172.21.15.32:38208) 2023-10-14T12:18:53.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 -- 172.21.15.32:0/1821680032 learned_addr learned my addr 172.21.15.32:0/1821680032 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9f7fe700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda015b880 0x7fdda00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 -- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda015b880 msgr2=0x7fdda00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda015b880 0x7fdda00b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 -- 172.21.15.32:0/1821680032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdda015bc60 msgr2=0x7fdda01f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdda015bc60 0x7fdda01f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 -- 172.21.15.32:0/1821680032 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98009a70 con 0x7fdda00ae750 2023-10-14T12:18:53.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7f4da9e22700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7f4d88073170 0x7f4d88075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda00ae750 0x7fdda01f1e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400fa10 tx=0x7fdd9400fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94005ca0 con 0x7fdda00ae750 2023-10-14T12:18:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94005e00 con 0x7fdda00ae750 2023-10-14T12:18:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00c8900 con 0x7fdda00ae750 2023-10-14T12:18:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94006260 con 0x7fdda00ae750 2023-10-14T12:18:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.460+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda00c8ec0 con 0x7fdda00ae750 2023-10-14T12:18:53.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.461+0000 7f4da8e20700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d8806af50 0x7f4d8806d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4da40c9a00 tx=0x7f4d94009540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.461+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== osd.6 v2:172.21.15.92:6816/1317212629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4d88075c40 con 0x7f4d88073170 2023-10-14T12:18:53.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.461+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdda00cc1f0 con 0x7fdda00ae750 2023-10-14T12:18:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.462+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40004030 con 0x7f3f500c5870 2023-10-14T12:18:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.462+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500c9980 con 0x7f3f500c5870 2023-10-14T12:18:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.462+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500c9f40 con 0x7f3f500c5870 2023-10-14T12:18:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.462+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400041b0 con 0x7f3f500c5870 2023-10-14T12:18:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.462+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40004560 con 0x7f3f500c5870 2023-10-14T12:18:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f500cb570 con 0x7f3f500c5870 2023-10-14T12:18:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.462+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd94039d50 con 0x7fdda00ae750 2023-10-14T12:18:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7fdd9cff9700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdd8406aed0 0x7fdd8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd94015070 con 0x7fdda00ae750 2023-10-14T12:18:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7fdd9f7fe700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdd8406aed0 0x7fdd8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7fdd9cff9700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7fdd84073070 0x7fdd84075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 --> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd84075b40 con 0x7fdd84073070 2023-10-14T12:18:53.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.463+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd9408d280 con 0x7fdda00ae750 2023-10-14T12:18:53.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.464+0000 7fdda493d700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7fdd84073070 0x7fdd84075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.464+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f400036a0 con 0x7f3f500c5870 2023-10-14T12:18:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.464+0000 7f3f377fe700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f3c06af20 0x7f3f3c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.464+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f40088fe0 con 0x7f3f500c5870 2023-10-14T12:18:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f4effd700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f3c06af20 0x7f3f3c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f377fe700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f3f3c073140 0x7f3f3c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 --> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f3c075c10 con 0x7f3f3c073140 2023-10-14T12:18:53.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f4008b6f0 con 0x7f3f500c5870 2023-10-14T12:18:53.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.464+0000 7fdd9f7fe700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdd8406aed0 0x7fdd8406d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800b370 tx=0x7fdd98011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7fdda493d700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7fdd84073070 0x7fdd84075490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f4e7fc700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f3f3c073140 0x7f3f3c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f4effd700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f3c06af20 0x7f3f3c06d3e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800afd0 tx=0x7f3f48009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.465+0000 7f3f4e7fc700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f3f3c073140 0x7f3f3c075560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.466+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== osd.7 v2:172.21.15.92:6817/769790747 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdd84075b40 con 0x7fdd84073070 2023-10-14T12:18:53.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.466+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== osd.4 v2:172.21.15.92:6800/2175015118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3f3c075c10 con 0x7f3f3c073140 2023-10-14T12:18:53.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.472+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 --> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0280c5b50 con 0x7ff00c0730a0 2023-10-14T12:18:53.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.475+0000 7ff01dffb700 1 -- 172.21.15.32:0/3047709306 <== osd.3 v2:172.21.15.32:6816/4217654174 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff0280c5b50 con 0x7ff00c0730a0 2023-10-14T12:18:53.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.476+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7ff00c0730a0 msgr2=0x7ff00c0754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.476+0000 7ff02f479700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7ff00c0730a0 0x7ff00c0754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.476+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff00c06af00 msgr2=0x7ff00c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.476+0000 7ff02f479700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff00c06af00 0x7ff00c06d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff018007fd0 tx=0x7ff018009040 comp rx=0 tx=0).stop 2023-10-14T12:18:53.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.476+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02806d390 msgr2=0x7ff0280c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.476+0000 7ff02f479700 1 --2- 172.21.15.32:0/3047709306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02806d390 0x7ff0280c64c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff024006fd0 tx=0x7ff02400b730 comp rx=0 tx=0).stop 2023-10-14T12:18:53.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.477+0000 7ff02da16700 1 -- 172.21.15.32:0/3047709306 reap_dead start 2023-10-14T12:18:53.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.477+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 shutdown_connections 2023-10-14T12:18:53.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.477+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 >> 172.21.15.32:0/3047709306 conn(0x7ff0280cfc40 msgr2=0x7ff0280b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.485+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 shutdown_connections 2023-10-14T12:18:53.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.485+0000 7ff02f479700 1 -- 172.21.15.32:0/3047709306 wait complete. 2023-10-14T12:18:53.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.486+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 --> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bec0ce5f0 con 0x7f9bd80730a0 2023-10-14T12:18:53.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.489+0000 7f9be8ff9700 1 -- 172.21.15.32:0/943260105 <== osd.1 v2:172.21.15.32:6808/3306403672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9be400bd70 con 0x7f9bd80730a0 2023-10-14T12:18:53.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.489+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 --> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0bc8162490 con 0x7f0bac073120 2023-10-14T12:18:53.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7f9bd80730a0 msgr2=0x7f9bd80754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7f9bd80730a0 0x7f9bd80754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9bd806af00 msgr2=0x7f9bd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9bd806af00 0x7f9bd806d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0ca630 tx=0x7f9be0009190 comp rx=0 tx=0).stop 2023-10-14T12:18:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec15d9e0 msgr2=0x7f9bec0ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 --2- 172.21.15.32:0/943260105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec15d9e0 0x7f9bec0ca8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c510 tx=0x7f9bdc00c820 comp rx=0 tx=0).stop 2023-10-14T12:18:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf0ffd700 1 -- 172.21.15.32:0/943260105 reap_dead start 2023-10-14T12:18:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 shutdown_connections 2023-10-14T12:18:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 >> 172.21.15.32:0/943260105 conn(0x7f9bec09cb40 msgr2=0x7f9bec15cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 shutdown_connections 2023-10-14T12:18:53.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.490+0000 7f9bf2a60700 1 -- 172.21.15.32:0/943260105 wait complete. 2023-10-14T12:18:53.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.491+0000 7f0bbdffb700 1 -- 172.21.15.32:0/4002312037 <== osd.5 v2:172.21.15.92:6808/2463723168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0bc0001ee0 con 0x7f0bac073120 2023-10-14T12:18:53.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.495+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 --> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab1c0cd720 con 0x7fab080730a0 2023-10-14T12:18:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.496+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 --> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdda00ce920 con 0x7fdd84073070 2023-10-14T12:18:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.497+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 --> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4da416e580 con 0x7f4d88073170 2023-10-14T12:18:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.497+0000 7f4d99ffb700 1 -- 172.21.15.32:0/3201715300 <== osd.6 v2:172.21.15.92:6816/1317212629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d9c00cdf0 con 0x7f4d88073170 2023-10-14T12:18:53.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 --> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0aec0cdd10 con 0x7f0ad00730f0 2023-10-14T12:18:53.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f0bac073120 msgr2=0x7f0bac075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f0bac073120 0x7f0bac075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0bac06af00 msgr2=0x7f0bac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0bac06af00 0x7f0bac06d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80b4bf0 tx=0x7f0bc4010000 comp rx=0 tx=0).stop 2023-10-14T12:18:53.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80ca150 msgr2=0x7f0bc80c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 --2- 172.21.15.32:0/4002312037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bc80ca150 0x7f0bc80c5010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800e810 tx=0x7f0bb800eb20 comp rx=0 tx=0).stop 2023-10-14T12:18:53.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcd8e9700 1 -- 172.21.15.32:0/4002312037 reap_dead start 2023-10-14T12:18:53.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 shutdown_connections 2023-10-14T12:18:53.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 >> 172.21.15.32:0/4002312037 conn(0x7f0bc806afb0 msgr2=0x7f0bc80aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0adbfff700 1 -- 172.21.15.32:0/763301949 <== osd.0 v2:172.21.15.32:6800/3987087050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ae4005040 con 0x7f0ad00730f0 2023-10-14T12:18:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 shutdown_connections 2023-10-14T12:18:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.498+0000 7f0bcf34c700 1 -- 172.21.15.32:0/4002312037 wait complete. 2023-10-14T12:18:53.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7f0ad00730f0 msgr2=0x7f0ad0075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0af1a7b700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7f0ad00730f0 0x7f0ad0075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0ad006aed0 msgr2=0x7f0ad006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0af1a7b700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0ad006aed0 0x7f0ad006d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0c5b20 tx=0x7f0ae0001750 comp rx=0 tx=0).stop 2023-10-14T12:18:53.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec06d0c0 msgr2=0x7f0aec1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0af1a7b700 1 --2- 172.21.15.32:0/763301949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aec06d0c0 0x7f0aec1529e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0adc015000 tx=0x7f0adc0047c0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7f0aebfff700 1 -- 172.21.15.32:0/763301949 reap_dead start 2023-10-14T12:18:53.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7fab037fe700 1 -- 172.21.15.32:0/514717367 <== osd.2 v2:172.21.15.32:6819/2045586294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab14001d80 con 0x7fab080730a0 2023-10-14T12:18:53.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7fdd9cff9700 1 -- 172.21.15.32:0/1821680032 <== osd.7 v2:172.21.15.92:6817/769790747 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd90004b70 con 0x7fdd84073070 2023-10-14T12:18:53.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7fab080730a0 msgr2=0x7fab080754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.499+0000 7fab21214700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7fab080730a0 0x7fab080754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab0806af00 msgr2=0x7fab0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fab0806af00 0x7fab0806d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0b97c0 tx=0x7fab0c008030 comp rx=0 tx=0).stop 2023-10-14T12:18:53.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c162050 msgr2=0x7fab1c0c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 --2- 172.21.15.32:0/514717367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab1c162050 0x7fab1c0c7bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab1000e7d0 tx=0x7fab1000eb90 comp rx=0 tx=0).stop 2023-10-14T12:18:53.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab1b59e700 1 -- 172.21.15.32:0/514717367 reap_dead start 2023-10-14T12:18:53.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 shutdown_connections 2023-10-14T12:18:53.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 >> 172.21.15.32:0/514717367 conn(0x7fab1c06aa20 msgr2=0x7fab1c06ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 shutdown_connections 2023-10-14T12:18:53.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.500+0000 7fab21214700 1 -- 172.21.15.32:0/514717367 wait complete. 2023-10-14T12:18:53.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 --> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f500cb290 con 0x7f3f3c073140 2023-10-14T12:18:53.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7f4d88073170 msgr2=0x7f4d88075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4dab885700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7f4d88073170 0x7f4d88075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d8806af50 msgr2=0x7f4d8806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4dab885700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4d8806af50 0x7f4d8806d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4da40c9a00 tx=0x7f4d94009540 comp rx=0 tx=0).stop 2023-10-14T12:18:53.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da406d0c0 msgr2=0x7f4da416c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4dab885700 1 --2- 172.21.15.32:0/3201715300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da406d0c0 0x7f4da416c660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4da000b550 tx=0x7f4da000b860 comp rx=0 tx=0).stop 2023-10-14T12:18:53.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f4da9e22700 1 -- 172.21.15.32:0/3201715300 reap_dead start 2023-10-14T12:18:53.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f3f377fe700 1 -- 172.21.15.32:0/4025577441 <== osd.4 v2:172.21.15.92:6800/2175015118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3f4400c040 con 0x7f3f3c073140 2023-10-14T12:18:53.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f3f3c073140 msgr2=0x7f3f3c075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.501+0000 7f3f5557e700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f3f3c073140 0x7f3f3c075560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f3c06af20 msgr2=0x7f3f3c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f3c06af20 0x7f3f3c06d3e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800afd0 tx=0x7f3f48009030 comp rx=0 tx=0).stop 2023-10-14T12:18:53.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500c5870 msgr2=0x7f3f500c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 --2- 172.21.15.32:0/4025577441 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f500c5870 0x7f3f500c5d20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f500ce5a0 tx=0x7f3f4000e790 comp rx=0 tx=0).stop 2023-10-14T12:18:53.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f4f7fe700 1 -- 172.21.15.32:0/4025577441 reap_dead start 2023-10-14T12:18:53.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 shutdown_connections 2023-10-14T12:18:53.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 >> 172.21.15.32:0/4025577441 conn(0x7f3f500cfc40 msgr2=0x7f3f500b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 shutdown_connections 2023-10-14T12:18:53.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.502+0000 7f3f5557e700 1 -- 172.21.15.32:0/4025577441 wait complete. 2023-10-14T12:18:53.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 shutdown_connections 2023-10-14T12:18:53.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 >> 172.21.15.32:0/3201715300 conn(0x7f4da40cf3f0 msgr2=0x7f4da40b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 shutdown_connections 2023-10-14T12:18:53.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7f4dab885700 1 -- 172.21.15.32:0/3201715300 wait complete. 2023-10-14T12:18:53.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 shutdown_connections 2023-10-14T12:18:53.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 >> 172.21.15.32:0/763301949 conn(0x7f0aec0cf3f0 msgr2=0x7f0aec0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7fdd84073070 msgr2=0x7fdd84075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.503+0000 7fdda63a0700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7fdd84073070 0x7fdd84075490 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdd8406aed0 msgr2=0x7fdd8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda63a0700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdd8406aed0 0x7fdd8406d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800b370 tx=0x7fdd98011000 comp rx=0 tx=0).stop 2023-10-14T12:18:53.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda00ae750 msgr2=0x7fdda01f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda63a0700 1 --2- 172.21.15.32:0/1821680032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdda00ae750 0x7fdda01f1e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400fa10 tx=0x7fdd9400fd20 comp rx=0 tx=0).stop 2023-10-14T12:18:53.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda493d700 1 -- 172.21.15.32:0/1821680032 reap_dead start 2023-10-14T12:18:53.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 shutdown_connections 2023-10-14T12:18:53.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 >> 172.21.15.32:0/1821680032 conn(0x7fdda00d15e0 msgr2=0x7fdda006f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.504+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 shutdown_connections 2023-10-14T12:18:53.608 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:53.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T12:18:53.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.505+0000 7f0af1a7b700 1 -- 172.21.15.32:0/763301949 wait complete. 2023-10-14T12:18:53.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.506+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 shutdown_connections 2023-10-14T12:18:53.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.506+0000 7fdda63a0700 1 -- 172.21.15.32:0/1821680032 wait complete. 2023-10-14T12:18:53.611 INFO:teuthology.orchestra.run.smithi032.stdout:55834574852 2023-10-14T12:18:53.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T12:18:53.612 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:53.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T12:18:53.614 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:53.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T12:18:53.615 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:53.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T12:18:53.616 INFO:teuthology.orchestra.run.smithi032.stdout:55834574855 2023-10-14T12:18:53.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T12:18:53.618 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:53.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T12:18:53.619 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:53.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T12:18:53.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.864+0000 7fda46e70700 1 Processor -- start 2023-10-14T12:18:53.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.864+0000 7fda46e70700 1 -- start start 2023-10-14T12:18:53.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.865+0000 7fda46e70700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fda4008a700 0x7fda400ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.865+0000 7fda46e70700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.865+0000 7fda46e70700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda400ca990 con 0x7fda400ceae0 2023-10-14T12:18:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.865+0000 7fda46e70700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda400cf250 con 0x7fda4008a700 2023-10-14T12:18:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.865+0000 7fda46e70700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4016ebd0 con 0x7fda4006d0c0 2023-10-14T12:18:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.866+0000 7fda44c0c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fda4008a700 0x7fda400ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.866+0000 7fda44c0c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fda4008a700 0x7fda400ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42486/0 (socket says 172.21.15.32:42486) 2023-10-14T12:18:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.866+0000 7fda44c0c700 1 -- 172.21.15.32:0/2925450545 learned_addr learned my addr 172.21.15.32:0/2925450545 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.866+0000 7fda4540d700 1 --2- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.867+0000 7fda44c0c700 1 -- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 msgr2=0x7fda400ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.867+0000 7fda44c0c700 1 --2- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.867+0000 7fda44c0c700 1 -- 172.21.15.32:0/2925450545 >> v1:172.21.15.92:6789/0 conn(0x7fda400ceae0 legacy=0x7fda4006c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.867+0000 7fda44c0c700 1 -- 172.21.15.32:0/2925450545 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda400cef70 con 0x7fda4008a700 2023-10-14T12:18:53.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.867+0000 7fda44c0c700 1 --2- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda4008a700 0x7fda400ca450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda30008970 tx=0x7fda300082b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fa5a6684a0aec01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.870+0000 7fda3f7fe700 1 -- 172.21.15.32:0/2925450545 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000b9c0 con 0x7fda4008a700 2023-10-14T12:18:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.870+0000 7fda3f7fe700 1 -- 172.21.15.32:0/2925450545 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000bb20 con 0x7fda4008a700 2023-10-14T12:18:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.870+0000 7fda3f7fe700 1 -- 172.21.15.32:0/2925450545 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000be90 con 0x7fda4008a700 2023-10-14T12:18:53.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.872+0000 7fda46e70700 1 -- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda4008a700 msgr2=0x7fda400ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.872+0000 7fda46e70700 1 --2- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda4008a700 0x7fda400ca450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda30008970 tx=0x7fda300082b0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.874+0000 7fb4383aa700 1 Processor -- start 2023-10-14T12:18:53.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.874+0000 7fb4383aa700 1 -- start start 2023-10-14T12:18:53.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.869+0000 7f5325971700 1 Processor -- start 2023-10-14T12:18:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.869+0000 7f5325971700 1 -- start start 2023-10-14T12:18:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f5325971700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532008a700 0x7f53200ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f5325971700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f53200ceae0 0x7f532006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f5325971700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f532016f060 0x7f532006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f5325971700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53200ca990 con 0x7f532016f060 2023-10-14T12:18:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f5325971700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53200cf250 con 0x7f53200ceae0 2023-10-14T12:18:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f5325971700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532016ebd0 con 0x7f532008a700 2023-10-14T12:18:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f531effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532008a700 0x7f53200ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f531effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532008a700 0x7f53200ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43916/0 (socket says 172.21.15.32:43916) 2023-10-14T12:18:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f531e7fc700 1 --2- 172.21.15.32:0/833726943 >> v2:172.21.15.92:3300/0 conn(0x7f53200ceae0 0x7f532006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f531effd700 1 -- 172.21.15.32:0/833726943 learned_addr learned my addr 172.21.15.32:0/833726943 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.871+0000 7f531f7fe700 1 --2- 172.21.15.32:0/833726943 >> v2:172.21.15.32:3300/0 conn(0x7f532016f060 0x7f532006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.875+0000 7f531e7fc700 1 -- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532008a700 msgr2=0x7f53200ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.875+0000 7f531e7fc700 1 --2- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532008a700 0x7f53200ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.875+0000 7f531e7fc700 1 -- 172.21.15.32:0/833726943 >> v2:172.21.15.32:3300/0 conn(0x7f532016f060 msgr2=0x7f532006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.875+0000 7f531e7fc700 1 --2- 172.21.15.32:0/833726943 >> v2:172.21.15.32:3300/0 conn(0x7f532016f060 0x7f532006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.875+0000 7f531e7fc700 1 -- 172.21.15.32:0/833726943 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200cef70 con 0x7f53200ceae0 2023-10-14T12:18:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7f531e7fc700 1 --2- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53200ceae0 0x7f532006c9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5320070600 tx=0x7f531000df40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83fe9dae724c32e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.875+0000 7f2eeaefd700 1 Processor -- start 2023-10-14T12:18:53.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7f531dffb700 1 -- 172.21.15.32:0/833726943 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310012070 con 0x7f53200ceae0 2023-10-14T12:18:53.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7f531dffb700 1 -- 172.21.15.32:0/833726943 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531000d2e0 con 0x7f53200ceae0 2023-10-14T12:18:53.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7f531dffb700 1 -- 172.21.15.32:0/833726943 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000f8e0 con 0x7f53200ceae0 2023-10-14T12:18:53.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb4383aa700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb43006af50 0x7fb430071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb4383aa700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb430071ab0 con 0x7fb4300cc3f0 2023-10-14T12:18:53.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb4383aa700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb430161bc0 con 0x7fb430161670 2023-10-14T12:18:53.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb4383aa700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb430161ea0 con 0x7fb43006af50 2023-10-14T12:18:53.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fb9d36b9700 1 Processor -- start 2023-10-14T12:18:53.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb436947700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb43006af50 0x7fb430071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb435945700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb430161670 0x7fb43006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54130/0 (socket says 172.21.15.32:54130) 2023-10-14T12:18:53.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb436947700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb43006af50 0x7fb430071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38232/0 (socket says 172.21.15.32:38232) 2023-10-14T12:18:53.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb435945700 1 -- 172.21.15.32:0/3522409195 learned_addr learned my addr 172.21.15.32:0/3522409195 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb435144700 1 -- 172.21.15.32:0/3522409195 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149950464 0 0) 0x7fb430161bc0 con 0x7fb430161670 2023-10-14T12:18:53.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb436947700 1 -- 172.21.15.32:0/3522409195 >> v1:172.21.15.92:6789/0 conn(0x7fb430161670 legacy=0x7fb43006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb436947700 1 -- 172.21.15.32:0/3522409195 >> v1:172.21.15.32:6789/0 conn(0x7fb4300cc3f0 legacy=0x7fb4300cc7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:18:53.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7fb436947700 1 -- 172.21.15.32:0/3522409195 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430162180 con 0x7fb43006af50 2023-10-14T12:18:53.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fb436947700 1 --2- 172.21.15.32:0/3522409195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb43006af50 0x7fb430071f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb428009d90 tx=0x7fb42800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b638066e577f2f8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fb435144700 1 -- 172.21.15.32:0/3522409195 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800e070 con 0x7fb43006af50 2023-10-14T12:18:53.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fb435144700 1 -- 172.21.15.32:0/3522409195 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42800bb90 con 0x7fb43006af50 2023-10-14T12:18:53.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fb435144700 1 -- 172.21.15.32:0/3522409195 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428003a20 con 0x7fb43006af50 2023-10-14T12:18:53.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fb9d36b9700 1 -- start start 2023-10-14T12:18:53.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7f5325971700 1 -- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53200ceae0 msgr2=0x7f532006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7f5325971700 1 --2- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53200ceae0 0x7f532006c9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5320070600 tx=0x7f531000df40 comp rx=0 tx=0).stop 2023-10-14T12:18:53.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fda46e70700 1 -- 172.21.15.32:0/2925450545 shutdown_connections 2023-10-14T12:18:53.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fda46e70700 1 --2- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fda46e70700 1 --2- 172.21.15.32:0/2925450545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda4008a700 0x7fda400ca450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.877+0000 7fda46e70700 1 -- 172.21.15.32:0/2925450545 >> 172.21.15.32:0/2925450545 conn(0x7fda400cf3f0 msgr2=0x7fda400cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fda46e70700 1 -- 172.21.15.32:0/2925450545 shutdown_connections 2023-10-14T12:18:53.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 -- 172.21.15.32:0/833726943 shutdown_connections 2023-10-14T12:18:53.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 --2- 172.21.15.32:0/833726943 >> v2:172.21.15.32:3300/0 conn(0x7f532016f060 0x7f532006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 --2- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532008a700 0x7f53200ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 --2- 172.21.15.32:0/833726943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53200ceae0 0x7f532006c9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 -- 172.21.15.32:0/833726943 >> 172.21.15.32:0/833726943 conn(0x7f53200cf3f0 msgr2=0x7f53200cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb4383aa700 1 -- 172.21.15.32:0/3522409195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb43006af50 msgr2=0x7fb430071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb4383aa700 1 --2- 172.21.15.32:0/3522409195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb43006af50 0x7fb430071f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb428009d90 tx=0x7fb42800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:53.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.876+0000 7f2eeaefd700 1 -- start start 2023-10-14T12:18:53.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2eeaefd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 0x7f2ee40cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2eeaefd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ee40b2940 0x7f2ee40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2eeaefd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ee40cd2e0 0x7f2ee4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2eeaefd700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40ce3b0 con 0x7f2ee40b2940 2023-10-14T12:18:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2eeaefd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40b2dc0 con 0x7f2ee40cd2e0 2023-10-14T12:18:53.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2eeaefd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40b6290 con 0x7f2ee415a850 2023-10-14T12:18:53.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2ee8c99700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 0x7f2ee40cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d36b9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9cc06d0c0 0x7fb9cc0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d36b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc0ccfc0 0x7fb9cc0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d36b9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc0ce360 con 0x7fb9cc15da70 2023-10-14T12:18:53.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d36b9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc0cd790 con 0x7fb9cc06d0c0 2023-10-14T12:18:53.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d36b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0cf040 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d1455700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb9cc15da70 0x7fb9cc06c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55262/0 (socket says 172.21.15.32:55262) 2023-10-14T12:18:53.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7fb9d1455700 1 -- 172.21.15.32:0/2417851005 learned_addr learned my addr 172.21.15.32:0/2417851005 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 -- 172.21.15.32:0/833726943 shutdown_connections 2023-10-14T12:18:53.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f5325971700 1 -- 172.21.15.32:0/833726943 wait complete. 2023-10-14T12:18:53.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2ee8c99700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 0x7f2ee40cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43926/0 (socket says 172.21.15.32:43926) 2023-10-14T12:18:53.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2ee8c99700 1 -- 172.21.15.32:0/3200082347 learned_addr learned my addr 172.21.15.32:0/3200082347 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.878+0000 7f2ee3fff700 1 --2- 172.21.15.32:0/3200082347 >> v2:172.21.15.32:3300/0 conn(0x7f2ee40b2940 0x7f2ee40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9d0c54700 1 --2- 172.21.15.32:0/2417851005 >> v2:172.21.15.32:3300/0 conn(0x7fb9cc06d0c0 0x7fb9cc0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee8c99700 1 -- 172.21.15.32:0/3200082347 >> v2:172.21.15.92:3300/0 conn(0x7f2ee40cd2e0 msgr2=0x7f2ee4071ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:18:53.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/3200082347 >> v2:172.21.15.92:3300/0 conn(0x7f2ee40cd2e0 0x7f2ee4071ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee8c99700 1 -- 172.21.15.32:0/3200082347 >> v2:172.21.15.32:3300/0 conn(0x7f2ee40b2940 msgr2=0x7f2ee40ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/3200082347 >> v2:172.21.15.32:3300/0 conn(0x7f2ee40b2940 0x7f2ee40ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee8c99700 1 -- 172.21.15.32:0/3200082347 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40cc220 con 0x7f2ee415a850 2023-10-14T12:18:53.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee3fff700 1 --2- 172.21.15.32:0/3200082347 >> v2:172.21.15.32:3300/0 conn(0x7f2ee40b2940 0x7f2ee40ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:53.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/3200082347 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 0x7f2ee40cbc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40caa90 tx=0x7f2ed400be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf8d3d87455c7ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9d1c56700 1 --2- 172.21.15.32:0/2417851005 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc0ccfc0 0x7fb9cc0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb4383aa700 1 -- 172.21.15.32:0/3522409195 shutdown_connections 2023-10-14T12:18:53.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb4383aa700 1 --2- 172.21.15.32:0/3522409195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb43006af50 0x7fb430071f40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb4383aa700 1 -- 172.21.15.32:0/3522409195 >> 172.21.15.32:0/3522409195 conn(0x7fb43006dac0 msgr2=0x7fb43006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9c3fff700 1 -- 172.21.15.32:0/2417851005 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900670251 0 0) 0x7fb9cc0ce360 con 0x7fb9cc15da70 2023-10-14T12:18:53.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9c3fff700 1 -- 172.21.15.32:0/2417851005 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b80035b0 con 0x7fb9cc15da70 2023-10-14T12:18:53.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9d1c56700 1 -- 172.21.15.32:0/2417851005 >> v2:172.21.15.32:3300/0 conn(0x7fb9cc06d0c0 msgr2=0x7fb9cc0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9d1c56700 1 --2- 172.21.15.32:0/2417851005 >> v2:172.21.15.32:3300/0 conn(0x7fb9cc06d0c0 0x7fb9cc0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9d1c56700 1 -- 172.21.15.32:0/2417851005 >> v1:172.21.15.32:6789/0 conn(0x7fb9cc15da70 legacy=0x7fb9cc06c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fb9d1c56700 1 -- 172.21.15.32:0/2417851005 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0cda30 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7fb9d1c56700 1 --2- 172.21.15.32:0/2417851005 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc0ccfc0 0x7fb9cc0709a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009d90 tx=0x7fb9c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec85081271d616a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7f2ee37fe700 1 -- 172.21.15.32:0/3200082347 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400dd30 con 0x7f2ee415a850 2023-10-14T12:18:53.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7f2ee37fe700 1 -- 172.21.15.32:0/3200082347 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed400de90 con 0x7f2ee415a850 2023-10-14T12:18:53.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7f2ee37fe700 1 -- 172.21.15.32:0/3200082347 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4010690 con 0x7f2ee415a850 2023-10-14T12:18:53.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7f5325971700 1 Processor -- start 2023-10-14T12:18:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7fb9c3fff700 1 -- 172.21.15.32:0/2417851005 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400e070 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7fb9c3fff700 1 -- 172.21.15.32:0/2417851005 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400bb20 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7fb9c3fff700 1 -- 172.21.15.32:0/2417851005 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4012430 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.879+0000 7fda46e70700 1 -- 172.21.15.32:0/2925450545 wait complete. 2023-10-14T12:18:53.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7fda46e70700 1 Processor -- start 2023-10-14T12:18:53.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb4383aa700 1 -- 172.21.15.32:0/3522409195 shutdown_connections 2023-10-14T12:18:53.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 -- 172.21.15.32:0/3200082347 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 msgr2=0x7f2ee40cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/3200082347 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 0x7f2ee40cbc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40caa90 tx=0x7f2ed400be70 comp rx=0 tx=0).stop 2023-10-14T12:18:53.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 -- 172.21.15.32:0/3200082347 shutdown_connections 2023-10-14T12:18:53.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/3200082347 >> v2:172.21.15.92:3300/0 conn(0x7f2ee40cd2e0 0x7f2ee4071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/3200082347 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee415a850 0x7f2ee40cbc40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/3200082347 >> v2:172.21.15.32:3300/0 conn(0x7f2ee40b2940 0x7f2ee40ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 -- 172.21.15.32:0/3200082347 >> 172.21.15.32:0/3200082347 conn(0x7f2ee406dac0 msgr2=0x7f2ee406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 -- 172.21.15.32:0/3200082347 shutdown_connections 2023-10-14T12:18:53.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f2eeaefd700 1 -- 172.21.15.32:0/3200082347 wait complete. 2023-10-14T12:18:53.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f2eeaefd700 1 Processor -- start 2023-10-14T12:18:53.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fda46e70700 1 -- start start 2023-10-14T12:18:53.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda46e70700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda46e70700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4008a700 0x7fda401f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda46e70700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 0x7fda40214bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda46e70700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda402147b0 con 0x7fda4008a700 2023-10-14T12:18:53.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda46e70700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda40210f40 con 0x7fda401f47d0 2023-10-14T12:18:53.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda46e70700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda401f68e0 con 0x7fda4006d0c0 2023-10-14T12:18:53.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda4540d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 0x7fda40214bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda4540d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 0x7fda40214bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42518/0 (socket says 172.21.15.32:42518) 2023-10-14T12:18:53.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda4540d700 1 -- 172.21.15.32:0/1034683790 learned_addr learned my addr 172.21.15.32:0/1034683790 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda3ffff700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4008a700 0x7fda401f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fda44c0c700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fda3ffff700 1 -- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 msgr2=0x7fda400add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fda3ffff700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fda3ffff700 1 -- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 msgr2=0x7fda40214bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fda3ffff700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 0x7fda40214bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fda3ffff700 1 -- 172.21.15.32:0/1034683790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300085d0 con 0x7fda4008a700 2023-10-14T12:18:53.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 -- 172.21.15.32:0/2417851005 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc0ccfc0 msgr2=0x7fb9cc0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/2417851005 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc0ccfc0 0x7fb9cc0709a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009d90 tx=0x7fb9c400b330 comp rx=0 tx=0).stop 2023-10-14T12:18:53.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 -- 172.21.15.32:0/2417851005 shutdown_connections 2023-10-14T12:18:53.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/2417851005 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc0ccfc0 0x7fb9cc0709a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/2417851005 >> v2:172.21.15.32:3300/0 conn(0x7fb9cc06d0c0 0x7fb9cc0ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 -- 172.21.15.32:0/2417851005 >> 172.21.15.32:0/2417851005 conn(0x7fb9cc0cf3f0 msgr2=0x7fb9cc0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:53.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 -- 172.21.15.32:0/2417851005 shutdown_connections 2023-10-14T12:18:53.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7fb9d36b9700 1 -- 172.21.15.32:0/2417851005 wait complete. 2023-10-14T12:18:53.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.880+0000 7f5325971700 1 -- start start 2023-10-14T12:18:53.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f5325971700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532008a700 0x7f532016cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f5325971700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532016f060 0x7f53200c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f5325971700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 0x7f53202060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f5325971700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53202065e0 con 0x7f5320205bf0 2023-10-14T12:18:53.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f5325971700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532016aec0 con 0x7f532008a700 2023-10-14T12:18:53.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.881+0000 7f5325971700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532016b180 con 0x7f532016f060 2023-10-14T12:18:53.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 0x7f53202060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 0x7f53202060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38246/0 (socket says 172.21.15.32:38246) 2023-10-14T12:18:53.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 -- 172.21.15.32:0/1358476211 learned_addr learned my addr 172.21.15.32:0/1358476211 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531effd700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532008a700 0x7f532016cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531e7fc700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532016f060 0x7f53200c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 -- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532016f060 msgr2=0x7f53200c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532016f060 0x7f53200c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 -- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532008a700 msgr2=0x7f532016cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532008a700 0x7f532016cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 -- 172.21.15.32:0/1358476211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531000d940 con 0x7f5320205bf0 2023-10-14T12:18:53.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7f531f7fe700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 0x7f53202060a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f531400e7f0 tx=0x7f531400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fb9d36b9700 1 Processor -- start 2023-10-14T12:18:53.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fda4540d700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 0x7fda40214bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:53.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f9ad6dfa700 1 Processor -- start 2023-10-14T12:18:53.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314013680 con 0x7f5320205bf0 2023-10-14T12:18:53.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140137e0 con 0x7f5320205bf0 2023-10-14T12:18:53.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314013b70 con 0x7f5320205bf0 2023-10-14T12:18:53.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532016b460 con 0x7f5320205bf0 2023-10-14T12:18:53.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532016ba20 con 0x7f5320205bf0 2023-10-14T12:18:53.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.882+0000 7fb4383aa700 1 -- 172.21.15.32:0/3522409195 wait complete. 2023-10-14T12:18:53.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7fb4383aa700 1 Processor -- start 2023-10-14T12:18:53.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7fda3ffff700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4008a700 0x7fda401f4290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda3400c400 tx=0x7fda3400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7f2eeaefd700 1 -- start start 2023-10-14T12:18:53.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f2eeaefd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee40b2940 0x7f2ee41575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f2eeaefd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ee40cd2e0 0x7f2ee40b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f2eeaefd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ee415a850 0x7f2ee40b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f2eeaefd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee415af10 con 0x7f2ee415a850 2023-10-14T12:18:53.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f2eeaefd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c5030 con 0x7f2ee40cd2e0 2023-10-14T12:18:53.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f2eeaefd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c5280 con 0x7f2ee40b2940 2023-10-14T12:18:53.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.883+0000 7fb9d36b9700 1 -- start start 2023-10-14T12:18:53.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7fb9d36b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc06d0c0 0x7fb9cc0a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7fb9d36b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 0x7fb9cc1feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d36b9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9cc15da70 0x7fb9cc0abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d36b9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0a9650 con 0x7fb9cc15da70 2023-10-14T12:18:53.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d36b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc1ff430 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d36b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0a89d0 con 0x7fb9cc06d0c0 2023-10-14T12:18:53.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ee40cd2e0 0x7f2ee40b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ee40cd2e0 0x7f2ee40b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42524/0 (socket says 172.21.15.32:42524) 2023-10-14T12:18:53.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee3fff700 1 -- 172.21.15.32:0/2903132120 learned_addr learned my addr 172.21.15.32:0/2903132120 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee40b2940 0x7f2ee41575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 0x7fb9cc1feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d1455700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc06d0c0 0x7fb9cc0a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 0x7fb9cc1feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42526/0 (socket says 172.21.15.32:42526) 2023-10-14T12:18:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 -- 172.21.15.32:0/684038112 learned_addr learned my addr 172.21.15.32:0/684038112 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d1c56700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9cc15da70 0x7fb9cc0abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 -- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc06d0c0 msgr2=0x7fb9cc0a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc06d0c0 0x7fb9cc0a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 -- 172.21.15.32:0/684038112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9cc15da70 msgr2=0x7fb9cc0abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9cc15da70 0x7fb9cc0abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb9d0c54700 1 -- 172.21.15.32:0/684038112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4009a70 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7f9ad6dfa700 1 -- start start 2023-10-14T12:18:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f9ad6dfa700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9ad0162300 0x7f9ad0071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f9ad6dfa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9ad006daa0 0x7f9ad00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f9ad6dfa700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad00caa80 con 0x7f9ad00717c0 2023-10-14T12:18:53.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f9ad6dfa700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad01626e0 con 0x7f9ad0162300 2023-10-14T12:18:53.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f9ad6dfa700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad00cbf20 con 0x7f9ad006daa0 2023-10-14T12:18:53.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee949a700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ee415a850 0x7f2ee40b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee8c99700 1 -- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ee40cd2e0 msgr2=0x7f2ee40b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ee40cd2e0 0x7f2ee40b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee8c99700 1 -- 172.21.15.32:0/2903132120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ee415a850 msgr2=0x7f2ee40b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ee415a850 0x7f2ee40b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7f2ee8c99700 1 -- 172.21.15.32:0/2903132120 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed400b7f0 con 0x7f2ee40b2940 2023-10-14T12:18:53.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.884+0000 7fb4383aa700 1 -- start start 2023-10-14T12:18:53.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb4383aa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 0x7fb4300b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb4383aa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4300cc3f0 0x7fb43015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb4383aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430161670 0x7fb43015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:53.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.885+0000 7fb4383aa700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43015e5c0 con 0x7fb4300cc3f0 2023-10-14T12:18:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb4383aa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300ada30 con 0x7fb430161670 2023-10-14T12:18:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb4383aa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300ae2d0 con 0x7fb43006af50 2023-10-14T12:18:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb436146700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 0x7fb4300b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb436146700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 0x7fb4300b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:43968/0 (socket says 172.21.15.32:43968) 2023-10-14T12:18:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb436146700 1 -- 172.21.15.32:0/337349692 learned_addr learned my addr 172.21.15.32:0/337349692 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb9d0c54700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 0x7fb9cc1feef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00e810 tx=0x7fb9bc00eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00c070 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9acffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9ad00717c0 0x7f9ad006d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54170/0 (socket says 172.21.15.32:54170) 2023-10-14T12:18:53.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9acffff700 1 -- 172.21.15.32:0/2061603718 learned_addr learned my addr 172.21.15.32:0/2061603718 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:53.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9ad5397700 1 --2- 172.21.15.32:0/2061603718 >> v2:172.21.15.92:3300/0 conn(0x7f9ad006daa0 0x7f9ad00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:53.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9ad5397700 1 -- 172.21.15.32:0/2061603718 >> v2:172.21.15.32:3300/0 conn(0x7f9ad0162300 msgr2=0x7f9ad0071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:53.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9ad5397700 1 --2- 172.21.15.32:0/2061603718 >> v2:172.21.15.32:3300/0 conn(0x7f9ad0162300 0x7f9ad0071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:53.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340052d0 con 0x7fda4008a700 2023-10-14T12:18:53.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34005430 con 0x7fda4008a700 2023-10-14T12:18:53.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc013610 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0139c0 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc0a8cb0 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc0a9270 con 0x7fb9cc0ccfc0 2023-10-14T12:18:53.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda401f6bc0 con 0x7fda4008a700 2023-10-14T12:18:53.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9ad5397700 1 -- 172.21.15.32:0/2061603718 >> v1:172.21.15.92:6789/0 conn(0x7f9ad00717c0 legacy=0x7f9ad006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f9ad5397700 1 -- 172.21.15.32:0/2061603718 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00722e0 con 0x7f9ad006daa0 2023-10-14T12:18:53.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda401f7180 con 0x7fda4008a700 2023-10-14T12:18:53.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fb436146700 1 -- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430161670 msgr2=0x7fb43015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:53.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fb436146700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430161670 0x7fb43015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fb436146700 1 -- 172.21.15.32:0/337349692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4300cc3f0 msgr2=0x7fb43015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fb436146700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4300cc3f0 0x7fb43015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fb436146700 1 -- 172.21.15.32:0/337349692 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009a70 con 0x7fb43006af50 2023-10-14T12:18:54.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f9ad5397700 1 --2- 172.21.15.32:0/2061603718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad006daa0 0x7f9ad00b4db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0071210 tx=0x7f9ac4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4a155c7659d717 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fb436146700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 0x7fb4300b5350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00b550 tx=0x7fb42c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.886+0000 7f2ee8c99700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee40b2940 0x7f2ee41575e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ee406d5e0 tx=0x7f2ed4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4003bf0 con 0x7f2ee40b2940 2023-10-14T12:18:54.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed401e070 con 0x7f2ee40b2940 2023-10-14T12:18:54.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4024470 con 0x7f2ee40b2940 2023-10-14T12:18:54.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40c5560 con 0x7f2ee40b2940 2023-10-14T12:18:54.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40c5b20 con 0x7f2ee40b2940 2023-10-14T12:18:54.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec40052f0 con 0x7f2ee40b2940 2023-10-14T12:18:54.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340038c0 con 0x7fda4008a700 2023-10-14T12:18:54.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.888+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc04ebb0 con 0x7fb9cc0ccfc0 2023-10-14T12:18:54.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb9bc013b20 con 0x7fb9cc0ccfc0 2023-10-14T12:18:54.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5314013cd0 con 0x7f5320205bf0 2023-10-14T12:18:54.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000052f0 con 0x7f5320205bf0 2023-10-14T12:18:54.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f5307fff700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f530806b0b0 0x7f530806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.888+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5314089410 con 0x7f5320205bf0 2023-10-14T12:18:54.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7f531effd700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f530806b0b0 0x7f530806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f9acf7fe700 1 -- 172.21.15.32:0/2061603718 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4004230 con 0x7f9ad006daa0 2023-10-14T12:18:54.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f9acf7fe700 1 -- 172.21.15.32:0/2061603718 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac4004390 con 0x7f9ad006daa0 2023-10-14T12:18:54.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.887+0000 7f9acf7fe700 1 -- 172.21.15.32:0/2061603718 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40036a0 con 0x7f9ad006daa0 2023-10-14T12:18:54.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.888+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2061603718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad006daa0 msgr2=0x7f9ad00b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.888+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2061603718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad006daa0 0x7f9ad00b4db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0071210 tx=0x7f9ac4009b20 comp rx=0 tx=0).stop 2023-10-14T12:18:54.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fb9c1ffb700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb9b006af50 0x7fb9b006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9bc089250 con 0x7fb9cc0ccfc0 2023-10-14T12:18:54.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fb9d1455700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb9b006af50 0x7fb9b006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011830 con 0x7fb43006af50 2023-10-14T12:18:54.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c011990 con 0x7fb43006af50 2023-10-14T12:18:54.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c011d40 con 0x7fb43006af50 2023-10-14T12:18:54.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4300cd060 con 0x7fb43006af50 2023-10-14T12:18:54.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4300adc80 con 0x7fb43006af50 2023-10-14T12:18:54.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda34003a20 con 0x7fda4008a700 2023-10-14T12:18:54.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda200052f0 con 0x7fda4008a700 2023-10-14T12:18:54.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7fda3d7fa700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fda2c06af50 0x7fda2c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda34088740 con 0x7fda4008a700 2023-10-14T12:18:54.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f531effd700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f530806b0b0 0x7f530806d570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53180072b0 tx=0x7f531800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2061603718 shutdown_connections 2023-10-14T12:18:54.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2061603718 >> v2:172.21.15.32:3300/0 conn(0x7f9ad0162300 0x7f9ad0071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2061603718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad006daa0 0x7f9ad00b4db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.889+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2061603718 >> 172.21.15.32:0/2061603718 conn(0x7f9ad00cfc40 msgr2=0x7f9ad00d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2061603718 shutdown_connections 2023-10-14T12:18:54.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2061603718 wait complete. 2023-10-14T12:18:54.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f3f97bdd700 1 Processor -- start 2023-10-14T12:18:54.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7fda44c0c700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fda2c06af50 0x7fda2c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4180052f0 con 0x7fb43006af50 2023-10-14T12:18:54.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7fb9d1455700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb9b006af50 0x7fb9b006d410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8007fd0 tx=0x7fb9c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7fda44c0c700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fda2c06af50 0x7fda2c06d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda30000c00 tx=0x7fda3000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ed4019400 con 0x7f2ee40b2940 2023-10-14T12:18:54.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7f2ee17fa700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2ed006afd0 0x7f2ed006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed408cf40 con 0x7f2ee40b2940 2023-10-14T12:18:54.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.891+0000 7f2ee3fff700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2ed006afd0 0x7f2ed006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f8ffb17b700 1 Processor -- start 2023-10-14T12:18:54.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f9ad6dfa700 1 Processor -- start 2023-10-14T12:18:54.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.890+0000 7f3f97bdd700 1 -- start start 2023-10-14T12:18:54.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f97bdd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f90157250 0x7f3f9015df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f97bdd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f900c9fc0 0x7f3f90159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f97bdd700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9015af20 con 0x7f3f9015a4e0 2023-10-14T12:18:54.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f97bdd700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9015e470 con 0x7f3f90157250 2023-10-14T12:18:54.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f97bdd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9015a960 con 0x7f3f900c9fc0 2023-10-14T12:18:54.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f8ffb17b700 1 -- start start 2023-10-14T12:18:54.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f9ad6dfa700 1 -- start start 2023-10-14T12:18:54.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f2ee3fff700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2ed006afd0 0x7f2ed006d490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2edc003bc0 tx=0x7f2edc009930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f900c9fc0 0x7f3f90159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f900c9fc0 0x7f3f90159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42560/0 (socket says 172.21.15.32:42560) 2023-10-14T12:18:54.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 -- 172.21.15.32:0/3855394807 learned_addr learned my addr 172.21.15.32:0/3855394807 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:54.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 -- 172.21.15.32:0/3855394807 >> v2:172.21.15.32:3300/0 conn(0x7f3f90157250 msgr2=0x7f3f9015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:54.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 --2- 172.21.15.32:0/3855394807 >> v2:172.21.15.32:3300/0 conn(0x7f3f90157250 0x7f3f9015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 -- 172.21.15.32:0/3855394807 >> v1:172.21.15.32:6789/0 conn(0x7f3f9015a4e0 legacy=0x7f3f9006c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:54.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.892+0000 7f3f95178700 1 -- 172.21.15.32:0/3855394807 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9015ac40 con 0x7f3f900c9fc0 2023-10-14T12:18:54.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f3f95178700 1 --2- 172.21.15.32:0/3855394807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f900c9fc0 0x7f3f90159fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f900aedf0 tx=0x7f3f8c00b4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14d0fb4af52aabb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ffb17b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ff4157250 0x7f8ff415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ffb17b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff415af20 con 0x7f8ff4157630 2023-10-14T12:18:54.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ffb17b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff415e470 con 0x7f8ff40c9fc0 2023-10-14T12:18:54.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ffb17b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff415a6b0 con 0x7f8ff4157250 2023-10-14T12:18:54.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ff3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8ff40c9fc0 0x7f8ff4159fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54196/0 (socket says 172.21.15.32:54196) 2023-10-14T12:18:54.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ff3fff700 1 -- 172.21.15.32:0/2924252981 learned_addr learned my addr 172.21.15.32:0/2924252981 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:54.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ff8f17700 1 --2- 172.21.15.32:0/2924252981 >> v2:172.21.15.32:3300/0 conn(0x7f8ff4157250 0x7f8ff415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad6dfa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ad006daa0 0x7f9ad0165110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad6dfa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 0x7f9ad00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad6dfa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad0162300 0x7f9ad00c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad6dfa700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c5b30 con 0x7f9ad00717c0 2023-10-14T12:18:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad6dfa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c4a90 con 0x7f9ad0162300 2023-10-14T12:18:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad6dfa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c4d70 con 0x7f9ad006daa0 2023-10-14T12:18:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9acffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 0x7f9ad00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9acffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 0x7f9ad00c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38300/0 (socket says 172.21.15.32:38300) 2023-10-14T12:18:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9acffff700 1 -- 172.21.15.32:0/2290630149 learned_addr learned my addr 172.21.15.32:0/2290630149 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:54.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ff8f17700 1 -- 172.21.15.32:0/2924252981 >> v1:172.21.15.92:6789/0 conn(0x7f8ff40c9fc0 legacy=0x7f8ff4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ff8f17700 1 -- 172.21.15.32:0/2924252981 >> v1:172.21.15.32:6789/0 conn(0x7f8ff4157630 legacy=0x7f8ff406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad5397700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad0162300 0x7f9ad00c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f8ff8f17700 1 -- 172.21.15.32:0/2924252981 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff415a960 con 0x7f8ff4157250 2023-10-14T12:18:54.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.893+0000 7f9ad4b96700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ad006daa0 0x7f9ad0165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f8ff8f17700 1 --2- 172.21.15.32:0/2924252981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157250 0x7f8ff415df30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009840 tx=0x7f8fe8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12571d0d610ca2de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f9acffff700 1 -- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ad006daa0 msgr2=0x7f9ad0165110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f9acffff700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ad006daa0 0x7f9ad0165110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f9acffff700 1 -- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad0162300 msgr2=0x7f9ad00c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f9acffff700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad0162300 0x7f9ad00c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f9acffff700 1 -- 172.21.15.32:0/2290630149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40094a0 con 0x7f9ad00717c0 2023-10-14T12:18:54.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.894+0000 7f9acffff700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 0x7f9ad00c8f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8002050 tx=0x7f9ac800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.895+0000 7f3f94977700 1 -- 172.21.15.32:0/3855394807 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00e070 con 0x7f3f900c9fc0 2023-10-14T12:18:54.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.895+0000 7f3f94977700 1 -- 172.21.15.32:0/3855394807 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00be40 con 0x7f3f900c9fc0 2023-10-14T12:18:54.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.895+0000 7f3f94977700 1 -- 172.21.15.32:0/3855394807 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c004250 con 0x7f3f900c9fc0 2023-10-14T12:18:54.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.895+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9bc054390 con 0x7fb9cc0ccfc0 2023-10-14T12:18:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.895+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ed4058180 con 0x7f2ee40b2940 2023-10-14T12:18:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 -- 172.21.15.32:0/3855394807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f900c9fc0 msgr2=0x7f3f90159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/3855394807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f900c9fc0 0x7f3f90159fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f900aedf0 tx=0x7f3f8c00b4c0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 -- 172.21.15.32:0/3855394807 shutdown_connections 2023-10-14T12:18:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/3855394807 >> v2:172.21.15.32:3300/0 conn(0x7f3f90157250 0x7f3f9015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/3855394807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f900c9fc0 0x7f3f90159fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 -- 172.21.15.32:0/3855394807 >> 172.21.15.32:0/3855394807 conn(0x7f3f900cf3f0 msgr2=0x7f3f900cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 -- 172.21.15.32:0/3855394807 shutdown_connections 2023-10-14T12:18:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7f3f97bdd700 1 -- 172.21.15.32:0/3855394807 wait complete. 2023-10-14T12:18:54.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.896+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb42c01a400 con 0x7fb43006af50 2023-10-14T12:18:54.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.897+0000 7fb426ffd700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb41406af50 0x7fb41406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.897+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb42c089ad0 con 0x7fb43006af50 2023-10-14T12:18:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.897+0000 7fb435945700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb41406af50 0x7fb41406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.897+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5314054550 con 0x7f5320205bf0 2023-10-14T12:18:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.897+0000 7fb435945700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb41406af50 0x7fb41406d410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb420000c00 tx=0x7fb420007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.898+0000 7f3f97bdd700 1 Processor -- start 2023-10-14T12:18:54.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.898+0000 7f3f97bdd700 1 -- start start 2023-10-14T12:18:54.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f97bdd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 0x7f3f9013df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f97bdd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f90157250 0x7f3f900b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f97bdd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9015a4e0 0x7f3f9013e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f97bdd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900b4020 con 0x7f3f900c9fc0 2023-10-14T12:18:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f97bdd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900b4300 con 0x7f3f9015a4e0 2023-10-14T12:18:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f97bdd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900b45e0 con 0x7f3f90157250 2023-10-14T12:18:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 0x7f3f9013df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 0x7f3f9013df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38308/0 (socket says 172.21.15.32:38308) 2023-10-14T12:18:54.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 -- 172.21.15.32:0/1618812776 learned_addr learned my addr 172.21.15.32:0/1618812776 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:54.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f9617a700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9015a4e0 0x7f3f9013e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 -- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f90157250 msgr2=0x7f3f900b37b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:18:54.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f90157250 0x7f3f900b37b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 -- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9015a4e0 msgr2=0x7f3f9013e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9015a4e0 0x7f3f9013e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 -- 172.21.15.32:0/1618812776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c009e70 con 0x7f3f900c9fc0 2023-10-14T12:18:54.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.899+0000 7f3f95979700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 0x7f3f9013df80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000b530 tx=0x7f3f8000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.900+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb42c054db0 con 0x7fb43006af50 2023-10-14T12:18:54.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f8ff37fe700 1 -- 172.21.15.32:0/2924252981 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8011830 con 0x7f8ff4157250 2023-10-14T12:18:54.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800ac90 con 0x7f9ad00717c0 2023-10-14T12:18:54.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac800adf0 con 0x7f9ad00717c0 2023-10-14T12:18:54.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8007310 con 0x7f9ad00717c0 2023-10-14T12:18:54.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda34053960 con 0x7fda4008a700 2023-10-14T12:18:54.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80011830 con 0x7f3f900c9fc0 2023-10-14T12:18:54.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f8ff37fe700 1 -- 172.21.15.32:0/2924252981 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe8011990 con 0x7f8ff4157250 2023-10-14T12:18:54.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.906+0000 7f8ff37fe700 1 -- 172.21.15.32:0/2924252981 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8011d20 con 0x7f8ff4157250 2023-10-14T12:18:54.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.907+0000 7f8ffb17b700 1 -- 172.21.15.32:0/2924252981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157250 msgr2=0x7f8ff415df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.907+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/2924252981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157250 0x7f8ff415df30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009840 tx=0x7f8fe8009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:54.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.907+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad00c5050 con 0x7f9ad00717c0 2023-10-14T12:18:54.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.907+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad00c5610 con 0x7f9ad00717c0 2023-10-14T12:18:54.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.907+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f900b48c0 con 0x7f3f900c9fc0 2023-10-14T12:18:54.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.907+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f900b3cf0 con 0x7f3f900c9fc0 2023-10-14T12:18:54.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.908+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad0067d20 con 0x7f9ad00717c0 2023-10-14T12:18:54.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.908+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80011990 con 0x7f3f900c9fc0 2023-10-14T12:18:54.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.908+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80011d00 con 0x7f3f900c9fc0 2023-10-14T12:18:54.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.909+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f780052f0 con 0x7f3f900c9fc0 2023-10-14T12:18:54.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.909+0000 7f8ffb17b700 1 -- 172.21.15.32:0/2924252981 shutdown_connections 2023-10-14T12:18:54.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.909+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/2924252981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157250 0x7f8ff415df30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.909+0000 7f8ffb17b700 1 -- 172.21.15.32:0/2924252981 >> 172.21.15.32:0/2924252981 conn(0x7f8ff40cf3f0 msgr2=0x7f8ff40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.909+0000 7f8ffb17b700 1 -- 172.21.15.32:0/2924252981 shutdown_connections 2023-10-14T12:18:54.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.910+0000 7f8ffb17b700 1 -- 172.21.15.32:0/2924252981 wait complete. 2023-10-14T12:18:54.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.912+0000 7f8ffb17b700 1 Processor -- start 2023-10-14T12:18:54.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.912+0000 7f8ffb17b700 1 -- start start 2023-10-14T12:18:54.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ffb17b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ff40c9fc0 0x7f8ff414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ffb17b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 0x7f8ff414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ffb17b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157630 0x7f8ff414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ffb17b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c3fc0 con 0x7f8ff4157630 2023-10-14T12:18:54.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ffb17b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c2f20 con 0x7f8ff4157250 2023-10-14T12:18:54.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ffb17b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c3200 con 0x7f8ff40c9fc0 2023-10-14T12:18:54.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.913+0000 7f8ff3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 0x7f8ff414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 0x7f8ff414eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42582/0 (socket says 172.21.15.32:42582) 2023-10-14T12:18:54.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 -- 172.21.15.32:0/1238309587 learned_addr learned my addr 172.21.15.32:0/1238309587 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:54.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 -- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ff40c9fc0 msgr2=0x7f8ff414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ff40c9fc0 0x7f8ff414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 -- 172.21.15.32:0/1238309587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157630 msgr2=0x7f8ff414d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157630 0x7f8ff414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 -- 172.21.15.32:0/1238309587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe80094a0 con 0x7f8ff4157250 2023-10-14T12:18:54.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.914+0000 7f8ff3fff700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 0x7f8ff414eb80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c480 tx=0x7f8fe400c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.919+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f80024440 con 0x7f3f900c9fc0 2023-10-14T12:18:54.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.919+0000 7f3f867fc700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f7406af00 0x7f3f7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.919+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f80089ca0 con 0x7f3f900c9fc0 2023-10-14T12:18:54.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.920+0000 7f3f95178700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f7406af00 0x7f3f7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.921+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ac8007470 con 0x7f9ad00717c0 2023-10-14T12:18:54.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.921+0000 7f9acd7fa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9abc06afd0 0x7f9abc06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.921+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ac8089a30 con 0x7f9ad00717c0 2023-10-14T12:18:54.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.922+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ac80b5d40 con 0x7f9ad00717c0 2023-10-14T12:18:54.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.922+0000 7f9ad4b96700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9abc06afd0 0x7f9abc06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.922+0000 7f9ad4b96700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9abc06afd0 0x7f9abc06d490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00b5260 tx=0x7f9ac0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.922+0000 7f3f95178700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f7406af00 0x7f3f7406d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b50c0 tx=0x7f3f8c009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.922+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4005d70 con 0x7f8ff4157250 2023-10-14T12:18:54.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.923+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe40070d0 con 0x7f8ff4157250 2023-10-14T12:18:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.923+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4007440 con 0x7f8ff4157250 2023-10-14T12:18:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.924+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff40c34e0 con 0x7f8ff4157250 2023-10-14T12:18:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.924+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff40c3aa0 con 0x7f8ff4157250 2023-10-14T12:18:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.927+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8fe40075a0 con 0x7f8ff4157250 2023-10-14T12:18:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.927+0000 7f8ff17fa700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8fe006afd0 0x7f8fe006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.927+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fe4088a00 con 0x7f8ff4157250 2023-10-14T12:18:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.928+0000 7f8ff8f17700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8fe006afd0 0x7f8fe006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.928+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff404ebb0 con 0x7f8ff4157250 2023-10-14T12:18:54.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.928+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f80054d30 con 0x7f3f900c9fc0 2023-10-14T12:18:54.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.929+0000 7f8ff8f17700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8fe006afd0 0x7f8fe006d490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40aeb00 tx=0x7f8fe8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:54.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:53.933+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fe4053bd0 con 0x7f8ff4157250 2023-10-14T12:18:54.308 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.302+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5300005870 con 0x7f5320205bf0 2023-10-14T12:18:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.302+0000 7f5307fff700 1 -- 172.21.15.32:0/1358476211 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5314021030 con 0x7f5320205bf0 2023-10-14T12:18:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f530806b0b0 msgr2=0x7f530806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f530806b0b0 0x7f530806d570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53180072b0 tx=0x7f531800d040 comp rx=0 tx=0).stop 2023-10-14T12:18:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 msgr2=0x7f53202060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 0x7f53202060a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f531400e7f0 tx=0x7f531400ebb0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 shutdown_connections 2023-10-14T12:18:54.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5320205bf0 0x7f53202060a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f530806b0b0 0x7f530806d570 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53180072b0 tx=0x7f531800d040 comp rx=0 tx=0).stop 2023-10-14T12:18:54.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f532008a700 0x7f532016cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 --2- 172.21.15.32:0/1358476211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f532016f060 0x7f53200c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.306+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 >> 172.21.15.32:0/1358476211 conn(0x7f53200cf3f0 msgr2=0x7f53200af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.307+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 shutdown_connections 2023-10-14T12:18:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.307+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb418005870 con 0x7fb43006af50 2023-10-14T12:18:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.308+0000 7fb426ffd700 1 -- 172.21.15.32:0/337349692 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb42c015090 con 0x7fb43006af50 2023-10-14T12:18:54.317 INFO:teuthology.orchestra.run.smithi032.stdout:55834574851 2023-10-14T12:18:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.309+0000 7f5325971700 1 -- 172.21.15.32:0/1358476211 wait complete. 2023-10-14T12:18:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb41406af50 msgr2=0x7fb41406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb41406af50 0x7fb41406d410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb420000c00 tx=0x7fb420007a50 comp rx=0 tx=0).stop 2023-10-14T12:18:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 msgr2=0x7fb4300b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 0x7fb4300b5350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00b550 tx=0x7fb42c00b910 comp rx=0 tx=0).stop 2023-10-14T12:18:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 shutdown_connections 2023-10-14T12:18:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb41406af50 0x7fb41406d410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430161670 0x7fb43015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb43006af50 0x7fb4300b5350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 --2- 172.21.15.32:0/337349692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4300cc3f0 0x7fb43015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 >> 172.21.15.32:0/337349692 conn(0x7fb43006dac0 msgr2=0x7fb4300b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 shutdown_connections 2023-10-14T12:18:54.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.311+0000 7fb4383aa700 1 -- 172.21.15.32:0/337349692 wait complete. 2023-10-14T12:18:54.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.313+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ec4005870 con 0x7f2ee40b2940 2023-10-14T12:18:54.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.316+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb9cc06ba10 con 0x7fb9cc0ccfc0 2023-10-14T12:18:54.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.316+0000 7fb9c1ffb700 1 -- 172.21.15.32:0/684038112 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9bc0579b0 con 0x7fb9cc0ccfc0 2023-10-14T12:18:54.323 INFO:teuthology.orchestra.run.smithi032.stdout:55834574852 2023-10-14T12:18:54.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.320+0000 7f2ee17fa700 1 -- 172.21.15.32:0/2903132120 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ed4006d80 con 0x7f2ee40b2940 2023-10-14T12:18:54.323 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:54.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb9b006af50 msgr2=0x7fb9b006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb9b006af50 0x7fb9b006d410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8007fd0 tx=0x7fb9c8009040 comp rx=0 tx=0).stop 2023-10-14T12:18:54.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 msgr2=0x7fb9cc1feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 0x7fb9cc1feef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00e810 tx=0x7fb9bc00eb20 comp rx=0 tx=0).stop 2023-10-14T12:18:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 shutdown_connections 2023-10-14T12:18:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9cc15da70 0x7fb9cc0abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9cc06d0c0 0x7fb9cc0a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb9b006af50 0x7fb9b006d410 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8007fd0 tx=0x7fb9c8009040 comp rx=0 tx=0).stop 2023-10-14T12:18:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 --2- 172.21.15.32:0/684038112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9cc0ccfc0 0x7fb9cc1feef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.322+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 >> 172.21.15.32:0/684038112 conn(0x7fb9cc0cf3f0 msgr2=0x7fb9cc15e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2ed006afd0 msgr2=0x7f2ed006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2ed006afd0 0x7f2ed006d490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2edc003bc0 tx=0x7f2edc009930 comp rx=0 tx=0).stop 2023-10-14T12:18:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee40b2940 msgr2=0x7f2ee41575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee40b2940 0x7f2ee41575e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ee406d5e0 tx=0x7f2ed4004750 comp rx=0 tx=0).stop 2023-10-14T12:18:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 shutdown_connections 2023-10-14T12:18:54.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 shutdown_connections 2023-10-14T12:18:54.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ee415a850 0x7f2ee40b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ee40b2940 0x7f2ee41575e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2ed006afd0 0x7f2ed006d490 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2edc003bc0 tx=0x7f2edc009930 comp rx=0 tx=0).stop 2023-10-14T12:18:54.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 --2- 172.21.15.32:0/2903132120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ee40cd2e0 0x7f2ee40b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 >> 172.21.15.32:0/2903132120 conn(0x7f2ee406dac0 msgr2=0x7f2ee4071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.325+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 shutdown_connections 2023-10-14T12:18:54.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.325+0000 7f2eeaefd700 1 -- 172.21.15.32:0/2903132120 wait complete. 2023-10-14T12:18:54.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.324+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fda20005870 con 0x7fda4008a700 2023-10-14T12:18:54.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.329+0000 7fda3d7fa700 1 -- 172.21.15.32:0/1034683790 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda34086e60 con 0x7fda4008a700 2023-10-14T12:18:54.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.329+0000 7fb9d36b9700 1 -- 172.21.15.32:0/684038112 wait complete. 2023-10-14T12:18:54.336 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:54.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2023-10-14T12:18:54.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fda2c06af50 msgr2=0x7fda2c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fda2c06af50 0x7fda2c06d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda30000c00 tx=0x7fda3000a000 comp rx=0 tx=0).stop 2023-10-14T12:18:54.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4008a700 msgr2=0x7fda401f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4008a700 0x7fda401f4290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda3400c400 tx=0x7fda3400c710 comp rx=0 tx=0).stop 2023-10-14T12:18:54.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 shutdown_connections 2023-10-14T12:18:54.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fda2c06af50 0x7fda2c06d410 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda30000c00 tx=0x7fda3000a000 comp rx=0 tx=0).stop 2023-10-14T12:18:54.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda401f47d0 0x7fda40214bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda4006d0c0 0x7fda400add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 --2- 172.21.15.32:0/1034683790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda4008a700 0x7fda401f4290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.333+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 >> 172.21.15.32:0/1034683790 conn(0x7fda400cf3f0 msgr2=0x7fda4016d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.334+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 shutdown_connections 2023-10-14T12:18:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.334+0000 7fda46e70700 1 -- 172.21.15.32:0/1034683790 wait complete. 2023-10-14T12:18:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.335+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9ad00d0130 con 0x7f9ad00717c0 2023-10-14T12:18:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.336+0000 7f9acd7fa700 1 -- 172.21.15.32:0/2290630149 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ac8018070 con 0x7f9ad00717c0 2023-10-14T12:18:54.340 INFO:teuthology.orchestra.run.smithi032.stdout:55834574852 2023-10-14T12:18:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.341+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8ff40cd260 con 0x7f8ff4157250 2023-10-14T12:18:54.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.342+0000 7f8ff17fa700 1 -- 172.21.15.32:0/1238309587 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fe4017070 con 0x7f8ff4157250 2023-10-14T12:18:54.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-14T12:18:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.344+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9abc06afd0 msgr2=0x7f9abc06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.344+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9abc06afd0 0x7f9abc06d490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00b5260 tx=0x7f9ac0009190 comp rx=0 tx=0).stop 2023-10-14T12:18:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.344+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 msgr2=0x7f9ad00c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.344+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 0x7f9ad00c8f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8002050 tx=0x7f9ac800a340 comp rx=0 tx=0).stop 2023-10-14T12:18:54.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-14T12:18:54.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 shutdown_connections 2023-10-14T12:18:54.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9abc06afd0 0x7f9abc06d490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad0162300 0x7f9ad00c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ad006daa0 0x7f9ad0165110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 --2- 172.21.15.32:0/2290630149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ad00717c0 0x7f9ad00c8f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 >> 172.21.15.32:0/2290630149 conn(0x7f9ad00cfc40 msgr2=0x7f9ad00afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.356 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:54.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 shutdown_connections 2023-10-14T12:18:54.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f9ad6dfa700 1 -- 172.21.15.32:0/2290630149 wait complete. 2023-10-14T12:18:54.358 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:54.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3f78005870 con 0x7f3f900c9fc0 2023-10-14T12:18:54.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.346+0000 7f3f867fc700 1 -- 172.21.15.32:0/1618812776 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f80015090 con 0x7f3f900c9fc0 2023-10-14T12:18:54.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8fe006afd0 msgr2=0x7f8fe006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8fe006afd0 0x7f8fe006d490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40aeb00 tx=0x7f8fe8010000 comp rx=0 tx=0).stop 2023-10-14T12:18:54.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 msgr2=0x7f8ff414eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 0x7f8ff414eb80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c480 tx=0x7f8fe400c840 comp rx=0 tx=0).stop 2023-10-14T12:18:54.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 shutdown_connections 2023-10-14T12:18:54.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ff4157630 0x7f8ff414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ff40c9fc0 0x7f8ff414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8fe006afd0 0x7f8fe006d490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 --2- 172.21.15.32:0/1238309587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff4157250 0x7f8ff414eb80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 >> 172.21.15.32:0/1238309587 conn(0x7f8ff40cf3f0 msgr2=0x7f8ff4159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 shutdown_connections 2023-10-14T12:18:54.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.349+0000 7f8ffb17b700 1 -- 172.21.15.32:0/1238309587 wait complete. 2023-10-14T12:18:54.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f7406af00 msgr2=0x7f3f7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f7406af00 0x7f3f7406d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b50c0 tx=0x7f3f8c009000 comp rx=0 tx=0).stop 2023-10-14T12:18:54.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 msgr2=0x7f3f9013df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:54.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 0x7f3f9013df80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000b530 tx=0x7f3f8000b840 comp rx=0 tx=0).stop 2023-10-14T12:18:54.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 shutdown_connections 2023-10-14T12:18:54.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3f7406af00 0x7f3f7406d3c0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b50c0 tx=0x7f3f8c009000 comp rx=0 tx=0).stop 2023-10-14T12:18:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9015a4e0 0x7f3f9013e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f900c9fc0 0x7f3f9013df80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 --2- 172.21.15.32:0/1618812776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f90157250 0x7f3f900b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.350+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 >> 172.21.15.32:0/1618812776 conn(0x7f3f900cf3f0 msgr2=0x7f3f9015c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:54.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-14T12:18:54.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.355+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 shutdown_connections 2023-10-14T12:18:54.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:54.355+0000 7f3f97bdd700 1 -- 172.21.15.32:0/1618812776 wait complete. 2023-10-14T12:18:54.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-10-14T12:18:54.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-14T12:18:54.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-10-14T12:18:54.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-14T12:18:54.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:18:54.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:18:55.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T12:18:55.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T12:18:55.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T12:18:55.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T12:18:55.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T12:18:55.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T12:18:55.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T12:18:55.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T12:18:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.535+0000 7fdb11f58700 1 Processor -- start 2023-10-14T12:18:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.535+0000 7fdb11f58700 1 -- start start 2023-10-14T12:18:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.537+0000 7fdb11f58700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdb0c0c9fc0 0x7fdb0c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.537+0000 7fdb11f58700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdb0c15a4e0 0x7fdb0c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.537+0000 7fdb11f58700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c15af20 con 0x7fdb0c157250 2023-10-14T12:18:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.537+0000 7fdb11f58700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c15a960 con 0x7fdb0c0c9fc0 2023-10-14T12:18:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.537+0000 7fdb11f58700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c15ac40 con 0x7fdb0c15a4e0 2023-10-14T12:18:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdb0c0c9fc0 0x7fdb0c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdb0c0c9fc0 0x7fdb0c159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38324/0 (socket says 172.21.15.32:38324) 2023-10-14T12:18:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 -- 172.21.15.32:0/282302302 learned_addr learned my addr 172.21.15.32:0/282302302 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 -- 172.21.15.32:0/282302302 >> v2:172.21.15.92:3300/0 conn(0x7fdb0c15a4e0 msgr2=0x7fdb0c06c9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:18:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 --2- 172.21.15.32:0/282302302 >> v2:172.21.15.92:3300/0 conn(0x7fdb0c15a4e0 0x7fdb0c06c9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 -- 172.21.15.32:0/282302302 >> v1:172.21.15.92:6789/0 conn(0x7fdb0c157250 legacy=0x7fdb0c15df30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:18:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 -- 172.21.15.32:0/282302302 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c15d730 con 0x7fdb0c0c9fc0 2023-10-14T12:18:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.538+0000 7fdb0affd700 1 --2- 172.21.15.32:0/282302302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c0c9fc0 0x7fdb0c159fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0cd230 tx=0x7fdb0400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b12673f5e280656 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.540+0000 7fdb0a7fc700 1 -- 172.21.15.32:0/282302302 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04010070 con 0x7fdb0c0c9fc0 2023-10-14T12:18:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.540+0000 7fdb0a7fc700 1 -- 172.21.15.32:0/282302302 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400dca0 con 0x7fdb0c0c9fc0 2023-10-14T12:18:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.540+0000 7fdb0a7fc700 1 -- 172.21.15.32:0/282302302 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04007d70 con 0x7fdb0c0c9fc0 2023-10-14T12:18:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.541+0000 7fdb11f58700 1 -- 172.21.15.32:0/282302302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c0c9fc0 msgr2=0x7fdb0c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.541+0000 7fdb11f58700 1 --2- 172.21.15.32:0/282302302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c0c9fc0 0x7fdb0c159fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0cd230 tx=0x7fdb0400d650 comp rx=0 tx=0).stop 2023-10-14T12:18:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.541+0000 7fdb11f58700 1 -- 172.21.15.32:0/282302302 shutdown_connections 2023-10-14T12:18:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.541+0000 7fdb11f58700 1 --2- 172.21.15.32:0/282302302 >> v2:172.21.15.92:3300/0 conn(0x7fdb0c15a4e0 0x7fdb0c06c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.541+0000 7fdb11f58700 1 --2- 172.21.15.32:0/282302302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c0c9fc0 0x7fdb0c159fa0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0cd230 tx=0x7fdb0400d650 comp rx=0 tx=0).stop 2023-10-14T12:18:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.541+0000 7fdb11f58700 1 -- 172.21.15.32:0/282302302 >> 172.21.15.32:0/282302302 conn(0x7fdb0c0cf3f0 msgr2=0x7fdb0c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.542+0000 7fdb11f58700 1 -- 172.21.15.32:0/282302302 shutdown_connections 2023-10-14T12:18:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.542+0000 7fdb11f58700 1 -- 172.21.15.32:0/282302302 wait complete. 2023-10-14T12:18:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.544+0000 7fdb11f58700 1 Processor -- start 2023-10-14T12:18:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.545+0000 7fdb11f58700 1 -- start start 2023-10-14T12:18:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb11f58700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb0c157250 0x7fdb0c0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb11f58700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 0x7fdb0c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb11f58700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c1f2360 0x7fdb0c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb11f58700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c5e20 con 0x7fdb0c1f2360 2023-10-14T12:18:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb11f58700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1f3430 con 0x7fdb0c157250 2023-10-14T12:18:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb11f58700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c58a0 con 0x7fdb0c15a4e0 2023-10-14T12:18:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb0affd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 0x7fdb0c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb0bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c1f2360 0x7fdb0c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb0affd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 0x7fdb0c159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:44022/0 (socket says 172.21.15.32:44022) 2023-10-14T12:18:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.546+0000 7fdb0affd700 1 -- 172.21.15.32:0/174124340 learned_addr learned my addr 172.21.15.32:0/174124340 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.547+0000 7fdb0bfff700 1 -- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 msgr2=0x7fdb0c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.547+0000 7fdb0bfff700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 0x7fdb0c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.547+0000 7fdb0bfff700 1 -- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb0c157250 msgr2=0x7fdb0c0c64c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:18:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.547+0000 7fdb0bfff700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb0c157250 0x7fdb0c0c64c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.547+0000 7fdb0bfff700 1 -- 172.21.15.32:0/174124340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0400d050 con 0x7fdb0c1f2360 2023-10-14T12:18:55.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.547+0000 7fdb0bfff700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c1f2360 0x7fdb0c15c250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c070540 tx=0x7fdafc00b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.548+0000 7fdb0affd700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 0x7fdb0c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:55.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.549+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011830 con 0x7fdb0c1f2360 2023-10-14T12:18:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.549+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc011990 con 0x7fdb0c1f2360 2023-10-14T12:18:55.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.549+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011d40 con 0x7fdb0c1f2360 2023-10-14T12:18:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.549+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c0c5b40 con 0x7fdb0c1f2360 2023-10-14T12:18:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.549+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c0c9390 con 0x7fdb0c1f2360 2023-10-14T12:18:55.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.554+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdafc01a400 con 0x7fdb0c1f2360 2023-10-14T12:18:55.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.555+0000 7fdaf3fff700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdaf806afd0 0x7fdaf806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.555+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdafc089510 con 0x7fdb0c1f2360 2023-10-14T12:18:55.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.556+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec0052f0 con 0x7fdb0c1f2360 2023-10-14T12:18:55.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.558+0000 7fdb0b7fe700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdaf806afd0 0x7fdaf806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.566+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdafc0545a0 con 0x7fdb0c1f2360 2023-10-14T12:18:55.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.577+0000 7fdb0b7fe700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdaf806afd0 0x7fdaf806d490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c1f36c0 tx=0x7fdb00006c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.609+0000 7f68ce94d700 1 Processor -- start 2023-10-14T12:18:55.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.609+0000 7f68ce94d700 1 -- start start 2023-10-14T12:18:55.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.611+0000 7f68ce94d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68c80c27d0 0x7f68c80ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.611+0000 7f68ce94d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8165e40 con 0x7f68c80ca150 2023-10-14T12:18:55.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.611+0000 7f68ce94d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c80cd560 con 0x7f68c80b0e70 2023-10-14T12:18:55.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.611+0000 7f68ce94d700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c80cdbe0 con 0x7f68c80c27d0 2023-10-14T12:18:55.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.611+0000 7f68cceea700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f68c80ca150 0x7f68c8070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55362/0 (socket says 172.21.15.32:55362) 2023-10-14T12:18:55.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.611+0000 7f68cceea700 1 -- 172.21.15.32:0/3476355498 learned_addr learned my addr 172.21.15.32:0/3476355498 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:55.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003138957 0 0) 0x7f68c8165e40 con 0x7f68c80ca150 2023-10-14T12:18:55.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b00035b0 con 0x7f68c80ca150 2023-10-14T12:18:55.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955780577 0 0) 0x7f68c80cd560 con 0x7f68c80b0e70 2023-10-14T12:18:55.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c8165e40 con 0x7f68c80b0e70 2023-10-14T12:18:55.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c7fff700 1 --2- 172.21.15.32:0/3476355498 >> v2:172.21.15.32:3300/0 conn(0x7f68c80c27d0 0x7f68c80ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1475762460 0 0) 0x7f68b00035b0 con 0x7f68c80ca150 2023-10-14T12:18:55.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.612+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 >> v2:172.21.15.32:3300/0 conn(0x7f68c80c27d0 msgr2=0x7f68c80ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 --2- 172.21.15.32:0/3476355498 >> v2:172.21.15.32:3300/0 conn(0x7f68c80c27d0 0x7f68c80ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 >> v1:172.21.15.92:6789/0 conn(0x7f68c80b0e70 legacy=0x7f68c80c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c80ca620 con 0x7f68c80ca150 2023-10-14T12:18:55.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f68b8001670 con 0x7f68c80ca150 2023-10-14T12:18:55.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 >> v1:172.21.15.32:6789/0 conn(0x7f68c80ca150 legacy=0x7f68c8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b0004c40 0x7f68b0005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68b00037f0 0x7f68b0003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b0004200 0x7f68b000ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80cdbe0 con 0x7f68b0004200 2023-10-14T12:18:55.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b000c160 con 0x7f68b0004c40 2023-10-14T12:18:55.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b000c320 con 0x7f68b00037f0 2023-10-14T12:18:55.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c7fff700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b0004c40 0x7f68b0005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68c77fe700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68b00037f0 0x7f68b0003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7f68cceea700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b0004200 0x7f68b000ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.613+0000 7ffb69690700 1 Processor -- start 2023-10-14T12:18:55.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c77fe700 1 -- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b0004c40 msgr2=0x7f68b0005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c77fe700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68b0004c40 0x7f68b0005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c77fe700 1 -- 172.21.15.32:0/3476355498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b0004200 msgr2=0x7f68b000ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c77fe700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b0004200 0x7f68b000ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c77fe700 1 -- 172.21.15.32:0/3476355498 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00035b0 con 0x7f68b00037f0 2023-10-14T12:18:55.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68cceea700 1 -- 172.21.15.32:0/3476355498 reap_dead start 2023-10-14T12:18:55.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c77fe700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68b00037f0 0x7f68b0003c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68bc001830 tx=0x7f68b0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68caf0d3a3e78b5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc001320 con 0x7f68b00037f0 2023-10-14T12:18:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7ffb69690700 1 -- start start 2023-10-14T12:18:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7ffb69690700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffb64157630 0x7ffb6406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7ffb69690700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6415af20 con 0x7ffb640c9fc0 2023-10-14T12:18:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7ffb69690700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6415a6b0 con 0x7ffb64157250 2023-10-14T12:18:55.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7ffb69690700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6415a960 con 0x7ffb64157630 2023-10-14T12:18:55.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc0052f0 con 0x7f68b00037f0 2023-10-14T12:18:55.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.614+0000 7f68c6ffd700 1 -- 172.21.15.32:0/3476355498 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc003680 con 0x7f68b00037f0 2023-10-14T12:18:55.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7f68ce94d700 1 -- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68b00037f0 msgr2=0x7f68b0003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7f68ce94d700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68b00037f0 0x7f68b0003c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68bc001830 tx=0x7f68b0005880 comp rx=0 tx=0).stop 2023-10-14T12:18:55.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.615+0000 7f68ce94d700 1 -- 172.21.15.32:0/3476355498 shutdown_connections 2023-10-14T12:18:55.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7f68ce94d700 1 --2- 172.21.15.32:0/3476355498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68b00037f0 0x7f68b0003c70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7f68ce94d700 1 -- 172.21.15.32:0/3476355498 >> 172.21.15.32:0/3476355498 conn(0x7f68c806afb0 msgr2=0x7f68c80cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb62ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ffb64157250 0x7ffb6415df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54248/0 (socket says 172.21.15.32:54248) 2023-10-14T12:18:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb62ffd700 1 -- 172.21.15.32:0/3732559572 learned_addr learned my addr 172.21.15.32:0/3732559572 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:55.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7f68ce94d700 1 -- 172.21.15.32:0/3476355498 shutdown_connections 2023-10-14T12:18:55.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb637fe700 1 --2- 172.21.15.32:0/3732559572 >> v2:172.21.15.32:3300/0 conn(0x7ffb64157630 0x7ffb6406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7f68ce94d700 1 -- 172.21.15.32:0/3476355498 wait complete. 2023-10-14T12:18:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102259826 0 0) 0x7ffb6415a6b0 con 0x7ffb64157250 2023-10-14T12:18:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb4c0046c0 con 0x7ffb64157250 2023-10-14T12:18:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691348480 0 0) 0x7ffb6415af20 con 0x7ffb640c9fc0 2023-10-14T12:18:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.616+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb6415a6b0 con 0x7ffb640c9fc0 2023-10-14T12:18:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb637fe700 1 -- 172.21.15.32:0/3732559572 >> v1:172.21.15.92:6789/0 conn(0x7ffb64157250 legacy=0x7ffb6415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb637fe700 1 -- 172.21.15.32:0/3732559572 >> v1:172.21.15.32:6789/0 conn(0x7ffb640c9fc0 legacy=0x7ffb64159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb637fe700 1 -- 172.21.15.32:0/3732559572 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6415ac40 con 0x7ffb64157630 2023-10-14T12:18:55.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb637fe700 1 --2- 172.21.15.32:0/3732559572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb64157630 0x7ffb6406c9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009d90 tx=0x7ffb5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3318aaf664d4e5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00e070 con 0x7ffb64157630 2023-10-14T12:18:55.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c00bb20 con 0x7ffb64157630 2023-10-14T12:18:55.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.617+0000 7ffb61ffb700 1 -- 172.21.15.32:0/3732559572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00be90 con 0x7ffb64157630 2023-10-14T12:18:55.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.618+0000 7ffb69690700 1 -- 172.21.15.32:0/3732559572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb64157630 msgr2=0x7ffb6406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.618+0000 7ffb69690700 1 --2- 172.21.15.32:0/3732559572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb64157630 0x7ffb6406c9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009d90 tx=0x7ffb5c00b330 comp rx=0 tx=0).stop 2023-10-14T12:18:55.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.618+0000 7f68ce94d700 1 Processor -- start 2023-10-14T12:18:55.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.618+0000 7f68ce94d700 1 -- start start 2023-10-14T12:18:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7f68ce94d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b00037f0 0x7f68c8163240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7f68ce94d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68c80c85f0 0x7f68c80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7f68ce94d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68c8159770 0x7f68c80c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7f68ce94d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80b27d0 con 0x7f68b00037f0 2023-10-14T12:18:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7f68ce94d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80c8a70 con 0x7f68c80c85f0 2023-10-14T12:18:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7f68ce94d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80b4e10 con 0x7f68c8159770 2023-10-14T12:18:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68cceea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68c8159770 0x7f68c80c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68cceea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68c8159770 0x7f68c80c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:44046/0 (socket says 172.21.15.32:44046) 2023-10-14T12:18:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68cceea700 1 -- 172.21.15.32:0/1807167483 learned_addr learned my addr 172.21.15.32:0/1807167483 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68c7fff700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b00037f0 0x7f68c8163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7feedf121700 1 Processor -- start 2023-10-14T12:18:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7ffb69690700 1 -- 172.21.15.32:0/3732559572 shutdown_connections 2023-10-14T12:18:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7ffb69690700 1 --2- 172.21.15.32:0/3732559572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb64157630 0x7ffb6406c9b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7ffb69690700 1 -- 172.21.15.32:0/3732559572 >> 172.21.15.32:0/3732559572 conn(0x7ffb640cf3f0 msgr2=0x7ffb640cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68c7fff700 1 -- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68c8159770 msgr2=0x7f68c80c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68c7fff700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68c8159770 0x7f68c80c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68c7fff700 1 -- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68c80c85f0 msgr2=0x7f68c80b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68c7fff700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68c80c85f0 0x7f68c80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.620+0000 7f68c7fff700 1 -- 172.21.15.32:0/1807167483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c80c8f70 con 0x7f68b00037f0 2023-10-14T12:18:55.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.619+0000 7feedf121700 1 -- start start 2023-10-14T12:18:55.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7feedf121700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed8157250 0x7feed815df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7feedf121700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feed80c9fc0 0x7feed8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7feedf121700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed815af20 con 0x7feed815a4e0 2023-10-14T12:18:55.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7feedf121700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed815e470 con 0x7feed80c9fc0 2023-10-14T12:18:55.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7feedf121700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed815a960 con 0x7feed8157250 2023-10-14T12:18:55.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7f68c7fff700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b00037f0 0x7f68c8163240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68c0004690 tx=0x7f68c0007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7ffb69690700 1 -- 172.21.15.32:0/3732559572 shutdown_connections 2023-10-14T12:18:55.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7ff0f8fc5700 1 Processor -- start 2023-10-14T12:18:55.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0007bb0 con 0x7f68b00037f0 2023-10-14T12:18:55.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0007d10 con 0x7f68b00037f0 2023-10-14T12:18:55.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0015660 con 0x7f68b00037f0 2023-10-14T12:18:55.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7ff0f8fc5700 1 -- start start 2023-10-14T12:18:55.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7ffb69690700 1 -- 172.21.15.32:0/3732559572 wait complete. 2023-10-14T12:18:55.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ffb69690700 1 Processor -- start 2023-10-14T12:18:55.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedd6be700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7feed815a4e0 0x7feed806c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54262/0 (socket says 172.21.15.32:54262) 2023-10-14T12:18:55.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedd6be700 1 -- 172.21.15.32:0/2004320323 learned_addr learned my addr 172.21.15.32:0/2004320323 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:55.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedcebd700 1 --2- 172.21.15.32:0/2004320323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed8157250 0x7feed815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedcebd700 1 -- 172.21.15.32:0/2004320323 >> v2:172.21.15.92:3300/0 conn(0x7feed80c9fc0 msgr2=0x7feed8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedcebd700 1 --2- 172.21.15.32:0/2004320323 >> v2:172.21.15.92:3300/0 conn(0x7feed80c9fc0 0x7feed8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedcebd700 1 -- 172.21.15.32:0/2004320323 >> v1:172.21.15.92:6789/0 conn(0x7feed815a4e0 legacy=0x7feed806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedcebd700 1 -- 172.21.15.32:0/2004320323 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed815ac40 con 0x7feed8157250 2023-10-14T12:18:55.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7feedcebd700 1 --2- 172.21.15.32:0/2004320323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed8157250 0x7feed815df30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feec8010ba0 tx=0x7feec8010eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e1db002e5c02da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7f10e868b700 1 Processor -- start 2023-10-14T12:18:55.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.622+0000 7f10e868b700 1 -- start start 2023-10-14T12:18:55.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ffb69690700 1 -- start start 2023-10-14T12:18:55.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c80c8c90 con 0x7f68b00037f0 2023-10-14T12:18:55.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.621+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c80b23f0 con 0x7f68b00037f0 2023-10-14T12:18:55.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ff0f8fc5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff0f40cff10 0x7ff0f415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ff0f8fc5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f4159fa0 0x7ff0f406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ff0f8fc5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f415af20 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ff0f8fc5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f4157960 con 0x7ff0f40cff10 2023-10-14T12:18:55.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7ff0f8fc5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f415e470 con 0x7ff0f4159fa0 2023-10-14T12:18:55.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7feed77fe700 1 -- 172.21.15.32:0/2004320323 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800be50 con 0x7feed8157250 2023-10-14T12:18:55.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7feed77fe700 1 -- 172.21.15.32:0/2004320323 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8010070 con 0x7feed8157250 2023-10-14T12:18:55.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7feed77fe700 1 -- 172.21.15.32:0/2004320323 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8010420 con 0x7feed8157250 2023-10-14T12:18:55.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ff0f259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff0f40cff10 0x7ff0f415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ff0f1d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff0f40c9fc0 0x7ff0f4157250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54276/0 (socket says 172.21.15.32:54276) 2023-10-14T12:18:55.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ff0f1d9b700 1 -- 172.21.15.32:0/2816554219 learned_addr learned my addr 172.21.15.32:0/2816554219 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:55.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7feedf121700 1 -- 172.21.15.32:0/2004320323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed8157250 msgr2=0x7feed815df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7feedf121700 1 --2- 172.21.15.32:0/2004320323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed8157250 0x7feed815df30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feec8010ba0 tx=0x7feec8010eb0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ffb69690700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb640c9fc0 0x7ffb640b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ffb69690700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb64157250 0x7ffb64156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ffb69690700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 0x7ffb6415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ffb69690700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641570d0 con 0x7ffb640c9fc0 2023-10-14T12:18:55.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ffb69690700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640c5d70 con 0x7ffb64157250 2023-10-14T12:18:55.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7ffb69690700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640b2590 con 0x7ffb64157630 2023-10-14T12:18:55.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 0x7ffb6415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f2d9d700 1 --2- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f4159fa0 0x7ff0f406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 0x7ffb6415c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:44070/0 (socket says 172.21.15.32:44070) 2023-10-14T12:18:55.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 -- 172.21.15.32:0/1506581720 learned_addr learned my addr 172.21.15.32:0/1506581720 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb627fc700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb64157250 0x7ffb64156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 -- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb64157250 msgr2=0x7ffb64156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb64157250 0x7ffb64156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 -- 172.21.15.32:0/1506581720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb640c9fc0 msgr2=0x7ffb640b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb640c9fc0 0x7ffb640b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 -- 172.21.15.32:0/1506581720 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c009a70 con 0x7ffb64157630 2023-10-14T12:18:55.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.623+0000 7f10e868b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10e00c27d0 0x7f10e00ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e868b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e00b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e868b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e0165e40 con 0x7f10e00c9a40 2023-10-14T12:18:55.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e868b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e00cdbe0 con 0x7f10e00c27d0 2023-10-14T12:18:55.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e868b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00b1830 con 0x7f10e00b0e70 2023-10-14T12:18:55.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e6c28700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f10e00c9a40 0x7f10e0070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55394/0 (socket says 172.21.15.32:55394) 2023-10-14T12:18:55.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e6c28700 1 -- 172.21.15.32:0/3291960411 learned_addr learned my addr 172.21.15.32:0/3291960411 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:55.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e5c26700 1 --2- 172.21.15.32:0/3291960411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e00b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e5c26700 1 -- 172.21.15.32:0/3291960411 >> v2:172.21.15.32:3300/0 conn(0x7f10e00c27d0 msgr2=0x7f10e00ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e5c26700 1 --2- 172.21.15.32:0/3291960411 >> v2:172.21.15.32:3300/0 conn(0x7f10e00c27d0 0x7f10e00ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.624+0000 7f10e5c26700 1 -- 172.21.15.32:0/3291960411 >> v1:172.21.15.32:6789/0 conn(0x7f10e00c9a40 legacy=0x7f10e0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7f10e5c26700 1 -- 172.21.15.32:0/3291960411 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00cd560 con 0x7f10e00b0e70 2023-10-14T12:18:55.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7f10e5c26700 1 --2- 172.21.15.32:0/3291960411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e00b12f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009840 tx=0x7f10d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9f815c6f5089ef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7feedf121700 1 -- 172.21.15.32:0/2004320323 shutdown_connections 2023-10-14T12:18:55.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7feedf121700 1 --2- 172.21.15.32:0/2004320323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed8157250 0x7feed815df30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7feedf121700 1 --2- 172.21.15.32:0/2004320323 >> v2:172.21.15.92:3300/0 conn(0x7feed80c9fc0 0x7feed8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7feedf121700 1 -- 172.21.15.32:0/2004320323 >> 172.21.15.32:0/2004320323 conn(0x7feed80cf3f0 msgr2=0x7feed80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f159a700 1 -- 172.21.15.32:0/2816554219 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762151571 0 0) 0x7ff0f415af20 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f159a700 1 -- 172.21.15.32:0/2816554219 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0dc0035b0 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f259c700 1 -- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f4159fa0 msgr2=0x7ff0f406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f259c700 1 --2- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f4159fa0 0x7ff0f406c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f259c700 1 -- 172.21.15.32:0/2816554219 >> v1:172.21.15.92:6789/0 conn(0x7ff0f40c9fc0 legacy=0x7ff0f4157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f259c700 1 -- 172.21.15.32:0/2816554219 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f415a960 con 0x7ff0f40cff10 2023-10-14T12:18:55.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ffb637fe700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 0x7ffb6415c250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c014040 tx=0x7ffb5c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7feedf121700 1 -- 172.21.15.32:0/2004320323 shutdown_connections 2023-10-14T12:18:55.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.625+0000 7ff0f259c700 1 --2- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40cff10 0x7ff0f415df30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009840 tx=0x7ff0e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a7de80b362469a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7feedf121700 1 -- 172.21.15.32:0/2004320323 wait complete. 2023-10-14T12:18:55.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7ff0f159a700 1 -- 172.21.15.32:0/2816554219 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4011830 con 0x7ff0f40cff10 2023-10-14T12:18:55.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7ff0f159a700 1 -- 172.21.15.32:0/2816554219 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4011990 con 0x7ff0f40cff10 2023-10-14T12:18:55.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a80052f0 con 0x7f68b00037f0 2023-10-14T12:18:55.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7ff0f159a700 1 -- 172.21.15.32:0/2816554219 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4011d00 con 0x7ff0f40cff10 2023-10-14T12:18:55.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c025400 con 0x7ffb64157630 2023-10-14T12:18:55.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c01f070 con 0x7ffb64157630 2023-10-14T12:18:55.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0257a0 con 0x7ffb64157630 2023-10-14T12:18:55.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb640b2870 con 0x7ffb64157630 2023-10-14T12:18:55.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb641e37c0 con 0x7ffb64157630 2023-10-14T12:18:55.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7f10e5425700 1 -- 172.21.15.32:0/3291960411 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0004230 con 0x7f10e00b0e70 2023-10-14T12:18:55.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7f10e5425700 1 -- 172.21.15.32:0/3291960411 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0004390 con 0x7f10e00b0e70 2023-10-14T12:18:55.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.626+0000 7f10e5425700 1 -- 172.21.15.32:0/3291960411 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00036a0 con 0x7f10e00b0e70 2023-10-14T12:18:55.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f68c00157c0 con 0x7f68b00037f0 2023-10-14T12:18:55.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7f68c4ff9700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f68b406afd0 0x7f68b406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68c0089d30 con 0x7f68b00037f0 2023-10-14T12:18:55.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7f68c77fe700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f68b406afd0 0x7f68b406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7feedf121700 1 Processor -- start 2023-10-14T12:18:55.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40cff10 msgr2=0x7ff0f415df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40cff10 0x7ff0f415df30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009840 tx=0x7ff0e4009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:55.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/2816554219 shutdown_connections 2023-10-14T12:18:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f4159fa0 0x7ff0f406c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/2816554219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40cff10 0x7ff0f415df30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/2816554219 >> 172.21.15.32:0/2816554219 conn(0x7ff0f40cf3f0 msgr2=0x7ff0f40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/2816554219 shutdown_connections 2023-10-14T12:18:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.627+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/2816554219 wait complete. 2023-10-14T12:18:55.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7feedf121700 1 -- start start 2023-10-14T12:18:55.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedf121700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 0x7feed80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedf121700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed8157250 0x7feed8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedf121700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed815a4e0 0x7feed80b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedf121700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b4f00 con 0x7feed80c9fc0 2023-10-14T12:18:55.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedf121700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b01b0 con 0x7feed8157250 2023-10-14T12:18:55.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedf121700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b0490 con 0x7feed815a4e0 2023-10-14T12:18:55.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedcebd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 0x7feed80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedcebd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 0x7feed80b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38386/0 (socket says 172.21.15.32:38386) 2023-10-14T12:18:55.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedcebd700 1 -- 172.21.15.32:0/4147343737 learned_addr learned my addr 172.21.15.32:0/4147343737 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb641e39e0 con 0x7ffb64157630 2023-10-14T12:18:55.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7f10e868b700 1 -- 172.21.15.32:0/3291960411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 msgr2=0x7f10e00b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.628+0000 7f10e868b700 1 --2- 172.21.15.32:0/3291960411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e00b12f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009840 tx=0x7f10d0009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:55.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feedd6be700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed815a4e0 0x7feed80b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7ff0f8fc5700 1 Processor -- start 2023-10-14T12:18:55.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7feed7fff700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed8157250 0x7feed8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7ff0f8fc5700 1 -- start start 2023-10-14T12:18:55.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7f10e868b700 1 -- 172.21.15.32:0/3291960411 shutdown_connections 2023-10-14T12:18:55.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7f10e868b700 1 --2- 172.21.15.32:0/3291960411 >> v2:172.21.15.32:3300/0 conn(0x7f10e00c27d0 0x7f10e00ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7f10e868b700 1 --2- 172.21.15.32:0/3291960411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e00b12f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.629+0000 7f10e868b700 1 -- 172.21.15.32:0/3291960411 >> 172.21.15.32:0/3291960411 conn(0x7f10e006afb0 msgr2=0x7f10e00cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7f10e868b700 1 -- 172.21.15.32:0/3291960411 shutdown_connections 2023-10-14T12:18:55.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7f68c77fe700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f68b406afd0 0x7f68b406d490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b4fd0 tx=0x7f68bc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7feedcebd700 1 -- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed815a4e0 msgr2=0x7feed80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7feedcebd700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed815a4e0 0x7feed80b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7feedcebd700 1 -- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed8157250 msgr2=0x7feed8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7feedcebd700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed8157250 0x7feed8155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7feedcebd700 1 -- 172.21.15.32:0/4147343737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8010800 con 0x7feed80c9fc0 2023-10-14T12:18:55.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7f10e868b700 1 -- 172.21.15.32:0/3291960411 wait complete. 2023-10-14T12:18:55.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f8fc5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 0x7ff0f4071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f8fc5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f40cff10 0x7ff0f40722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f8fc5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0f4159fa0 0x7ff0f4149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f8fc5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c26b0 con 0x7ff0f4159fa0 2023-10-14T12:18:55.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f8fc5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4146e80 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f8fc5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4147160 con 0x7ff0f40cff10 2023-10-14T12:18:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 0x7ff0f4071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0f4159fa0 0x7ff0f4149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 0x7ff0f4071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42660/0 (socket says 172.21.15.32:42660) 2023-10-14T12:18:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0f4159fa0 0x7ff0f4149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38394/0 (socket says 172.21.15.32:38394) 2023-10-14T12:18:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7ff0f259c700 1 -- 172.21.15.32:0/1799672742 learned_addr learned my addr 172.21.15.32:0/1799672742 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0f259c700 1 -- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f40cff10 msgr2=0x7ff0f40722e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:18:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0f259c700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f40cff10 0x7ff0f40722e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0f259c700 1 -- 172.21.15.32:0/1799672742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0f4159fa0 msgr2=0x7ff0f4149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0f259c700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0f4159fa0 0x7ff0f4149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0f259c700 1 -- 172.21.15.32:0/1799672742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40094a0 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0f259c700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 0x7ff0f4071da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40090b0 tx=0x7ff0e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40038a0 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e401f070 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4003c60 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.632+0000 7f10e868b700 1 Processor -- start 2023-10-14T12:18:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.630+0000 7feed7fff700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed8157250 0x7feed8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.631+0000 7feedcebd700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 0x7feed80b1250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feec8000c00 tx=0x7feec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.632+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb5c025900 con 0x7ffb64157630 2023-10-14T12:18:55.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.632+0000 7ffb4b7fe700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ffb5006afd0 0x7ffb5006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb5c08b680 con 0x7ffb64157630 2023-10-14T12:18:55.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7ffb62ffd700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ffb5006afd0 0x7ffb5006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.632+0000 7f10e868b700 1 -- start start 2023-10-14T12:18:55.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.632+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4147440 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.632+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f4147a00 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f4147c20 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e868b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e868b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 0x7f10e0162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e868b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10e00c9a40 0x7f10e01ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e868b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0156b80 con 0x7f10e00c9a40 2023-10-14T12:18:55.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e868b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0164060 con 0x7f10e00c27d0 2023-10-14T12:18:55.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e868b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0164340 con 0x7f10e00b0e70 2023-10-14T12:18:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7ffb62ffd700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ffb5006afd0 0x7ffb5006d490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb580061a0 tx=0x7ffb58005ae0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e5c26700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 0x7f10e0162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7fbe31fe8700 1 Processor -- start 2023-10-14T12:18:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e5c26700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 0x7f10e0162fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:42666/0 (socket says 172.21.15.32:42666) 2023-10-14T12:18:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e5c26700 1 -- 172.21.15.32:0/1819327971 learned_addr learned my addr 172.21.15.32:0/1819327971 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7fbe31fe8700 1 -- start start 2023-10-14T12:18:55.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.633+0000 7f10e6c28700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10e00c9a40 0x7f10e01ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e5c26700 1 -- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 msgr2=0x7f10e0156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e5c26700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e5c26700 1 -- 172.21.15.32:0/1819327971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10e00c9a40 msgr2=0x7f10e01ebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e5c26700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10e00c9a40 0x7f10e01ebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e5c26700 1 -- 172.21.15.32:0/1819327971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00094a0 con 0x7f10e00c27d0 2023-10-14T12:18:55.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e6c28700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10e00c9a40 0x7f10e01ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:55.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f10e5c26700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 0x7f10e0162fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10e00b1f10 tx=0x7f10d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f028c9b1700 1 Processor -- start 2023-10-14T12:18:55.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.634+0000 7f028c9b1700 1 -- start start 2023-10-14T12:18:55.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe31fe8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe2c15a580 0x7fbe2c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe31fe8700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c071aa0 con 0x7fbe2c06c9b0 2023-10-14T12:18:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe31fe8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c15f140 con 0x7fbe2c15e8d0 2023-10-14T12:18:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe31fe8700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c15ee60 con 0x7fbe2c15a580 2023-10-14T12:18:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe2c15a580 0x7fbe2c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe2c15a580 0x7fbe2c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38404/0 (socket says 172.21.15.32:38404) 2023-10-14T12:18:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 -- 172.21.15.32:0/1824067547 learned_addr learned my addr 172.21.15.32:0/1824067547 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 -- 172.21.15.32:0/1824067547 >> v1:172.21.15.92:6789/0 conn(0x7fbe2c15e8d0 legacy=0x7fbe2c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 -- 172.21.15.32:0/1824067547 >> v1:172.21.15.32:6789/0 conn(0x7fbe2c06c9b0 legacy=0x7fbe2c15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 -- 172.21.15.32:0/1824067547 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c071cd0 con 0x7fbe2c15a580 2023-10-14T12:18:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.635+0000 7fbe2b7fe700 1 --2- 172.21.15.32:0/1824067547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0727b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe24010420 tx=0x7fbe24010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f678b74104b4f0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff0e401a430 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb5c0567a0 con 0x7ffb64157630 2023-10-14T12:18:55.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028c9b1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02880af740 0x7f02880b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028c9b1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0288161730 0x7f02880b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028c9b1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880afd30 con 0x7f02880cd870 2023-10-14T12:18:55.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028c9b1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288161cd0 con 0x7f0288161730 2023-10-14T12:18:55.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028c9b1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288161fb0 con 0x7f02880af740 2023-10-14T12:18:55.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028659c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f02880cd870 0x7f02880cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54310/0 (socket says 172.21.15.32:54310) 2023-10-14T12:18:55.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f028659c700 1 -- 172.21.15.32:0/2020722930 learned_addr learned my addr 172.21.15.32:0/2020722930 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:55.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7fbe2a7fc700 1 -- 172.21.15.32:0/1824067547 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24012840 con 0x7fbe2c15a580 2023-10-14T12:18:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f0285d9b700 1 --2- 172.21.15.32:0/2020722930 >> v2:172.21.15.92:3300/0 conn(0x7f02880af740 0x7f02880b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7fbe2a7fc700 1 -- 172.21.15.32:0/1824067547 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240129a0 con 0x7fbe2c15a580 2023-10-14T12:18:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7fbe2a7fc700 1 -- 172.21.15.32:0/1824067547 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24012d50 con 0x7fbe2c15a580 2023-10-14T12:18:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7f0286d9d700 1 --2- 172.21.15.32:0/2020722930 >> v2:172.21.15.32:3300/0 conn(0x7f0288161730 0x7f02880b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7ff0e2ffd700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff0d406af00 0x7ff0d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0e4021070 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.636+0000 7ff0f1d9b700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff0d406af00 0x7ff0d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7f0285d9b700 1 -- 172.21.15.32:0/2020722930 >> v2:172.21.15.32:3300/0 conn(0x7f0288161730 msgr2=0x7f02880b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:55.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7f0285d9b700 1 --2- 172.21.15.32:0/2020722930 >> v2:172.21.15.32:3300/0 conn(0x7f0288161730 0x7f02880b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7f0285d9b700 1 -- 172.21.15.32:0/2020722930 >> v1:172.21.15.92:6789/0 conn(0x7f02880cd870 legacy=0x7f02880cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7f0285d9b700 1 -- 172.21.15.32:0/2020722930 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288162290 con 0x7f02880af740 2023-10-14T12:18:55.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68c0054dc0 con 0x7f68b00037f0 2023-10-14T12:18:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8026070 con 0x7feed80c9fc0 2023-10-14T12:18:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8019850 con 0x7feed80c9fc0 2023-10-14T12:18:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8019be0 con 0x7feed80c9fc0 2023-10-14T12:18:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7f0285d9b700 1 --2- 172.21.15.32:0/2020722930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02880af740 0x7f02880b14f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f027c009840 tx=0x7f027c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e96d3cc35faf5c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7ff0f1d9b700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff0d406af00 0x7ff0d406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8007fd0 tx=0x7ff0e8007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7fbe31fe8700 1 -- 172.21.15.32:0/1824067547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 msgr2=0x7fbe2c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/1824067547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0727b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe24010420 tx=0x7fbe24010730 comp rx=0 tx=0).stop 2023-10-14T12:18:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed80b0770 con 0x7feed80c9fc0 2023-10-14T12:18:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.637+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed80b0d30 con 0x7feed80c9fc0 2023-10-14T12:18:55.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.638+0000 7fbe31fe8700 1 -- 172.21.15.32:0/1824067547 shutdown_connections 2023-10-14T12:18:55.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.638+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/1824067547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0727b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.638+0000 7fbe31fe8700 1 -- 172.21.15.32:0/1824067547 >> 172.21.15.32:0/1824067547 conn(0x7fbe2c06afb0 msgr2=0x7fbe2c0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.639+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0e4055fe0 con 0x7ff0f40c9fc0 2023-10-14T12:18:55.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.640+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed80b0f50 con 0x7feed80c9fc0 2023-10-14T12:18:55.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.640+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feec8019d40 con 0x7feed80c9fc0 2023-10-14T12:18:55.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.640+0000 7feed57fa700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feec406af50 0x7feec406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.640+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec8093600 con 0x7feed80c9fc0 2023-10-14T12:18:55.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.640+0000 7feed7fff700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feec406af50 0x7feec406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.641+0000 7feed7fff700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feec406af50 0x7feec406d410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feed80cb990 tx=0x7feecc009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.645+0000 7fbe31fe8700 1 -- 172.21.15.32:0/1824067547 shutdown_connections 2023-10-14T12:18:55.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.645+0000 7fbe31fe8700 1 -- 172.21.15.32:0/1824067547 wait complete. 2023-10-14T12:18:55.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.646+0000 7fbe31fe8700 1 Processor -- start 2023-10-14T12:18:55.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.645+0000 7f028559a700 1 -- 172.21.15.32:0/2020722930 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c011830 con 0x7f02880af740 2023-10-14T12:18:55.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.645+0000 7f028559a700 1 -- 172.21.15.32:0/2020722930 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c011990 con 0x7f02880af740 2023-10-14T12:18:55.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.645+0000 7f028559a700 1 -- 172.21.15.32:0/2020722930 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c011d20 con 0x7f02880af740 2023-10-14T12:18:55.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.647+0000 7fbe31fe8700 1 -- start start 2023-10-14T12:18:55.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.647+0000 7fbe31fe8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe2c06c9b0 0x7fbe2c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe31fe8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe31fe8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c15e8d0 0x7fbe2c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe31fe8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1539f0 con 0x7fbe2c15a580 2023-10-14T12:18:55.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe31fe8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c153710 con 0x7fbe2c15e8d0 2023-10-14T12:18:55.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe31fe8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1faca0 con 0x7fbe2c06c9b0 2023-10-14T12:18:55.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38422/0 (socket says 172.21.15.32:38422) 2023-10-14T12:18:55.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 -- 172.21.15.32:0/2244610620 learned_addr learned my addr 172.21.15.32:0/2244610620 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2b7fe700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe2c06c9b0 0x7fbe2c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2bfff700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c15e8d0 0x7fbe2c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 -- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe2c06c9b0 msgr2=0x7fbe2c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe2c06c9b0 0x7fbe2c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 -- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c15e8d0 msgr2=0x7fbe2c14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c15e8d0 0x7fbe2c14d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2affd700 1 -- 172.21.15.32:0/2244610620 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2400bd10 con 0x7fbe2c15a580 2023-10-14T12:18:55.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.648+0000 7fbe2b7fe700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe2c06c9b0 0x7fbe2c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:55.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7fbe2affd700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0c4ce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00c450 tx=0x7fbe1c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0052d0 con 0x7fbe2c15a580 2023-10-14T12:18:55.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c005430 con 0x7fbe2c15a580 2023-10-14T12:18:55.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c1faf80 con 0x7fbe2c15a580 2023-10-14T12:18:55.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0038c0 con 0x7fbe2c15a580 2023-10-14T12:18:55.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c1533c0 con 0x7fbe2c15a580 2023-10-14T12:18:55.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.649+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feec805e820 con 0x7feed80c9fc0 2023-10-14T12:18:55.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.651+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe1c003a20 con 0x7fbe2c15a580 2023-10-14T12:18:55.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.652+0000 7fbe13fff700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbe1806af00 0x7fbe1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.652+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe1c088a20 con 0x7fbe2c15a580 2023-10-14T12:18:55.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.652+0000 7fbe2b7fe700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbe1806af00 0x7fbe1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.653+0000 7fbe2b7fe700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbe1806af00 0x7fbe1806d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe24000f80 tx=0x7fbe24007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.655+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c1fb4a0 con 0x7fbe2c15a580 2023-10-14T12:18:55.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.659+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0003e50 con 0x7f10e00c27d0 2023-10-14T12:18:55.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.659+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0011630 con 0x7f10e00c27d0 2023-10-14T12:18:55.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.659+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00119c0 con 0x7f10e00c27d0 2023-10-14T12:18:55.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.659+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e0164620 con 0x7f10e00c27d0 2023-10-14T12:18:55.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.660+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e0164be0 con 0x7f10e00c27d0 2023-10-14T12:18:55.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.662+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f10d0022020 con 0x7f10e00c27d0 2023-10-14T12:18:55.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.663+0000 7f10d6ffd700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f10c406af50 0x7f10c406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.663+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e0164e00 con 0x7f10e00c27d0 2023-10-14T12:18:55.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.663+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10d008ab70 con 0x7f10e00c27d0 2023-10-14T12:18:55.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.664+0000 7f10e6427700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f10c406af50 0x7f10c406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.664+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe2c1fb4a0 con 0x7fbe2c15a580 2023-10-14T12:18:55.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.665+0000 7f10e6427700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f10c406af50 0x7f10c406d410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0097b0 tx=0x7f10dc006d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.664+0000 7f028c9b1700 1 -- 172.21.15.32:0/2020722930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02880af740 msgr2=0x7f02880b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.664+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2020722930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02880af740 0x7f02880b14f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f027c009840 tx=0x7f027c009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:55.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.666+0000 7f028c9b1700 1 -- 172.21.15.32:0/2020722930 shutdown_connections 2023-10-14T12:18:55.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.666+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2020722930 >> v2:172.21.15.32:3300/0 conn(0x7f0288161730 0x7f02880b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.666+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2020722930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02880af740 0x7f02880b14f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.666+0000 7f028c9b1700 1 -- 172.21.15.32:0/2020722930 >> 172.21.15.32:0/2020722930 conn(0x7f0288099a30 msgr2=0x7f02880d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.666+0000 7f028c9b1700 1 -- 172.21.15.32:0/2020722930 shutdown_connections 2023-10-14T12:18:55.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.666+0000 7f028c9b1700 1 -- 172.21.15.32:0/2020722930 wait complete. 2023-10-14T12:18:55.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.668+0000 7f028c9b1700 1 Processor -- start 2023-10-14T12:18:55.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.668+0000 7f028c9b1700 1 -- start start 2023-10-14T12:18:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.669+0000 7f028c9b1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 0x7f02880c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.669+0000 7f028c9b1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02880cd870 0x7f028815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.669+0000 7f028c9b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0288161730 0x7f028815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.669+0000 7f028c9b1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028815c5b0 con 0x7f02880cd870 2023-10-14T12:18:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.669+0000 7f028c9b1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880ae8a0 con 0x7f0288161730 2023-10-14T12:18:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.669+0000 7f028c9b1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028815d3e0 con 0x7f02880af740 2023-10-14T12:18:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 0x7f02880c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 0x7f02880c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:44122/0 (socket says 172.21.15.32:44122) 2023-10-14T12:18:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 -- 172.21.15.32:0/2840531619 learned_addr learned my addr 172.21.15.32:0/2840531619 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 -- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0288161730 msgr2=0x7f028815c070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:18:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0288161730 0x7f028815c070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 -- 172.21.15.32:0/2840531619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02880cd870 msgr2=0x7f028815bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:18:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02880cd870 0x7f028815bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 -- 172.21.15.32:0/2840531619 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0094a0 con 0x7f02880af740 2023-10-14T12:18:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f028659c700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 0x7f02880c67b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f027800c500 tx=0x7f027800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.670+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10d002a070 con 0x7f10e00c27d0 2023-10-14T12:18:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.671+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278005dc0 con 0x7f02880af740 2023-10-14T12:18:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.671+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02780070d0 con 0x7f02880af740 2023-10-14T12:18:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.671+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278007440 con 0x7f02880af740 2023-10-14T12:18:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.671+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028815d6c0 con 0x7f02880af740 2023-10-14T12:18:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.671+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02880c6cf0 con 0x7f02880af740 2023-10-14T12:18:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.675+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02780075a0 con 0x7f02880af740 2023-10-14T12:18:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.675+0000 7f0276ffd700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f027006b130 0x7f027006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.676+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02780889a0 con 0x7f02880af740 2023-10-14T12:18:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.683+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c0052f0 con 0x7f02880af740 2023-10-14T12:18:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.684+0000 7f0285d9b700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f027006b130 0x7f027006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.684+0000 7f0285d9b700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f027006b130 0x7f027006d5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f027c009840 tx=0x7f027c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.688+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0278053ae0 con 0x7f02880af740 2023-10-14T12:18:55.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.954+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdaec0055a0 con 0x7fdb0c1f2360 2023-10-14T12:18:55.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.956+0000 7fdaf3fff700 1 -- 172.21.15.32:0/174124340 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdafc015030 con 0x7fdb0c1f2360 2023-10-14T12:18:55.962 INFO:teuthology.orchestra.run.smithi032.stdout:55834574852 2023-10-14T12:18:55.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdaf806afd0 msgr2=0x7fdaf806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdaf806afd0 0x7fdaf806d490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c1f36c0 tx=0x7fdb00006c60 comp rx=0 tx=0).stop 2023-10-14T12:18:55.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c1f2360 msgr2=0x7fdb0c15c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c1f2360 0x7fdb0c15c250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c070540 tx=0x7fdafc00b770 comp rx=0 tx=0).stop 2023-10-14T12:18:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 shutdown_connections 2023-10-14T12:18:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb0c1f2360 0x7fdb0c15c250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fdaf806afd0 0x7fdaf806d490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb0c157250 0x7fdb0c0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 --2- 172.21.15.32:0/174124340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdb0c15a4e0 0x7fdb0c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:55.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 >> 172.21.15.32:0/174124340 conn(0x7fdb0c0cf3f0 msgr2=0x7fdb0c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:55.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 shutdown_connections 2023-10-14T12:18:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:55.966+0000 7fdb11f58700 1 -- 172.21.15.32:0/174124340 wait complete. 2023-10-14T12:18:55.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2023-10-14T12:18:55.988 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.029+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb64072ca0 con 0x7ffb64157630 2023-10-14T12:18:56.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.029+0000 7ffb4b7fe700 1 -- 172.21.15.32:0/1506581720 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb5c021090 con 0x7ffb64157630 2023-10-14T12:18:56.032 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:56.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ffb5006afd0 msgr2=0x7ffb5006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ffb5006afd0 0x7ffb5006d490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb580061a0 tx=0x7ffb58005ae0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 msgr2=0x7ffb6415c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 0x7ffb6415c250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c014040 tx=0x7ffb5c004ad0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 shutdown_connections 2023-10-14T12:18:56.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb64157630 0x7ffb6415c250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb640c9fc0 0x7ffb640b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ffb5006afd0 0x7ffb5006d490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 --2- 172.21.15.32:0/1506581720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb64157250 0x7ffb64156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 >> 172.21.15.32:0/1506581720 conn(0x7ffb640cf3f0 msgr2=0x7ffb64071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 shutdown_connections 2023-10-14T12:18:56.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.034+0000 7ffb69690700 1 -- 172.21.15.32:0/1506581720 wait complete. 2023-10-14T12:18:56.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.047+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f026c0055a0 con 0x7f02880af740 2023-10-14T12:18:56.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.047+0000 7f0276ffd700 1 -- 172.21.15.32:0/2840531619 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0278017070 con 0x7f02880af740 2023-10-14T12:18:56.051 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:56.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.050+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f027006b130 msgr2=0x7f027006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.050+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f027006b130 0x7f027006d5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f027c009840 tx=0x7f027c008030 comp rx=0 tx=0).stop 2023-10-14T12:18:56.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.050+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 msgr2=0x7f02880c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.050+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 0x7f02880c67b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f027800c500 tx=0x7f027800c8c0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-14T12:18:56.055 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 shutdown_connections 2023-10-14T12:18:56.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f027006b130 0x7f027006d5f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0288161730 0x7f028815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02880af740 0x7f02880c67b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 --2- 172.21.15.32:0/2840531619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02880cd870 0x7f028815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 >> 172.21.15.32:0/2840531619 conn(0x7f0288099a30 msgr2=0x7f02880b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 shutdown_connections 2023-10-14T12:18:56.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.051+0000 7f028c9b1700 1 -- 172.21.15.32:0/2840531619 wait complete. 2023-10-14T12:18:56.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.058+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f68a80055a0 con 0x7f68b00037f0 2023-10-14T12:18:56.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.059+0000 7f68c4ff9700 1 -- 172.21.15.32:0/1807167483 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68c00583e0 con 0x7f68b00037f0 2023-10-14T12:18:56.061 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:56.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.062+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff0f404ebb0 con 0x7ff0f40c9fc0 2023-10-14T12:18:56.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.062+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f68b406afd0 msgr2=0x7f68b406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.062+0000 7f68ce94d700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f68b406afd0 0x7f68b406d490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b4fd0 tx=0x7f68bc009030 comp rx=0 tx=0).stop 2023-10-14T12:18:56.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.062+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b00037f0 msgr2=0x7f68c8163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.062+0000 7f68ce94d700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b00037f0 0x7f68c8163240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68c0004690 tx=0x7f68c0007330 comp rx=0 tx=0).stop 2023-10-14T12:18:56.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.062+0000 7ff0e2ffd700 1 -- 172.21.15.32:0/1799672742 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0e4059600 con 0x7ff0f40c9fc0 2023-10-14T12:18:56.067 INFO:teuthology.orchestra.run.smithi032.stdout:55834574853 2023-10-14T12:18:56.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 shutdown_connections 2023-10-14T12:18:56.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68c8159770 0x7f68c80c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68b00037f0 0x7f68c8163240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f68b406afd0 0x7f68b406d490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 --2- 172.21.15.32:0/1807167483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68c80c85f0 0x7f68c80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 >> 172.21.15.32:0/1807167483 conn(0x7f68c806afb0 msgr2=0x7f68c80c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 shutdown_connections 2023-10-14T12:18:56.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f68ce94d700 1 -- 172.21.15.32:0/1807167483 wait complete. 2023-10-14T12:18:56.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.064+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f10e004ebb0 con 0x7f10e00c27d0 2023-10-14T12:18:56.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-14T12:18:56.073 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:56.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7f10d6ffd700 1 -- 172.21.15.32:0/1819327971 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10d0055eb0 con 0x7f10e00c27d0 2023-10-14T12:18:56.074 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff0d406af00 msgr2=0x7ff0d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff0d406af00 0x7ff0d406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8007fd0 tx=0x7ff0e8007980 comp rx=0 tx=0).stop 2023-10-14T12:18:56.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 msgr2=0x7ff0f4071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 0x7ff0f4071da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40090b0 tx=0x7ff0e4004750 comp rx=0 tx=0).stop 2023-10-14T12:18:56.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 shutdown_connections 2023-10-14T12:18:56.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0f4159fa0 0x7ff0f4149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff0d406af00 0x7ff0d406d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f40c9fc0 0x7ff0f4071da0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 --2- 172.21.15.32:0/1799672742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0f40cff10 0x7ff0f40722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 >> 172.21.15.32:0/1799672742 conn(0x7ff0f40cf3f0 msgr2=0x7ff0f414a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.065+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 shutdown_connections 2023-10-14T12:18:56.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.066+0000 7ff0f8fc5700 1 -- 172.21.15.32:0/1799672742 wait complete. 2023-10-14T12:18:56.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.068+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feed804ebb0 con 0x7feed80c9fc0 2023-10-14T12:18:56.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.069+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f10c406af50 msgr2=0x7f10c406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.069+0000 7f10e868b700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f10c406af50 0x7f10c406d410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0097b0 tx=0x7f10dc006d20 comp rx=0 tx=0).stop 2023-10-14T12:18:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.069+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 msgr2=0x7f10e0162fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.069+0000 7f10e868b700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 0x7f10e0162fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10e00b1f10 tx=0x7f10d0004750 comp rx=0 tx=0).stop 2023-10-14T12:18:56.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.069+0000 7feed57fa700 1 -- 172.21.15.32:0/4147343737 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feec8061e40 con 0x7feed80c9fc0 2023-10-14T12:18:56.080 INFO:teuthology.orchestra.run.smithi032.stdout:55834574854 2023-10-14T12:18:56.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 shutdown_connections 2023-10-14T12:18:56.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10e00c9a40 0x7f10e01ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10e00b0e70 0x7f10e0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f10c406af50 0x7f10c406d410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 --2- 172.21.15.32:0/1819327971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e00c27d0 0x7f10e0162fb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 >> 172.21.15.32:0/1819327971 conn(0x7f10e006afb0 msgr2=0x7f10e00726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 shutdown_connections 2023-10-14T12:18:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.070+0000 7f10e868b700 1 -- 172.21.15.32:0/1819327971 wait complete. 2023-10-14T12:18:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.073+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feec406af50 msgr2=0x7feec406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.073+0000 7feedf121700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feec406af50 0x7feec406d410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feed80cb990 tx=0x7feecc009110 comp rx=0 tx=0).stop 2023-10-14T12:18:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.073+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 msgr2=0x7feed80b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.073+0000 7feedf121700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 0x7feed80b1250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feec8000c00 tx=0x7feec8004750 comp rx=0 tx=0).stop 2023-10-14T12:18:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe2c1fb4a0 con 0x7fbe2c15a580 2023-10-14T12:18:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7fbe13fff700 1 -- 172.21.15.32:0/2244610620 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe2c1fb4a0 con 0x7fbe2c15a580 2023-10-14T12:18:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 shutdown_connections 2023-10-14T12:18:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feed815a4e0 0x7feed80b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feed80c9fc0 0x7feed80b1250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feec406af50 0x7feec406d410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 --2- 172.21.15.32:0/4147343737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed8157250 0x7feed8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 >> 172.21.15.32:0/4147343737 conn(0x7feed80cf3f0 msgr2=0x7feed80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.087 INFO:teuthology.orchestra.run.smithi032.stdout:55834574855 2023-10-14T12:18:56.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 shutdown_connections 2023-10-14T12:18:56.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.076+0000 7feedf121700 1 -- 172.21.15.32:0/4147343737 wait complete. 2023-10-14T12:18:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.080+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbe1806af00 msgr2=0x7fbe1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.080+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbe1806af00 0x7fbe1806d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe24000f80 tx=0x7fbe24007040 comp rx=0 tx=0).stop 2023-10-14T12:18:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.080+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 msgr2=0x7fbe2c0c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.080+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0c4ce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00c450 tx=0x7fbe1c00c760 comp rx=0 tx=0).stop 2023-10-14T12:18:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 shutdown_connections 2023-10-14T12:18:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbe1806af00 0x7fbe1806d3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe2c15e8d0 0x7fbe2c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe2c06c9b0 0x7fbe2c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 --2- 172.21.15.32:0/2244610620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe2c15a580 0x7fbe2c0c4ce0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 >> 172.21.15.32:0/2244610620 conn(0x7fbe2c06afb0 msgr2=0x7fbe2c158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 shutdown_connections 2023-10-14T12:18:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.081+0000 7fbe31fe8700 1 -- 172.21.15.32:0/2244610620 wait complete. 2023-10-14T12:18:56.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-10-14T12:18:56.095 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-14T12:18:56.096 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-14T12:18:56.097 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-14T12:18:56.099 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-14T12:18:56.101 DEBUG:teuthology.parallel:result is None 2023-10-14T12:18:56.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T12:18:56.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:18:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.263+0000 7f63cacf1700 1 Processor -- start 2023-10-14T12:18:56.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.264+0000 7f63cacf1700 1 -- start start 2023-10-14T12:18:56.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.264+0000 7f63cacf1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f63c415f1f0 0x7f63c40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.264+0000 7f63cacf1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c415e7a0 con 0x7f63c415ab10 2023-10-14T12:18:56.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.264+0000 7f63cacf1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40d0090 con 0x7f63c40cfc60 2023-10-14T12:18:56.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.264+0000 7f63cacf1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c40b29a0 con 0x7f63c415f1f0 2023-10-14T12:18:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.264+0000 7f63c8a8d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f63c415ab10 0x7f63c40b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55458/0 (socket says 172.21.15.32:55458) 2023-10-14T12:18:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c8a8d700 1 -- 172.21.15.32:0/4157534533 learned_addr learned my addr 172.21.15.32:0/4157534533 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:56.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c3fff700 1 --2- 172.21.15.32:0/4157534533 >> v2:172.21.15.92:3300/0 conn(0x7f63c415f1f0 0x7f63c40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426512010 0 0) 0x7f63c415e7a0 con 0x7f63c415ab10 2023-10-14T12:18:56.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b40035b0 con 0x7f63c415ab10 2023-10-14T12:18:56.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060931244 0 0) 0x7f63c40d0090 con 0x7f63c40cfc60 2023-10-14T12:18:56.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c415e7a0 con 0x7f63c40cfc60 2023-10-14T12:18:56.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2742073775 0 0) 0x7f63b40035b0 con 0x7f63c415ab10 2023-10-14T12:18:56.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 >> v2:172.21.15.92:3300/0 conn(0x7f63c415f1f0 msgr2=0x7f63c40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:56.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 --2- 172.21.15.32:0/4157534533 >> v2:172.21.15.92:3300/0 conn(0x7f63c415f1f0 0x7f63c40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 >> v1:172.21.15.92:6789/0 conn(0x7f63c40cfc60 legacy=0x7f63c40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40b2c80 con 0x7f63c415ab10 2023-10-14T12:18:56.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f63b8001670 con 0x7f63c415ab10 2023-10-14T12:18:56.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 >> v1:172.21.15.32:6789/0 conn(0x7f63c415ab10 legacy=0x7f63c40b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4003b90 0x7f63b4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63b4004850 0x7f63b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63b4005210 0x7f63b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40b29a0 con 0x7f63b4004850 2023-10-14T12:18:56.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b400c090 con 0x7f63b4003b90 2023-10-14T12:18:56.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b400c250 con 0x7f63b4005210 2023-10-14T12:18:56.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c3fff700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63b4004850 0x7f63b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c8a8d700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4003b90 0x7f63b4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.265+0000 7f63c928e700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63b4005210 0x7f63b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c3fff700 1 -- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63b4005210 msgr2=0x7f63b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:56.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c3fff700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63b4005210 0x7f63b400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c3fff700 1 -- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4003b90 msgr2=0x7f63b4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:56.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c3fff700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4003b90 0x7f63b4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c928e700 1 -- 172.21.15.32:0/4157534533 reap_dead start 2023-10-14T12:18:56.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c3fff700 1 -- 172.21.15.32:0/4157534533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40035b0 con 0x7f63b4004850 2023-10-14T12:18:56.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c3fff700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63b4004850 0x7f63b4004cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009b40 tx=0x7f63b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fec1cb20d1f34d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:56.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0005a20 con 0x7f63b4004850 2023-10-14T12:18:56.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0005b80 con 0x7f63b4004850 2023-10-14T12:18:56.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63c37fe700 1 -- 172.21.15.32:0/4157534533 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000e6c0 con 0x7f63b4004850 2023-10-14T12:18:56.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63cacf1700 1 -- 172.21.15.32:0/4157534533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63b4004850 msgr2=0x7f63b4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63cacf1700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63b4004850 0x7f63b4004cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009b40 tx=0x7f63b4005880 comp rx=0 tx=0).stop 2023-10-14T12:18:56.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63cacf1700 1 -- 172.21.15.32:0/4157534533 shutdown_connections 2023-10-14T12:18:56.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63cacf1700 1 --2- 172.21.15.32:0/4157534533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63b4004850 0x7f63b4004cd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63cacf1700 1 -- 172.21.15.32:0/4157534533 >> 172.21.15.32:0/4157534533 conn(0x7f63c406dae0 msgr2=0x7f63c406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.266+0000 7f63cacf1700 1 -- 172.21.15.32:0/4157534533 shutdown_connections 2023-10-14T12:18:56.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.267+0000 7f63cacf1700 1 -- 172.21.15.32:0/4157534533 wait complete. 2023-10-14T12:18:56.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.268+0000 7f63cacf1700 1 Processor -- start 2023-10-14T12:18:56.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.268+0000 7f63cacf1700 1 -- start start 2023-10-14T12:18:56.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4004850 0x7f63c41f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63c41592f0 0x7f63c40c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 0x7f63c40cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4159c00 con 0x7f63c4158b80 2023-10-14T12:18:56.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415c5d0 con 0x7f63b4004850 2023-10-14T12:18:56.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40c7ae0 con 0x7f63c41592f0 2023-10-14T12:18:56.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 0x7f63c40cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 0x7f63c40cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38450/0 (socket says 172.21.15.32:38450) 2023-10-14T12:18:56.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 -- 172.21.15.32:0/2839017875 learned_addr learned my addr 172.21.15.32:0/2839017875 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:56.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c8a8d700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4004850 0x7f63c41f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c3fff700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63c41592f0 0x7f63c40c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 -- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63c41592f0 msgr2=0x7f63c40c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63c41592f0 0x7f63c40c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 -- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4004850 msgr2=0x7f63c41f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4004850 0x7f63c41f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 -- 172.21.15.32:0/2839017875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40c7d10 con 0x7f63c4158b80 2023-10-14T12:18:56.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c928e700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 0x7f63c40cced0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f63c415e6d0 tx=0x7f63bc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:56.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc003c10 con 0x7f63c4158b80 2023-10-14T12:18:56.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc003d70 con 0x7f63c4158b80 2023-10-14T12:18:56.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c40c7ff0 con 0x7f63c4158b80 2023-10-14T12:18:56.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00db20 con 0x7f63c4158b80 2023-10-14T12:18:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.269+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c415cac0 con 0x7f63c4158b80 2023-10-14T12:18:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.270+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40c81e0 con 0x7f63c4158b80 2023-10-14T12:18:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.271+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63bc00dc80 con 0x7f63c4158b80 2023-10-14T12:18:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.271+0000 7f63c17fa700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f63a806af00 0x7f63a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.271+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63bc089700 con 0x7f63c4158b80 2023-10-14T12:18:56.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.271+0000 7f63c8a8d700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f63a806af00 0x7f63a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.272+0000 7f63c8a8d700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f63a806af00 0x7f63a806d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63b8001200 tx=0x7f63b8001e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:56.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.275+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63bc0548f0 con 0x7f63c4158b80 2023-10-14T12:18:56.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.469+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63c415ecd0 con 0x7f63a806af00 2023-10-14T12:18:56.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.477+0000 7f63c17fa700 1 -- 172.21.15.32:0/2839017875 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264588 (secure 0 0 0) 0x7f63b80070c0 con 0x7f63a806af00 2023-10-14T12:18:56.482 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:56.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f63a806af00 msgr2=0x7f63a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f63a806af00 0x7f63a806d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63b8001200 tx=0x7f63b8001e10 comp rx=0 tx=0).stop 2023-10-14T12:18:56.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 msgr2=0x7f63c40cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 0x7f63c40cced0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f63c415e6d0 tx=0x7f63bc00d430 comp rx=0 tx=0).stop 2023-10-14T12:18:56.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 shutdown_connections 2023-10-14T12:18:56.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c4158b80 0x7f63c40cced0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f63a806af00 0x7f63a806d3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63b4004850 0x7f63c41f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 --2- 172.21.15.32:0/2839017875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63c41592f0 0x7f63c40c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 >> 172.21.15.32:0/2839017875 conn(0x7f63c406dae0 msgr2=0x7f63c40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 shutdown_connections 2023-10-14T12:18:56.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.480+0000 7f63cacf1700 1 -- 172.21.15.32:0/2839017875 wait complete. 2023-10-14T12:18:56.486 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:18:56.494 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T12:18:55.098270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001948"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353249+0000","last_change":"2023-10-14T12:18:47.509049+0000","last_active":"2023-10-14T12:18:50.353249+0000","last_peered":"2023-10-14T12:18:50.353249+0000","last_clean":"2023-10-14T12:18:50.353249+0000","last_became_active":"2023-10-14T12:18:47.508659+0000","last_became_peered":"2023-10-14T12:18:47.508659+0000","last_unstale":"2023-10-14T12:18:50.353249+0000","last_undegraded":"2023-10-14T12:18:50.353249+0000","last_fullsized":"2023-10-14T12:18:50.353249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:15.401442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651885+0000","last_change":"2023-10-14T12:18:47.500830+0000","last_active":"2023-10-14T12:18:48.651885+0000","last_peered":"2023-10-14T12:18:48.651885+0000","last_clean":"2023-10-14T12:18:48.651885+0000","last_became_active":"2023-10-14T12:18:47.500534+0000","last_became_peered":"2023-10-14T12:18:47.500534+0000","last_unstale":"2023-10-14T12:18:48.651885+0000","last_undegraded":"2023-10-14T12:18:48.651885+0000","last_fullsized":"2023-10-14T12:18:48.651885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352506+0000","last_change":"2023-10-14T12:18:47.502596+0000","last_active":"2023-10-14T12:18:50.352506+0000","last_peered":"2023-10-14T12:18:50.352506+0000","last_clean":"2023-10-14T12:18:50.352506+0000","last_became_active":"2023-10-14T12:18:47.502274+0000","last_became_peered":"2023-10-14T12:18:47.502274+0000","last_unstale":"2023-10-14T12:18:50.352506+0000","last_undegraded":"2023-10-14T12:18:50.352506+0000","last_fullsized":"2023-10-14T12:18:50.352506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501296+0000","last_change":"2023-10-14T12:18:47.517714+0000","last_active":"2023-10-14T12:18:48.501296+0000","last_peered":"2023-10-14T12:18:48.501296+0000","last_clean":"2023-10-14T12:18:48.501296+0000","last_became_active":"2023-10-14T12:18:47.512963+0000","last_became_peered":"2023-10-14T12:18:47.512963+0000","last_unstale":"2023-10-14T12:18:48.501296+0000","last_undegraded":"2023-10-14T12:18:48.501296+0000","last_fullsized":"2023-10-14T12:18:48.501296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:47.569087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352967+0000","last_change":"2023-10-14T12:18:47.505586+0000","last_active":"2023-10-14T12:18:50.352967+0000","last_peered":"2023-10-14T12:18:50.352967+0000","last_clean":"2023-10-14T12:18:50.352967+0000","last_became_active":"2023-10-14T12:18:47.505317+0000","last_became_peered":"2023-10-14T12:18:47.505317+0000","last_unstale":"2023-10-14T12:18:50.352967+0000","last_undegraded":"2023-10-14T12:18:50.352967+0000","last_fullsized":"2023-10-14T12:18:50.352967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501003+0000","last_change":"2023-10-14T12:18:47.518702+0000","last_active":"2023-10-14T12:18:48.501003+0000","last_peered":"2023-10-14T12:18:48.501003+0000","last_clean":"2023-10-14T12:18:48.501003+0000","last_became_active":"2023-10-14T12:18:47.512637+0000","last_became_peered":"2023-10-14T12:18:47.512637+0000","last_unstale":"2023-10-14T12:18:48.501003+0000","last_undegraded":"2023-10-14T12:18:48.501003+0000","last_fullsized":"2023-10-14T12:18:48.501003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352748+0000","last_change":"2023-10-14T12:18:47.508247+0000","last_active":"2023-10-14T12:18:50.352748+0000","last_peered":"2023-10-14T12:18:50.352748+0000","last_clean":"2023-10-14T12:18:50.352748+0000","last_became_active":"2023-10-14T12:18:47.507971+0000","last_became_peered":"2023-10-14T12:18:47.507971+0000","last_unstale":"2023-10-14T12:18:50.352748+0000","last_undegraded":"2023-10-14T12:18:50.352748+0000","last_fullsized":"2023-10-14T12:18:50.352748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500163+0000","last_change":"2023-10-14T12:18:47.512408+0000","last_active":"2023-10-14T12:18:48.500163+0000","last_peered":"2023-10-14T12:18:48.500163+0000","last_clean":"2023-10-14T12:18:48.500163+0000","last_became_active":"2023-10-14T12:18:47.512170+0000","last_became_peered":"2023-10-14T12:18:47.512170+0000","last_unstale":"2023-10-14T12:18:48.500163+0000","last_undegraded":"2023-10-14T12:18:48.500163+0000","last_fullsized":"2023-10-14T12:18:48.500163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353201+0000","last_change":"2023-10-14T12:18:47.518549+0000","last_active":"2023-10-14T12:18:50.353201+0000","last_peered":"2023-10-14T12:18:50.353201+0000","last_clean":"2023-10-14T12:18:50.353201+0000","last_became_active":"2023-10-14T12:18:47.517982+0000","last_became_peered":"2023-10-14T12:18:47.517982+0000","last_unstale":"2023-10-14T12:18:50.353201+0000","last_undegraded":"2023-10-14T12:18:50.353201+0000","last_fullsized":"2023-10-14T12:18:50.353201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:10.981380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444405+0000","last_change":"2023-10-14T12:18:47.512949+0000","last_active":"2023-10-14T12:18:49.444405+0000","last_peered":"2023-10-14T12:18:49.444405+0000","last_clean":"2023-10-14T12:18:49.444405+0000","last_became_active":"2023-10-14T12:18:47.512703+0000","last_became_peered":"2023-10-14T12:18:47.512703+0000","last_unstale":"2023-10-14T12:18:49.444405+0000","last_undegraded":"2023-10-14T12:18:49.444405+0000","last_fullsized":"2023-10-14T12:18:49.444405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444355+0000","last_change":"2023-10-14T12:18:47.518785+0000","last_active":"2023-10-14T12:18:49.444355+0000","last_peered":"2023-10-14T12:18:49.444355+0000","last_clean":"2023-10-14T12:18:49.444355+0000","last_became_active":"2023-10-14T12:18:47.518508+0000","last_became_peered":"2023-10-14T12:18:47.518508+0000","last_unstale":"2023-10-14T12:18:49.444355+0000","last_undegraded":"2023-10-14T12:18:49.444355+0000","last_fullsized":"2023-10-14T12:18:49.444355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769191+0000","last_change":"2023-10-14T12:18:47.504920+0000","last_active":"2023-10-14T12:18:49.769191+0000","last_peered":"2023-10-14T12:18:49.769191+0000","last_clean":"2023-10-14T12:18:49.769191+0000","last_became_active":"2023-10-14T12:18:47.504633+0000","last_became_peered":"2023-10-14T12:18:47.504633+0000","last_unstale":"2023-10-14T12:18:49.769191+0000","last_undegraded":"2023-10-14T12:18:49.769191+0000","last_fullsized":"2023-10-14T12:18:49.769191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500384+0000","last_change":"2023-10-14T12:18:47.505034+0000","last_active":"2023-10-14T12:18:48.500384+0000","last_peered":"2023-10-14T12:18:48.500384+0000","last_clean":"2023-10-14T12:18:48.500384+0000","last_became_active":"2023-10-14T12:18:47.504655+0000","last_became_peered":"2023-10-14T12:18:47.504655+0000","last_unstale":"2023-10-14T12:18:48.500384+0000","last_undegraded":"2023-10-14T12:18:48.500384+0000","last_fullsized":"2023-10-14T12:18:48.500384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352363+0000","last_change":"2023-10-14T12:18:47.499576+0000","last_active":"2023-10-14T12:18:50.352363+0000","last_peered":"2023-10-14T12:18:50.352363+0000","last_clean":"2023-10-14T12:18:50.352363+0000","last_became_active":"2023-10-14T12:18:47.499249+0000","last_became_peered":"2023-10-14T12:18:47.499249+0000","last_unstale":"2023-10-14T12:18:50.352363+0000","last_undegraded":"2023-10-14T12:18:50.352363+0000","last_fullsized":"2023-10-14T12:18:50.352363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:40.565801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651648+0000","last_change":"2023-10-14T12:18:47.508453+0000","last_active":"2023-10-14T12:18:48.651648+0000","last_peered":"2023-10-14T12:18:48.651648+0000","last_clean":"2023-10-14T12:18:48.651648+0000","last_became_active":"2023-10-14T12:18:47.508081+0000","last_became_peered":"2023-10-14T12:18:47.508081+0000","last_unstale":"2023-10-14T12:18:48.651648+0000","last_undegraded":"2023-10-14T12:18:48.651648+0000","last_fullsized":"2023-10-14T12:18:48.651648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500721+0000","last_change":"2023-10-14T12:18:47.505739+0000","last_active":"2023-10-14T12:18:48.500721+0000","last_peered":"2023-10-14T12:18:48.500721+0000","last_clean":"2023-10-14T12:18:48.500721+0000","last_became_active":"2023-10-14T12:18:47.505456+0000","last_became_peered":"2023-10-14T12:18:47.505456+0000","last_unstale":"2023-10-14T12:18:48.500721+0000","last_undegraded":"2023-10-14T12:18:48.500721+0000","last_fullsized":"2023-10-14T12:18:48.500721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501605+0000","last_change":"2023-10-14T12:18:47.516673+0000","last_active":"2023-10-14T12:18:48.501605+0000","last_peered":"2023-10-14T12:18:48.501605+0000","last_clean":"2023-10-14T12:18:48.501605+0000","last_became_active":"2023-10-14T12:18:47.516312+0000","last_became_peered":"2023-10-14T12:18:47.516312+0000","last_unstale":"2023-10-14T12:18:48.501605+0000","last_undegraded":"2023-10-14T12:18:48.501605+0000","last_fullsized":"2023-10-14T12:18:48.501605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:15.401442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499582+0000","last_change":"2023-10-14T12:18:47.505601+0000","last_active":"2023-10-14T12:18:48.499582+0000","last_peered":"2023-10-14T12:18:48.499582+0000","last_clean":"2023-10-14T12:18:48.499582+0000","last_became_active":"2023-10-14T12:18:47.505242+0000","last_became_peered":"2023-10-14T12:18:47.505242+0000","last_unstale":"2023-10-14T12:18:48.499582+0000","last_undegraded":"2023-10-14T12:18:48.499582+0000","last_fullsized":"2023-10-14T12:18:48.499582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352933+0000","last_change":"2023-10-14T12:18:47.506070+0000","last_active":"2023-10-14T12:18:50.352933+0000","last_peered":"2023-10-14T12:18:50.352933+0000","last_clean":"2023-10-14T12:18:50.352933+0000","last_became_active":"2023-10-14T12:18:47.505784+0000","last_became_peered":"2023-10-14T12:18:47.505784+0000","last_unstale":"2023-10-14T12:18:50.352933+0000","last_undegraded":"2023-10-14T12:18:50.352933+0000","last_fullsized":"2023-10-14T12:18:50.352933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.245049+0000","last_change":"2023-10-14T12:18:46.489704+0000","last_active":"2023-10-14T12:18:50.245049+0000","last_peered":"2023-10-14T12:18:50.245049+0000","last_clean":"2023-10-14T12:18:50.245049+0000","last_became_active":"2023-10-14T12:18:46.489418+0000","last_became_peered":"2023-10-14T12:18:46.489418+0000","last_unstale":"2023-10-14T12:18:50.245049+0000","last_undegraded":"2023-10-14T12:18:50.245049+0000","last_fullsized":"2023-10-14T12:18:50.245049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500871+0000","last_change":"2023-10-14T12:18:47.506025+0000","last_active":"2023-10-14T12:18:48.500871+0000","last_peered":"2023-10-14T12:18:48.500871+0000","last_clean":"2023-10-14T12:18:48.500871+0000","last_became_active":"2023-10-14T12:18:47.505700+0000","last_became_peered":"2023-10-14T12:18:47.505700+0000","last_unstale":"2023-10-14T12:18:48.500871+0000","last_undegraded":"2023-10-14T12:18:48.500871+0000","last_fullsized":"2023-10-14T12:18:48.500871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500977+0000","last_change":"2023-10-14T12:18:46.486371+0000","last_active":"2023-10-14T12:18:48.500977+0000","last_peered":"2023-10-14T12:18:48.500977+0000","last_clean":"2023-10-14T12:18:48.500977+0000","last_became_active":"2023-10-14T12:18:46.486098+0000","last_became_peered":"2023-10-14T12:18:46.486098+0000","last_unstale":"2023-10-14T12:18:48.500977+0000","last_undegraded":"2023-10-14T12:18:48.500977+0000","last_fullsized":"2023-10-14T12:18:48.500977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352475+0000","last_change":"2023-10-14T12:18:47.517540+0000","last_active":"2023-10-14T12:18:50.352475+0000","last_peered":"2023-10-14T12:18:50.352475+0000","last_clean":"2023-10-14T12:18:50.352475+0000","last_became_active":"2023-10-14T12:18:47.517283+0000","last_became_peered":"2023-10-14T12:18:47.517283+0000","last_unstale":"2023-10-14T12:18:50.352475+0000","last_undegraded":"2023-10-14T12:18:50.352475+0000","last_fullsized":"2023-10-14T12:18:50.352475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.169009+0000","last_change":"2023-10-14T12:18:46.492599+0000","last_active":"2023-10-14T12:18:50.169009+0000","last_peered":"2023-10-14T12:18:50.169009+0000","last_clean":"2023-10-14T12:18:50.169009+0000","last_became_active":"2023-10-14T12:18:46.492296+0000","last_became_peered":"2023-10-14T12:18:46.492296+0000","last_unstale":"2023-10-14T12:18:50.169009+0000","last_undegraded":"2023-10-14T12:18:50.169009+0000","last_fullsized":"2023-10-14T12:18:50.169009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501088+0000","last_change":"2023-10-14T12:18:47.517351+0000","last_active":"2023-10-14T12:18:48.501088+0000","last_peered":"2023-10-14T12:18:48.501088+0000","last_clean":"2023-10-14T12:18:48.501088+0000","last_became_active":"2023-10-14T12:18:47.516208+0000","last_became_peered":"2023-10-14T12:18:47.516208+0000","last_unstale":"2023-10-14T12:18:48.501088+0000","last_undegraded":"2023-10-14T12:18:48.501088+0000","last_fullsized":"2023-10-14T12:18:48.501088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168896+0000","last_change":"2023-10-14T12:18:46.489437+0000","last_active":"2023-10-14T12:18:50.168896+0000","last_peered":"2023-10-14T12:18:50.168896+0000","last_clean":"2023-10-14T12:18:50.168896+0000","last_became_active":"2023-10-14T12:18:46.489122+0000","last_became_peered":"2023-10-14T12:18:46.489122+0000","last_unstale":"2023-10-14T12:18:50.168896+0000","last_undegraded":"2023-10-14T12:18:50.168896+0000","last_fullsized":"2023-10-14T12:18:50.168896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501421+0000","last_change":"2023-10-14T12:18:47.512921+0000","last_active":"2023-10-14T12:18:48.501421+0000","last_peered":"2023-10-14T12:18:48.501421+0000","last_clean":"2023-10-14T12:18:48.501421+0000","last_became_active":"2023-10-14T12:18:47.512426+0000","last_became_peered":"2023-10-14T12:18:47.512426+0000","last_unstale":"2023-10-14T12:18:48.501421+0000","last_undegraded":"2023-10-14T12:18:48.501421+0000","last_fullsized":"2023-10-14T12:18:48.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:30.575773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500674+0000","last_change":"2023-10-14T12:18:46.489840+0000","last_active":"2023-10-14T12:18:48.500674+0000","last_peered":"2023-10-14T12:18:48.500674+0000","last_clean":"2023-10-14T12:18:48.500674+0000","last_became_active":"2023-10-14T12:18:46.489548+0000","last_became_peered":"2023-10-14T12:18:46.489548+0000","last_unstale":"2023-10-14T12:18:48.500674+0000","last_undegraded":"2023-10-14T12:18:48.500674+0000","last_fullsized":"2023-10-14T12:18:48.500674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.768871+0000","last_change":"2023-10-14T12:18:47.505062+0000","last_active":"2023-10-14T12:18:49.768871+0000","last_peered":"2023-10-14T12:18:49.768871+0000","last_clean":"2023-10-14T12:18:49.768871+0000","last_became_active":"2023-10-14T12:18:47.504744+0000","last_became_peered":"2023-10-14T12:18:47.504744+0000","last_unstale":"2023-10-14T12:18:49.768871+0000","last_undegraded":"2023-10-14T12:18:49.768871+0000","last_fullsized":"2023-10-14T12:18:49.768871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444107+0000","last_change":"2023-10-14T12:18:46.495580+0000","last_active":"2023-10-14T12:18:49.444107+0000","last_peered":"2023-10-14T12:18:49.444107+0000","last_clean":"2023-10-14T12:18:49.444107+0000","last_became_active":"2023-10-14T12:18:46.495262+0000","last_became_peered":"2023-10-14T12:18:46.495262+0000","last_unstale":"2023-10-14T12:18:49.444107+0000","last_undegraded":"2023-10-14T12:18:49.444107+0000","last_fullsized":"2023-10-14T12:18:49.444107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352699+0000","last_change":"2023-10-14T12:18:47.509133+0000","last_active":"2023-10-14T12:18:50.352699+0000","last_peered":"2023-10-14T12:18:50.352699+0000","last_clean":"2023-10-14T12:18:50.352699+0000","last_became_active":"2023-10-14T12:18:47.508824+0000","last_became_peered":"2023-10-14T12:18:47.508824+0000","last_unstale":"2023-10-14T12:18:50.352699+0000","last_undegraded":"2023-10-14T12:18:50.352699+0000","last_fullsized":"2023-10-14T12:18:50.352699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500305+0000","last_change":"2023-10-14T12:18:46.489498+0000","last_active":"2023-10-14T12:18:48.500305+0000","last_peered":"2023-10-14T12:18:48.500305+0000","last_clean":"2023-10-14T12:18:48.500305+0000","last_became_active":"2023-10-14T12:18:46.489134+0000","last_became_peered":"2023-10-14T12:18:46.489134+0000","last_unstale":"2023-10-14T12:18:48.500305+0000","last_undegraded":"2023-10-14T12:18:48.500305+0000","last_fullsized":"2023-10-14T12:18:48.500305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500304+0000","last_change":"2023-10-14T12:18:47.500917+0000","last_active":"2023-10-14T12:18:48.500304+0000","last_peered":"2023-10-14T12:18:48.500304+0000","last_clean":"2023-10-14T12:18:48.500304+0000","last_became_active":"2023-10-14T12:18:47.500513+0000","last_became_peered":"2023-10-14T12:18:47.500513+0000","last_unstale":"2023-10-14T12:18:48.500304+0000","last_undegraded":"2023-10-14T12:18:48.500304+0000","last_fullsized":"2023-10-14T12:18:48.500304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500764+0000","last_change":"2023-10-14T12:18:46.485701+0000","last_active":"2023-10-14T12:18:48.500764+0000","last_peered":"2023-10-14T12:18:48.500764+0000","last_clean":"2023-10-14T12:18:48.500764+0000","last_became_active":"2023-10-14T12:18:46.485368+0000","last_became_peered":"2023-10-14T12:18:46.485368+0000","last_unstale":"2023-10-14T12:18:48.500764+0000","last_undegraded":"2023-10-14T12:18:48.500764+0000","last_fullsized":"2023-10-14T12:18:48.500764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:19.585802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651760+0000","last_change":"2023-10-14T12:18:47.497548+0000","last_active":"2023-10-14T12:18:48.651760+0000","last_peered":"2023-10-14T12:18:48.651760+0000","last_clean":"2023-10-14T12:18:48.651760+0000","last_became_active":"2023-10-14T12:18:47.497227+0000","last_became_peered":"2023-10-14T12:18:47.497227+0000","last_unstale":"2023-10-14T12:18:48.651760+0000","last_undegraded":"2023-10-14T12:18:48.651760+0000","last_fullsized":"2023-10-14T12:18:48.651760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444253+0000","last_change":"2023-10-14T12:18:46.491993+0000","last_active":"2023-10-14T12:18:49.444253+0000","last_peered":"2023-10-14T12:18:49.444253+0000","last_clean":"2023-10-14T12:18:49.444253+0000","last_became_active":"2023-10-14T12:18:46.491478+0000","last_became_peered":"2023-10-14T12:18:46.491478+0000","last_unstale":"2023-10-14T12:18:49.444253+0000","last_undegraded":"2023-10-14T12:18:49.444253+0000","last_fullsized":"2023-10-14T12:18:49.444253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501636+0000","last_change":"2023-10-14T12:18:47.510673+0000","last_active":"2023-10-14T12:18:48.501636+0000","last_peered":"2023-10-14T12:18:48.501636+0000","last_clean":"2023-10-14T12:18:48.501636+0000","last_became_active":"2023-10-14T12:18:47.510382+0000","last_became_peered":"2023-10-14T12:18:47.510382+0000","last_unstale":"2023-10-14T12:18:48.501636+0000","last_undegraded":"2023-10-14T12:18:48.501636+0000","last_fullsized":"2023-10-14T12:18:48.501636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:47.215959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501549+0000","last_change":"2023-10-14T12:18:46.487677+0000","last_active":"2023-10-14T12:18:48.501549+0000","last_peered":"2023-10-14T12:18:48.501549+0000","last_clean":"2023-10-14T12:18:48.501549+0000","last_became_active":"2023-10-14T12:18:46.487359+0000","last_became_peered":"2023-10-14T12:18:46.487359+0000","last_unstale":"2023-10-14T12:18:48.501549+0000","last_undegraded":"2023-10-14T12:18:48.501549+0000","last_fullsized":"2023-10-14T12:18:48.501549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:50.124419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352655+0000","last_change":"2023-10-14T12:18:47.521313+0000","last_active":"2023-10-14T12:18:50.352655+0000","last_peered":"2023-10-14T12:18:50.352655+0000","last_clean":"2023-10-14T12:18:50.352655+0000","last_became_active":"2023-10-14T12:18:47.521124+0000","last_became_peered":"2023-10-14T12:18:47.521124+0000","last_unstale":"2023-10-14T12:18:50.352655+0000","last_undegraded":"2023-10-14T12:18:50.352655+0000","last_fullsized":"2023-10-14T12:18:50.352655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651865+0000","last_change":"2023-10-14T12:18:46.488148+0000","last_active":"2023-10-14T12:18:48.651865+0000","last_peered":"2023-10-14T12:18:48.651865+0000","last_clean":"2023-10-14T12:18:48.651865+0000","last_became_active":"2023-10-14T12:18:46.487791+0000","last_became_peered":"2023-10-14T12:18:46.487791+0000","last_unstale":"2023-10-14T12:18:48.651865+0000","last_undegraded":"2023-10-14T12:18:48.651865+0000","last_fullsized":"2023-10-14T12:18:48.651865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:45.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769286+0000","last_change":"2023-10-14T12:18:47.512765+0000","last_active":"2023-10-14T12:18:49.769286+0000","last_peered":"2023-10-14T12:18:49.769286+0000","last_clean":"2023-10-14T12:18:49.769286+0000","last_became_active":"2023-10-14T12:18:47.512114+0000","last_became_peered":"2023-10-14T12:18:47.512114+0000","last_unstale":"2023-10-14T12:18:49.769286+0000","last_undegraded":"2023-10-14T12:18:49.769286+0000","last_fullsized":"2023-10-14T12:18:49.769286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444132+0000","last_change":"2023-10-14T12:18:46.493265+0000","last_active":"2023-10-14T12:18:49.444132+0000","last_peered":"2023-10-14T12:18:49.444132+0000","last_clean":"2023-10-14T12:18:49.444132+0000","last_became_active":"2023-10-14T12:18:46.493012+0000","last_became_peered":"2023-10-14T12:18:46.493012+0000","last_unstale":"2023-10-14T12:18:49.444132+0000","last_undegraded":"2023-10-14T12:18:49.444132+0000","last_fullsized":"2023-10-14T12:18:49.444132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353166+0000","last_change":"2023-10-14T12:18:47.510386+0000","last_active":"2023-10-14T12:18:50.353166+0000","last_peered":"2023-10-14T12:18:50.353166+0000","last_clean":"2023-10-14T12:18:50.353166+0000","last_became_active":"2023-10-14T12:18:47.510098+0000","last_became_peered":"2023-10-14T12:18:47.510098+0000","last_unstale":"2023-10-14T12:18:50.353166+0000","last_undegraded":"2023-10-14T12:18:50.353166+0000","last_fullsized":"2023-10-14T12:18:50.353166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:30.575773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.244932+0000","last_change":"2023-10-14T12:18:46.490324+0000","last_active":"2023-10-14T12:18:50.244932+0000","last_peered":"2023-10-14T12:18:50.244932+0000","last_clean":"2023-10-14T12:18:50.244932+0000","last_became_active":"2023-10-14T12:18:46.489914+0000","last_became_peered":"2023-10-14T12:18:46.489914+0000","last_unstale":"2023-10-14T12:18:50.244932+0000","last_undegraded":"2023-10-14T12:18:50.244932+0000","last_fullsized":"2023-10-14T12:18:50.244932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352280+0000","last_change":"2023-10-14T12:18:47.511080+0000","last_active":"2023-10-14T12:18:50.352280+0000","last_peered":"2023-10-14T12:18:50.352280+0000","last_clean":"2023-10-14T12:18:50.352280+0000","last_became_active":"2023-10-14T12:18:47.510729+0000","last_became_peered":"2023-10-14T12:18:47.510729+0000","last_unstale":"2023-10-14T12:18:50.352280+0000","last_undegraded":"2023-10-14T12:18:50.352280+0000","last_fullsized":"2023-10-14T12:18:50.352280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:44.510905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501219+0000","last_change":"2023-10-14T12:18:46.492854+0000","last_active":"2023-10-14T12:18:48.501219+0000","last_peered":"2023-10-14T12:18:48.501219+0000","last_clean":"2023-10-14T12:18:48.501219+0000","last_became_active":"2023-10-14T12:18:46.492536+0000","last_became_peered":"2023-10-14T12:18:46.492536+0000","last_unstale":"2023-10-14T12:18:48.501219+0000","last_undegraded":"2023-10-14T12:18:48.501219+0000","last_fullsized":"2023-10-14T12:18:48.501219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353155+0000","last_change":"2023-10-14T12:18:47.513637+0000","last_active":"2023-10-14T12:18:50.353155+0000","last_peered":"2023-10-14T12:18:50.353155+0000","last_clean":"2023-10-14T12:18:50.353155+0000","last_became_active":"2023-10-14T12:18:47.513263+0000","last_became_peered":"2023-10-14T12:18:47.513263+0000","last_unstale":"2023-10-14T12:18:50.353155+0000","last_undegraded":"2023-10-14T12:18:50.353155+0000","last_fullsized":"2023-10-14T12:18:50.353155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:20.704090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443932+0000","last_change":"2023-10-14T12:18:46.495076+0000","last_active":"2023-10-14T12:18:49.443932+0000","last_peered":"2023-10-14T12:18:49.443932+0000","last_clean":"2023-10-14T12:18:49.443932+0000","last_became_active":"2023-10-14T12:18:46.494780+0000","last_became_peered":"2023-10-14T12:18:46.494780+0000","last_unstale":"2023-10-14T12:18:49.443932+0000","last_undegraded":"2023-10-14T12:18:49.443932+0000","last_fullsized":"2023-10-14T12:18:49.443932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444027+0000","last_change":"2023-10-14T12:18:47.506950+0000","last_active":"2023-10-14T12:18:49.444027+0000","last_peered":"2023-10-14T12:18:49.444027+0000","last_clean":"2023-10-14T12:18:49.444027+0000","last_became_active":"2023-10-14T12:18:47.506480+0000","last_became_peered":"2023-10-14T12:18:47.506480+0000","last_unstale":"2023-10-14T12:18:49.444027+0000","last_undegraded":"2023-10-14T12:18:49.444027+0000","last_fullsized":"2023-10-14T12:18:49.444027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499104+0000","last_change":"2023-10-14T12:18:46.486865+0000","last_active":"2023-10-14T12:18:48.499104+0000","last_peered":"2023-10-14T12:18:48.499104+0000","last_clean":"2023-10-14T12:18:48.499104+0000","last_became_active":"2023-10-14T12:18:46.486537+0000","last_became_peered":"2023-10-14T12:18:46.486537+0000","last_unstale":"2023-10-14T12:18:48.499104+0000","last_undegraded":"2023-10-14T12:18:48.499104+0000","last_fullsized":"2023-10-14T12:18:48.499104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:59.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352872+0000","last_change":"2023-10-14T12:18:47.511494+0000","last_active":"2023-10-14T12:18:50.352872+0000","last_peered":"2023-10-14T12:18:50.352872+0000","last_clean":"2023-10-14T12:18:50.352872+0000","last_became_active":"2023-10-14T12:18:47.511109+0000","last_became_peered":"2023-10-14T12:18:47.511109+0000","last_unstale":"2023-10-14T12:18:50.352872+0000","last_undegraded":"2023-10-14T12:18:50.352872+0000","last_fullsized":"2023-10-14T12:18:50.352872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769115+0000","last_change":"2023-10-14T12:18:46.488089+0000","last_active":"2023-10-14T12:18:49.769115+0000","last_peered":"2023-10-14T12:18:49.769115+0000","last_clean":"2023-10-14T12:18:49.769115+0000","last_became_active":"2023-10-14T12:18:46.487778+0000","last_became_peered":"2023-10-14T12:18:46.487778+0000","last_unstale":"2023-10-14T12:18:49.769115+0000","last_undegraded":"2023-10-14T12:18:49.769115+0000","last_fullsized":"2023-10-14T12:18:49.769115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:51:57.421458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353136+0000","last_change":"2023-10-14T12:18:47.508911+0000","last_active":"2023-10-14T12:18:50.353136+0000","last_peered":"2023-10-14T12:18:50.353136+0000","last_clean":"2023-10-14T12:18:50.353136+0000","last_became_active":"2023-10-14T12:18:47.508621+0000","last_became_peered":"2023-10-14T12:18:47.508621+0000","last_unstale":"2023-10-14T12:18:50.353136+0000","last_undegraded":"2023-10-14T12:18:50.353136+0000","last_fullsized":"2023-10-14T12:18:50.353136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:18.615845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651805+0000","last_change":"2023-10-14T12:18:46.488275+0000","last_active":"2023-10-14T12:18:48.651805+0000","last_peered":"2023-10-14T12:18:48.651805+0000","last_clean":"2023-10-14T12:18:48.651805+0000","last_became_active":"2023-10-14T12:18:46.487981+0000","last_became_peered":"2023-10-14T12:18:46.487981+0000","last_unstale":"2023-10-14T12:18:48.651805+0000","last_undegraded":"2023-10-14T12:18:48.651805+0000","last_fullsized":"2023-10-14T12:18:48.651805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501360+0000","last_change":"2023-10-14T12:18:47.512865+0000","last_active":"2023-10-14T12:18:48.501360+0000","last_peered":"2023-10-14T12:18:48.501360+0000","last_clean":"2023-10-14T12:18:48.501360+0000","last_became_active":"2023-10-14T12:18:47.512117+0000","last_became_peered":"2023-10-14T12:18:47.512117+0000","last_unstale":"2023-10-14T12:18:48.501360+0000","last_undegraded":"2023-10-14T12:18:48.501360+0000","last_fullsized":"2023-10-14T12:18:48.501360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:20.704090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501126+0000","last_change":"2023-10-14T12:18:46.488158+0000","last_active":"2023-10-14T12:18:48.501126+0000","last_peered":"2023-10-14T12:18:48.501126+0000","last_clean":"2023-10-14T12:18:48.501126+0000","last_became_active":"2023-10-14T12:18:46.487808+0000","last_became_peered":"2023-10-14T12:18:46.487808+0000","last_unstale":"2023-10-14T12:18:48.501126+0000","last_undegraded":"2023-10-14T12:18:48.501126+0000","last_fullsized":"2023-10-14T12:18:48.501126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769274+0000","last_change":"2023-10-14T12:18:47.506873+0000","last_active":"2023-10-14T12:18:49.769274+0000","last_peered":"2023-10-14T12:18:49.769274+0000","last_clean":"2023-10-14T12:18:49.769274+0000","last_became_active":"2023-10-14T12:18:47.506563+0000","last_became_peered":"2023-10-14T12:18:47.506563+0000","last_unstale":"2023-10-14T12:18:49.769274+0000","last_undegraded":"2023-10-14T12:18:49.769274+0000","last_fullsized":"2023-10-14T12:18:49.769274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651592+0000","last_change":"2023-10-14T12:18:47.494275+0000","last_active":"2023-10-14T12:18:48.651592+0000","last_peered":"2023-10-14T12:18:48.651592+0000","last_clean":"2023-10-14T12:18:48.651592+0000","last_became_active":"2023-10-14T12:18:47.493948+0000","last_became_peered":"2023-10-14T12:18:47.493948+0000","last_unstale":"2023-10-14T12:18:48.651592+0000","last_undegraded":"2023-10-14T12:18:48.651592+0000","last_fullsized":"2023-10-14T12:18:48.651592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499214+0000","last_change":"2023-10-14T12:18:46.485430+0000","last_active":"2023-10-14T12:18:48.499214+0000","last_peered":"2023-10-14T12:18:48.499214+0000","last_clean":"2023-10-14T12:18:48.499214+0000","last_became_active":"2023-10-14T12:18:46.485097+0000","last_became_peered":"2023-10-14T12:18:46.485097+0000","last_unstale":"2023-10-14T12:18:48.499214+0000","last_undegraded":"2023-10-14T12:18:48.499214+0000","last_fullsized":"2023-10-14T12:18:48.499214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:35.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500519+0000","last_change":"2023-10-14T12:18:47.520808+0000","last_active":"2023-10-14T12:18:48.500519+0000","last_peered":"2023-10-14T12:18:48.500519+0000","last_clean":"2023-10-14T12:18:48.500519+0000","last_became_active":"2023-10-14T12:18:47.520421+0000","last_became_peered":"2023-10-14T12:18:47.520421+0000","last_unstale":"2023-10-14T12:18:48.500519+0000","last_undegraded":"2023-10-14T12:18:48.500519+0000","last_fullsized":"2023-10-14T12:18:48.500519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500975+0000","last_change":"2023-10-14T12:18:46.487688+0000","last_active":"2023-10-14T12:18:48.500975+0000","last_peered":"2023-10-14T12:18:48.500975+0000","last_clean":"2023-10-14T12:18:48.500975+0000","last_became_active":"2023-10-14T12:18:46.487378+0000","last_became_peered":"2023-10-14T12:18:46.487378+0000","last_unstale":"2023-10-14T12:18:48.500975+0000","last_undegraded":"2023-10-14T12:18:48.500975+0000","last_fullsized":"2023-10-14T12:18:48.500975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.494920+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:18:47.494920+0000","last_peered":"2023-10-14T12:18:47.494920+0000","last_clean":"2023-10-14T12:18:47.494920+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:18:47.494920+0000","last_undegraded":"2023-10-14T12:18:47.494920+0000","last_fullsized":"2023-10-14T12:18:47.494920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352259+0000","last_change":"2023-10-14T12:18:47.508543+0000","last_active":"2023-10-14T12:18:50.352259+0000","last_peered":"2023-10-14T12:18:50.352259+0000","last_clean":"2023-10-14T12:18:50.352259+0000","last_became_active":"2023-10-14T12:18:47.508263+0000","last_became_peered":"2023-10-14T12:18:47.508263+0000","last_unstale":"2023-10-14T12:18:50.352259+0000","last_undegraded":"2023-10-14T12:18:50.352259+0000","last_fullsized":"2023-10-14T12:18:50.352259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:05.917740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168717+0000","last_change":"2023-10-14T12:18:46.489896+0000","last_active":"2023-10-14T12:18:50.168717+0000","last_peered":"2023-10-14T12:18:50.168717+0000","last_clean":"2023-10-14T12:18:50.168717+0000","last_became_active":"2023-10-14T12:18:46.489571+0000","last_became_peered":"2023-10-14T12:18:46.489571+0000","last_unstale":"2023-10-14T12:18:50.168717+0000","last_undegraded":"2023-10-14T12:18:50.168717+0000","last_fullsized":"2023-10-14T12:18:50.168717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168987+0000","last_change":"2023-10-14T12:18:46.490891+0000","last_active":"2023-10-14T12:18:50.168987+0000","last_peered":"2023-10-14T12:18:50.168987+0000","last_clean":"2023-10-14T12:18:50.168987+0000","last_became_active":"2023-10-14T12:18:46.490638+0000","last_became_peered":"2023-10-14T12:18:46.490638+0000","last_unstale":"2023-10-14T12:18:50.168987+0000","last_undegraded":"2023-10-14T12:18:50.168987+0000","last_fullsized":"2023-10-14T12:18:50.168987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651814+0000","last_change":"2023-10-14T12:18:47.494381+0000","last_active":"2023-10-14T12:18:48.651814+0000","last_peered":"2023-10-14T12:18:48.651814+0000","last_clean":"2023-10-14T12:18:48.651814+0000","last_became_active":"2023-10-14T12:18:47.493740+0000","last_became_peered":"2023-10-14T12:18:47.493740+0000","last_unstale":"2023-10-14T12:18:48.651814+0000","last_undegraded":"2023-10-14T12:18:48.651814+0000","last_fullsized":"2023-10-14T12:18:48.651814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168766+0000","last_change":"2023-10-14T12:18:46.492626+0000","last_active":"2023-10-14T12:18:50.168766+0000","last_peered":"2023-10-14T12:18:50.168766+0000","last_clean":"2023-10-14T12:18:50.168766+0000","last_became_active":"2023-10-14T12:18:46.492238+0000","last_became_peered":"2023-10-14T12:18:46.492238+0000","last_unstale":"2023-10-14T12:18:50.168766+0000","last_undegraded":"2023-10-14T12:18:50.168766+0000","last_fullsized":"2023-10-14T12:18:50.168766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500978+0000","last_change":"2023-10-14T12:18:47.505508+0000","last_active":"2023-10-14T12:18:48.500978+0000","last_peered":"2023-10-14T12:18:48.500978+0000","last_clean":"2023-10-14T12:18:48.500978+0000","last_became_active":"2023-10-14T12:18:47.505204+0000","last_became_peered":"2023-10-14T12:18:47.505204+0000","last_unstale":"2023-10-14T12:18:48.500978+0000","last_undegraded":"2023-10-14T12:18:48.500978+0000","last_fullsized":"2023-10-14T12:18:48.500978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444144+0000","last_change":"2023-10-14T12:18:46.489860+0000","last_active":"2023-10-14T12:18:49.444144+0000","last_peered":"2023-10-14T12:18:49.444144+0000","last_clean":"2023-10-14T12:18:49.444144+0000","last_became_active":"2023-10-14T12:18:46.489554+0000","last_became_peered":"2023-10-14T12:18:46.489554+0000","last_unstale":"2023-10-14T12:18:49.444144+0000","last_undegraded":"2023-10-14T12:18:49.444144+0000","last_fullsized":"2023-10-14T12:18:49.444144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352643+0000","last_change":"2023-10-14T12:18:47.501705+0000","last_active":"2023-10-14T12:18:50.352643+0000","last_peered":"2023-10-14T12:18:50.352643+0000","last_clean":"2023-10-14T12:18:50.352643+0000","last_became_active":"2023-10-14T12:18:47.499259+0000","last_became_peered":"2023-10-14T12:18:47.499259+0000","last_unstale":"2023-10-14T12:18:50.352643+0000","last_undegraded":"2023-10-14T12:18:50.352643+0000","last_fullsized":"2023-10-14T12:18:50.352643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168657+0000","last_change":"2023-10-14T12:18:46.489770+0000","last_active":"2023-10-14T12:18:50.168657+0000","last_peered":"2023-10-14T12:18:50.168657+0000","last_clean":"2023-10-14T12:18:50.168657+0000","last_became_active":"2023-10-14T12:18:46.489289+0000","last_became_peered":"2023-10-14T12:18:46.489289+0000","last_unstale":"2023-10-14T12:18:50.168657+0000","last_undegraded":"2023-10-14T12:18:50.168657+0000","last_fullsized":"2023-10-14T12:18:50.168657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769054+0000","last_change":"2023-10-14T12:18:47.506908+0000","last_active":"2023-10-14T12:18:49.769054+0000","last_peered":"2023-10-14T12:18:49.769054+0000","last_clean":"2023-10-14T12:18:49.769054+0000","last_became_active":"2023-10-14T12:18:47.506651+0000","last_became_peered":"2023-10-14T12:18:47.506651+0000","last_unstale":"2023-10-14T12:18:49.769054+0000","last_undegraded":"2023-10-14T12:18:49.769054+0000","last_fullsized":"2023-10-14T12:18:49.769054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651573+0000","last_change":"2023-10-14T12:18:46.491315+0000","last_active":"2023-10-14T12:18:48.651573+0000","last_peered":"2023-10-14T12:18:48.651573+0000","last_clean":"2023-10-14T12:18:48.651573+0000","last_became_active":"2023-10-14T12:18:46.490992+0000","last_became_peered":"2023-10-14T12:18:46.490992+0000","last_unstale":"2023-10-14T12:18:48.651573+0000","last_undegraded":"2023-10-14T12:18:48.651573+0000","last_fullsized":"2023-10-14T12:18:48.651573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:39.561079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.496045+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.495676+0000","last_became_peered":"2023-10-14T12:18:47.495676+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651651+0000","last_change":"2023-10-14T12:18:46.493273+0000","last_active":"2023-10-14T12:18:48.651651+0000","last_peered":"2023-10-14T12:18:48.651651+0000","last_clean":"2023-10-14T12:18:48.651651+0000","last_became_active":"2023-10-14T12:18:46.492945+0000","last_became_peered":"2023-10-14T12:18:46.492945+0000","last_unstale":"2023-10-14T12:18:48.651651+0000","last_undegraded":"2023-10-14T12:18:48.651651+0000","last_fullsized":"2023-10-14T12:18:48.651651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500822+0000","last_change":"2023-10-14T12:18:47.504495+0000","last_active":"2023-10-14T12:18:48.500822+0000","last_peered":"2023-10-14T12:18:48.500822+0000","last_clean":"2023-10-14T12:18:48.500822+0000","last_became_active":"2023-10-14T12:18:47.504117+0000","last_became_peered":"2023-10-14T12:18:47.504117+0000","last_unstale":"2023-10-14T12:18:48.500822+0000","last_undegraded":"2023-10-14T12:18:48.500822+0000","last_fullsized":"2023-10-14T12:18:48.500822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168843+0000","last_change":"2023-10-14T12:18:46.489933+0000","last_active":"2023-10-14T12:18:50.168843+0000","last_peered":"2023-10-14T12:18:50.168843+0000","last_clean":"2023-10-14T12:18:50.168843+0000","last_became_active":"2023-10-14T12:18:46.489656+0000","last_became_peered":"2023-10-14T12:18:46.489656+0000","last_unstale":"2023-10-14T12:18:50.168843+0000","last_undegraded":"2023-10-14T12:18:50.168843+0000","last_fullsized":"2023-10-14T12:18:50.168843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444202+0000","last_change":"2023-10-14T12:18:47.510691+0000","last_active":"2023-10-14T12:18:49.444202+0000","last_peered":"2023-10-14T12:18:49.444202+0000","last_clean":"2023-10-14T12:18:49.444202+0000","last_became_active":"2023-10-14T12:18:47.510404+0000","last_became_peered":"2023-10-14T12:18:47.510404+0000","last_unstale":"2023-10-14T12:18:49.444202+0000","last_undegraded":"2023-10-14T12:18:49.444202+0000","last_fullsized":"2023-10-14T12:18:49.444202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499536+0000","last_change":"2023-10-14T12:18:46.480875+0000","last_active":"2023-10-14T12:18:48.499536+0000","last_peered":"2023-10-14T12:18:48.499536+0000","last_clean":"2023-10-14T12:18:48.499536+0000","last_became_active":"2023-10-14T12:18:46.480351+0000","last_became_peered":"2023-10-14T12:18:46.480351+0000","last_unstale":"2023-10-14T12:18:48.499536+0000","last_undegraded":"2023-10-14T12:18:48.499536+0000","last_fullsized":"2023-10-14T12:18:48.499536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353141+0000","last_change":"2023-10-14T12:18:47.513547+0000","last_active":"2023-10-14T12:18:50.353141+0000","last_peered":"2023-10-14T12:18:50.353141+0000","last_clean":"2023-10-14T12:18:50.353141+0000","last_became_active":"2023-10-14T12:18:47.513269+0000","last_became_peered":"2023-10-14T12:18:47.513269+0000","last_unstale":"2023-10-14T12:18:50.353141+0000","last_undegraded":"2023-10-14T12:18:50.353141+0000","last_fullsized":"2023-10-14T12:18:50.353141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:47.569087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651762+0000","last_change":"2023-10-14T12:18:46.489993+0000","last_active":"2023-10-14T12:18:48.651762+0000","last_peered":"2023-10-14T12:18:48.651762+0000","last_clean":"2023-10-14T12:18:48.651762+0000","last_became_active":"2023-10-14T12:18:46.489684+0000","last_became_peered":"2023-10-14T12:18:46.489684+0000","last_unstale":"2023-10-14T12:18:48.651762+0000","last_undegraded":"2023-10-14T12:18:48.651762+0000","last_fullsized":"2023-10-14T12:18:48.651762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501154+0000","last_change":"2023-10-14T12:18:47.503531+0000","last_active":"2023-10-14T12:18:48.501154+0000","last_peered":"2023-10-14T12:18:48.501154+0000","last_clean":"2023-10-14T12:18:48.501154+0000","last_became_active":"2023-10-14T12:18:47.503243+0000","last_became_peered":"2023-10-14T12:18:47.503243+0000","last_unstale":"2023-10-14T12:18:48.501154+0000","last_undegraded":"2023-10-14T12:18:48.501154+0000","last_fullsized":"2023-10-14T12:18:48.501154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:18.615845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499451+0000","last_change":"2023-10-14T12:18:46.488590+0000","last_active":"2023-10-14T12:18:48.499451+0000","last_peered":"2023-10-14T12:18:48.499451+0000","last_clean":"2023-10-14T12:18:48.499451+0000","last_became_active":"2023-10-14T12:18:46.487442+0000","last_became_peered":"2023-10-14T12:18:46.487442+0000","last_unstale":"2023-10-14T12:18:48.499451+0000","last_undegraded":"2023-10-14T12:18:48.499451+0000","last_fullsized":"2023-10-14T12:18:48.499451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353411+0000","last_change":"2023-10-14T12:18:47.510800+0000","last_active":"2023-10-14T12:18:50.353411+0000","last_peered":"2023-10-14T12:18:50.353411+0000","last_clean":"2023-10-14T12:18:50.353411+0000","last_became_active":"2023-10-14T12:18:47.510526+0000","last_became_peered":"2023-10-14T12:18:47.510526+0000","last_unstale":"2023-10-14T12:18:50.353411+0000","last_undegraded":"2023-10-14T12:18:50.353411+0000","last_fullsized":"2023-10-14T12:18:50.353411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:47.215959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443979+0000","last_change":"2023-10-14T12:18:47.506751+0000","last_active":"2023-10-14T12:18:49.443979+0000","last_peered":"2023-10-14T12:18:49.443979+0000","last_clean":"2023-10-14T12:18:49.443979+0000","last_became_active":"2023-10-14T12:18:47.506062+0000","last_became_peered":"2023-10-14T12:18:47.506062+0000","last_unstale":"2023-10-14T12:18:49.443979+0000","last_undegraded":"2023-10-14T12:18:49.443979+0000","last_fullsized":"2023-10-14T12:18:49.443979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499359+0000","last_change":"2023-10-14T12:18:47.512676+0000","last_active":"2023-10-14T12:18:48.499359+0000","last_peered":"2023-10-14T12:18:48.499359+0000","last_clean":"2023-10-14T12:18:48.499359+0000","last_became_active":"2023-10-14T12:18:47.512314+0000","last_became_peered":"2023-10-14T12:18:47.512314+0000","last_unstale":"2023-10-14T12:18:48.499359+0000","last_undegraded":"2023-10-14T12:18:48.499359+0000","last_fullsized":"2023-10-14T12:18:48.499359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501459+0000","last_change":"2023-10-14T12:18:47.517326+0000","last_active":"2023-10-14T12:18:48.501459+0000","last_peered":"2023-10-14T12:18:48.501459+0000","last_clean":"2023-10-14T12:18:48.501459+0000","last_became_active":"2023-10-14T12:18:47.512255+0000","last_became_peered":"2023-10-14T12:18:47.512255+0000","last_unstale":"2023-10-14T12:18:48.501459+0000","last_undegraded":"2023-10-14T12:18:48.501459+0000","last_fullsized":"2023-10-14T12:18:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:10.981380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352599+0000","last_change":"2023-10-14T12:18:47.501741+0000","last_active":"2023-10-14T12:18:50.352599+0000","last_peered":"2023-10-14T12:18:50.352599+0000","last_clean":"2023-10-14T12:18:50.352599+0000","last_became_active":"2023-10-14T12:18:47.501392+0000","last_became_peered":"2023-10-14T12:18:47.501392+0000","last_unstale":"2023-10-14T12:18:50.352599+0000","last_undegraded":"2023-10-14T12:18:50.352599+0000","last_fullsized":"2023-10-14T12:18:50.352599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500920+0000","last_change":"2023-10-14T12:18:47.510665+0000","last_active":"2023-10-14T12:18:48.500920+0000","last_peered":"2023-10-14T12:18:48.500920+0000","last_clean":"2023-10-14T12:18:48.500920+0000","last_became_active":"2023-10-14T12:18:47.510347+0000","last_became_peered":"2023-10-14T12:18:47.510347+0000","last_unstale":"2023-10-14T12:18:48.500920+0000","last_undegraded":"2023-10-14T12:18:48.500920+0000","last_fullsized":"2023-10-14T12:18:48.500920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651786+0000","last_change":"2023-10-14T12:18:47.497457+0000","last_active":"2023-10-14T12:18:48.651786+0000","last_peered":"2023-10-14T12:18:48.651786+0000","last_clean":"2023-10-14T12:18:48.651786+0000","last_became_active":"2023-10-14T12:18:47.497154+0000","last_became_peered":"2023-10-14T12:18:47.497154+0000","last_unstale":"2023-10-14T12:18:48.651786+0000","last_undegraded":"2023-10-14T12:18:48.651786+0000","last_fullsized":"2023-10-14T12:18:48.651786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444383+0000","last_change":"2023-10-14T12:18:47.509170+0000","last_active":"2023-10-14T12:18:49.444383+0000","last_peered":"2023-10-14T12:18:49.444383+0000","last_clean":"2023-10-14T12:18:49.444383+0000","last_became_active":"2023-10-14T12:18:47.508882+0000","last_became_peered":"2023-10-14T12:18:47.508882+0000","last_unstale":"2023-10-14T12:18:49.444383+0000","last_undegraded":"2023-10-14T12:18:49.444383+0000","last_fullsized":"2023-10-14T12:18:49.444383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500863+0000","last_change":"2023-10-14T12:18:47.505965+0000","last_active":"2023-10-14T12:18:48.500863+0000","last_peered":"2023-10-14T12:18:48.500863+0000","last_clean":"2023-10-14T12:18:48.500863+0000","last_became_active":"2023-10-14T12:18:47.505663+0000","last_became_peered":"2023-10-14T12:18:47.505663+0000","last_unstale":"2023-10-14T12:18:48.500863+0000","last_undegraded":"2023-10-14T12:18:48.500863+0000","last_fullsized":"2023-10-14T12:18:48.500863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500816+0000","last_change":"2023-10-14T12:18:47.503352+0000","last_active":"2023-10-14T12:18:48.500816+0000","last_peered":"2023-10-14T12:18:48.500816+0000","last_clean":"2023-10-14T12:18:48.500816+0000","last_became_active":"2023-10-14T12:18:47.502998+0000","last_became_peered":"2023-10-14T12:18:47.502998+0000","last_unstale":"2023-10-14T12:18:48.500816+0000","last_undegraded":"2023-10-14T12:18:48.500816+0000","last_fullsized":"2023-10-14T12:18:48.500816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.509290+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.508938+0000","last_became_peered":"2023-10-14T12:18:47.508938+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501012+0000","last_change":"2023-10-14T12:18:47.517756+0000","last_active":"2023-10-14T12:18:48.501012+0000","last_peered":"2023-10-14T12:18:48.501012+0000","last_clean":"2023-10-14T12:18:48.501012+0000","last_became_active":"2023-10-14T12:18:47.516277+0000","last_became_peered":"2023-10-14T12:18:47.516277+0000","last_unstale":"2023-10-14T12:18:48.501012+0000","last_undegraded":"2023-10-14T12:18:48.501012+0000","last_fullsized":"2023-10-14T12:18:48.501012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352466+0000","last_change":"2023-10-14T12:18:47.518451+0000","last_active":"2023-10-14T12:18:50.352466+0000","last_peered":"2023-10-14T12:18:50.352466+0000","last_clean":"2023-10-14T12:18:50.352466+0000","last_became_active":"2023-10-14T12:18:47.518127+0000","last_became_peered":"2023-10-14T12:18:47.518127+0000","last_unstale":"2023-10-14T12:18:50.352466+0000","last_undegraded":"2023-10-14T12:18:50.352466+0000","last_fullsized":"2023-10-14T12:18:50.352466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:05.100753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444296+0000","last_change":"2023-10-14T12:18:47.510708+0000","last_active":"2023-10-14T12:18:49.444296+0000","last_peered":"2023-10-14T12:18:49.444296+0000","last_clean":"2023-10-14T12:18:49.444296+0000","last_became_active":"2023-10-14T12:18:47.510385+0000","last_became_peered":"2023-10-14T12:18:47.510385+0000","last_unstale":"2023-10-14T12:18:49.444296+0000","last_undegraded":"2023-10-14T12:18:49.444296+0000","last_fullsized":"2023-10-14T12:18:49.444296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:18:56.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:18:56.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.657+0000 7f59fb3c1700 1 Processor -- start 2023-10-14T12:18:56.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.657+0000 7f59fb3c1700 1 -- start start 2023-10-14T12:18:56.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59fb3c1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f59f415ab10 0x7f59f415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59fb3c1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f59f40b1f50 0x7f59f40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59fb3c1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f415e7a0 con 0x7f59f40b2400 2023-10-14T12:18:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59fb3c1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f415f730 con 0x7f59f415ab10 2023-10-14T12:18:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59fb3c1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40b29a0 con 0x7f59f40b1f50 2023-10-14T12:18:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f59f415ab10 0x7f59f415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f59f415ab10 0x7f59f415f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38454/0 (socket says 172.21.15.32:38454) 2023-10-14T12:18:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 -- 172.21.15.32:0/1963363991 learned_addr learned my addr 172.21.15.32:0/1963363991 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f895c700 1 --2- 172.21.15.32:0/1963363991 >> v2:172.21.15.92:3300/0 conn(0x7f59f40b1f50 0x7f59f40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 -- 172.21.15.32:0/1963363991 >> v2:172.21.15.92:3300/0 conn(0x7f59f40b1f50 msgr2=0x7f59f40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 --2- 172.21.15.32:0/1963363991 >> v2:172.21.15.92:3300/0 conn(0x7f59f40b1f50 0x7f59f40cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 -- 172.21.15.32:0/1963363991 >> v1:172.21.15.92:6789/0 conn(0x7f59f40b2400 legacy=0x7f59f40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.658+0000 7f59f915d700 1 -- 172.21.15.32:0/1963363991 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40b2c80 con 0x7f59f415ab10 2023-10-14T12:18:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59f915d700 1 --2- 172.21.15.32:0/1963363991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f415f1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f59f406d470 tx=0x7f59e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39011f540d8e8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59ebfff700 1 -- 172.21.15.32:0/1963363991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4004230 con 0x7f59f415ab10 2023-10-14T12:18:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59ebfff700 1 -- 172.21.15.32:0/1963363991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4004390 con 0x7f59f415ab10 2023-10-14T12:18:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59ebfff700 1 -- 172.21.15.32:0/1963363991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40036a0 con 0x7f59f415ab10 2023-10-14T12:18:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 -- 172.21.15.32:0/1963363991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 msgr2=0x7f59f415f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/1963363991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f415f1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f59f406d470 tx=0x7f59e4009bd0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 -- 172.21.15.32:0/1963363991 shutdown_connections 2023-10-14T12:18:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/1963363991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f415f1f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/1963363991 >> v2:172.21.15.92:3300/0 conn(0x7f59f40b1f50 0x7f59f40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 -- 172.21.15.32:0/1963363991 >> 172.21.15.32:0/1963363991 conn(0x7f59f406dae0 msgr2=0x7f59f406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.659+0000 7f59fb3c1700 1 -- 172.21.15.32:0/1963363991 shutdown_connections 2023-10-14T12:18:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.660+0000 7f59fb3c1700 1 -- 172.21.15.32:0/1963363991 wait complete. 2023-10-14T12:18:56.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.661+0000 7f59fb3c1700 1 Processor -- start 2023-10-14T12:18:56.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.661+0000 7f59fb3c1700 1 -- start start 2023-10-14T12:18:56.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59fb3c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59f40b1f50 0x7f59f40b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59fb3c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59f40b2400 0x7f59f414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59fb3c1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f4145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59fb3c1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f414fdb0 con 0x7f59f415ab10 2023-10-14T12:18:56.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59fb3c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f414dc80 con 0x7f59f40b2400 2023-10-14T12:18:56.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59fb3c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f414ded0 con 0x7f59f40b1f50 2023-10-14T12:18:56.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f4145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f4145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38462/0 (socket says 172.21.15.32:38462) 2023-10-14T12:18:56.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 -- 172.21.15.32:0/3161201991 learned_addr learned my addr 172.21.15.32:0/3161201991 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:56.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 -- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59f40b1f50 msgr2=0x7f59f40b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59f40b1f50 0x7f59f40b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 -- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59f40b2400 msgr2=0x7f59f414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f895c700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59f40b2400 0x7f59f414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59f40b2400 0x7f59f414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f995e700 1 -- 172.21.15.32:0/3161201991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4009550 con 0x7f59f415ab10 2023-10-14T12:18:56.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.662+0000 7f59f895c700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59f40b2400 0x7f59f414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:56.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.663+0000 7f59f995e700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f4145820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00b970 tx=0x7f59ec00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:56.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.663+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00c9b0 con 0x7f59f415ab10 2023-10-14T12:18:56.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.663+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00cb10 con 0x7f59f415ab10 2023-10-14T12:18:56.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.663+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f414e1b0 con 0x7f59f415ab10 2023-10-14T12:18:56.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.663+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec014440 con 0x7f59f415ab10 2023-10-14T12:18:56.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.663+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f414e770 con 0x7f59f415ab10 2023-10-14T12:18:56.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.664+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f414e990 con 0x7f59f415ab10 2023-10-14T12:18:56.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.664+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59ec01d3b0 con 0x7f59f415ab10 2023-10-14T12:18:56.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.665+0000 7f59e9ffb700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f59d806af00 0x7f59d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:56.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.665+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59ec0891d0 con 0x7f59f415ab10 2023-10-14T12:18:56.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.665+0000 7f59f915d700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f59d806af00 0x7f59d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:56.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.665+0000 7f59f915d700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f59d806af00 0x7f59d806d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59f40b4010 tx=0x7f59e4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:56.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.669+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59ec054310 con 0x7f59f415ab10 2023-10-14T12:18:56.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.863+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59f415ecd0 con 0x7f59d806af00 2023-10-14T12:18:56.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.871+0000 7f59e9ffb700 1 -- 172.21.15.32:0/3161201991 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264588 (secure 0 0 0) 0x7f59e401f070 con 0x7f59d806af00 2023-10-14T12:18:56.877 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f59d806af00 msgr2=0x7f59d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f59d806af00 0x7f59d806d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59f40b4010 tx=0x7f59e4010000 comp rx=0 tx=0).stop 2023-10-14T12:18:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 msgr2=0x7f59f4145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f4145820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00b970 tx=0x7f59ec00bd30 comp rx=0 tx=0).stop 2023-10-14T12:18:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 shutdown_connections 2023-10-14T12:18:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59f415ab10 0x7f59f4145820 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59f40b1f50 0x7f59f40b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f59d806af00 0x7f59d806d3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 --2- 172.21.15.32:0/3161201991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59f40b2400 0x7f59f414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 >> 172.21.15.32:0/3161201991 conn(0x7f59f406dae0 msgr2=0x7f59f40cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 shutdown_connections 2023-10-14T12:18:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:56.874+0000 7f59fb3c1700 1 -- 172.21.15.32:0/3161201991 wait complete. 2023-10-14T12:18:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:18:56.888 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T12:18:55.098270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001948"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353249+0000","last_change":"2023-10-14T12:18:47.509049+0000","last_active":"2023-10-14T12:18:50.353249+0000","last_peered":"2023-10-14T12:18:50.353249+0000","last_clean":"2023-10-14T12:18:50.353249+0000","last_became_active":"2023-10-14T12:18:47.508659+0000","last_became_peered":"2023-10-14T12:18:47.508659+0000","last_unstale":"2023-10-14T12:18:50.353249+0000","last_undegraded":"2023-10-14T12:18:50.353249+0000","last_fullsized":"2023-10-14T12:18:50.353249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:15.401442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651885+0000","last_change":"2023-10-14T12:18:47.500830+0000","last_active":"2023-10-14T12:18:48.651885+0000","last_peered":"2023-10-14T12:18:48.651885+0000","last_clean":"2023-10-14T12:18:48.651885+0000","last_became_active":"2023-10-14T12:18:47.500534+0000","last_became_peered":"2023-10-14T12:18:47.500534+0000","last_unstale":"2023-10-14T12:18:48.651885+0000","last_undegraded":"2023-10-14T12:18:48.651885+0000","last_fullsized":"2023-10-14T12:18:48.651885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352506+0000","last_change":"2023-10-14T12:18:47.502596+0000","last_active":"2023-10-14T12:18:50.352506+0000","last_peered":"2023-10-14T12:18:50.352506+0000","last_clean":"2023-10-14T12:18:50.352506+0000","last_became_active":"2023-10-14T12:18:47.502274+0000","last_became_peered":"2023-10-14T12:18:47.502274+0000","last_unstale":"2023-10-14T12:18:50.352506+0000","last_undegraded":"2023-10-14T12:18:50.352506+0000","last_fullsized":"2023-10-14T12:18:50.352506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501296+0000","last_change":"2023-10-14T12:18:47.517714+0000","last_active":"2023-10-14T12:18:48.501296+0000","last_peered":"2023-10-14T12:18:48.501296+0000","last_clean":"2023-10-14T12:18:48.501296+0000","last_became_active":"2023-10-14T12:18:47.512963+0000","last_became_peered":"2023-10-14T12:18:47.512963+0000","last_unstale":"2023-10-14T12:18:48.501296+0000","last_undegraded":"2023-10-14T12:18:48.501296+0000","last_fullsized":"2023-10-14T12:18:48.501296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:47.569087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352967+0000","last_change":"2023-10-14T12:18:47.505586+0000","last_active":"2023-10-14T12:18:50.352967+0000","last_peered":"2023-10-14T12:18:50.352967+0000","last_clean":"2023-10-14T12:18:50.352967+0000","last_became_active":"2023-10-14T12:18:47.505317+0000","last_became_peered":"2023-10-14T12:18:47.505317+0000","last_unstale":"2023-10-14T12:18:50.352967+0000","last_undegraded":"2023-10-14T12:18:50.352967+0000","last_fullsized":"2023-10-14T12:18:50.352967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501003+0000","last_change":"2023-10-14T12:18:47.518702+0000","last_active":"2023-10-14T12:18:48.501003+0000","last_peered":"2023-10-14T12:18:48.501003+0000","last_clean":"2023-10-14T12:18:48.501003+0000","last_became_active":"2023-10-14T12:18:47.512637+0000","last_became_peered":"2023-10-14T12:18:47.512637+0000","last_unstale":"2023-10-14T12:18:48.501003+0000","last_undegraded":"2023-10-14T12:18:48.501003+0000","last_fullsized":"2023-10-14T12:18:48.501003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352748+0000","last_change":"2023-10-14T12:18:47.508247+0000","last_active":"2023-10-14T12:18:50.352748+0000","last_peered":"2023-10-14T12:18:50.352748+0000","last_clean":"2023-10-14T12:18:50.352748+0000","last_became_active":"2023-10-14T12:18:47.507971+0000","last_became_peered":"2023-10-14T12:18:47.507971+0000","last_unstale":"2023-10-14T12:18:50.352748+0000","last_undegraded":"2023-10-14T12:18:50.352748+0000","last_fullsized":"2023-10-14T12:18:50.352748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500163+0000","last_change":"2023-10-14T12:18:47.512408+0000","last_active":"2023-10-14T12:18:48.500163+0000","last_peered":"2023-10-14T12:18:48.500163+0000","last_clean":"2023-10-14T12:18:48.500163+0000","last_became_active":"2023-10-14T12:18:47.512170+0000","last_became_peered":"2023-10-14T12:18:47.512170+0000","last_unstale":"2023-10-14T12:18:48.500163+0000","last_undegraded":"2023-10-14T12:18:48.500163+0000","last_fullsized":"2023-10-14T12:18:48.500163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353201+0000","last_change":"2023-10-14T12:18:47.518549+0000","last_active":"2023-10-14T12:18:50.353201+0000","last_peered":"2023-10-14T12:18:50.353201+0000","last_clean":"2023-10-14T12:18:50.353201+0000","last_became_active":"2023-10-14T12:18:47.517982+0000","last_became_peered":"2023-10-14T12:18:47.517982+0000","last_unstale":"2023-10-14T12:18:50.353201+0000","last_undegraded":"2023-10-14T12:18:50.353201+0000","last_fullsized":"2023-10-14T12:18:50.353201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:10.981380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444405+0000","last_change":"2023-10-14T12:18:47.512949+0000","last_active":"2023-10-14T12:18:49.444405+0000","last_peered":"2023-10-14T12:18:49.444405+0000","last_clean":"2023-10-14T12:18:49.444405+0000","last_became_active":"2023-10-14T12:18:47.512703+0000","last_became_peered":"2023-10-14T12:18:47.512703+0000","last_unstale":"2023-10-14T12:18:49.444405+0000","last_undegraded":"2023-10-14T12:18:49.444405+0000","last_fullsized":"2023-10-14T12:18:49.444405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444355+0000","last_change":"2023-10-14T12:18:47.518785+0000","last_active":"2023-10-14T12:18:49.444355+0000","last_peered":"2023-10-14T12:18:49.444355+0000","last_clean":"2023-10-14T12:18:49.444355+0000","last_became_active":"2023-10-14T12:18:47.518508+0000","last_became_peered":"2023-10-14T12:18:47.518508+0000","last_unstale":"2023-10-14T12:18:49.444355+0000","last_undegraded":"2023-10-14T12:18:49.444355+0000","last_fullsized":"2023-10-14T12:18:49.444355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769191+0000","last_change":"2023-10-14T12:18:47.504920+0000","last_active":"2023-10-14T12:18:49.769191+0000","last_peered":"2023-10-14T12:18:49.769191+0000","last_clean":"2023-10-14T12:18:49.769191+0000","last_became_active":"2023-10-14T12:18:47.504633+0000","last_became_peered":"2023-10-14T12:18:47.504633+0000","last_unstale":"2023-10-14T12:18:49.769191+0000","last_undegraded":"2023-10-14T12:18:49.769191+0000","last_fullsized":"2023-10-14T12:18:49.769191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:21:36.127575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500384+0000","last_change":"2023-10-14T12:18:47.505034+0000","last_active":"2023-10-14T12:18:48.500384+0000","last_peered":"2023-10-14T12:18:48.500384+0000","last_clean":"2023-10-14T12:18:48.500384+0000","last_became_active":"2023-10-14T12:18:47.504655+0000","last_became_peered":"2023-10-14T12:18:47.504655+0000","last_unstale":"2023-10-14T12:18:48.500384+0000","last_undegraded":"2023-10-14T12:18:48.500384+0000","last_fullsized":"2023-10-14T12:18:48.500384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352363+0000","last_change":"2023-10-14T12:18:47.499576+0000","last_active":"2023-10-14T12:18:50.352363+0000","last_peered":"2023-10-14T12:18:50.352363+0000","last_clean":"2023-10-14T12:18:50.352363+0000","last_became_active":"2023-10-14T12:18:47.499249+0000","last_became_peered":"2023-10-14T12:18:47.499249+0000","last_unstale":"2023-10-14T12:18:50.352363+0000","last_undegraded":"2023-10-14T12:18:50.352363+0000","last_fullsized":"2023-10-14T12:18:50.352363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:40.565801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651648+0000","last_change":"2023-10-14T12:18:47.508453+0000","last_active":"2023-10-14T12:18:48.651648+0000","last_peered":"2023-10-14T12:18:48.651648+0000","last_clean":"2023-10-14T12:18:48.651648+0000","last_became_active":"2023-10-14T12:18:47.508081+0000","last_became_peered":"2023-10-14T12:18:47.508081+0000","last_unstale":"2023-10-14T12:18:48.651648+0000","last_undegraded":"2023-10-14T12:18:48.651648+0000","last_fullsized":"2023-10-14T12:18:48.651648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500721+0000","last_change":"2023-10-14T12:18:47.505739+0000","last_active":"2023-10-14T12:18:48.500721+0000","last_peered":"2023-10-14T12:18:48.500721+0000","last_clean":"2023-10-14T12:18:48.500721+0000","last_became_active":"2023-10-14T12:18:47.505456+0000","last_became_peered":"2023-10-14T12:18:47.505456+0000","last_unstale":"2023-10-14T12:18:48.500721+0000","last_undegraded":"2023-10-14T12:18:48.500721+0000","last_fullsized":"2023-10-14T12:18:48.500721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501605+0000","last_change":"2023-10-14T12:18:47.516673+0000","last_active":"2023-10-14T12:18:48.501605+0000","last_peered":"2023-10-14T12:18:48.501605+0000","last_clean":"2023-10-14T12:18:48.501605+0000","last_became_active":"2023-10-14T12:18:47.516312+0000","last_became_peered":"2023-10-14T12:18:47.516312+0000","last_unstale":"2023-10-14T12:18:48.501605+0000","last_undegraded":"2023-10-14T12:18:48.501605+0000","last_fullsized":"2023-10-14T12:18:48.501605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:15.401442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499582+0000","last_change":"2023-10-14T12:18:47.505601+0000","last_active":"2023-10-14T12:18:48.499582+0000","last_peered":"2023-10-14T12:18:48.499582+0000","last_clean":"2023-10-14T12:18:48.499582+0000","last_became_active":"2023-10-14T12:18:47.505242+0000","last_became_peered":"2023-10-14T12:18:47.505242+0000","last_unstale":"2023-10-14T12:18:48.499582+0000","last_undegraded":"2023-10-14T12:18:48.499582+0000","last_fullsized":"2023-10-14T12:18:48.499582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352933+0000","last_change":"2023-10-14T12:18:47.506070+0000","last_active":"2023-10-14T12:18:50.352933+0000","last_peered":"2023-10-14T12:18:50.352933+0000","last_clean":"2023-10-14T12:18:50.352933+0000","last_became_active":"2023-10-14T12:18:47.505784+0000","last_became_peered":"2023-10-14T12:18:47.505784+0000","last_unstale":"2023-10-14T12:18:50.352933+0000","last_undegraded":"2023-10-14T12:18:50.352933+0000","last_fullsized":"2023-10-14T12:18:50.352933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.245049+0000","last_change":"2023-10-14T12:18:46.489704+0000","last_active":"2023-10-14T12:18:50.245049+0000","last_peered":"2023-10-14T12:18:50.245049+0000","last_clean":"2023-10-14T12:18:50.245049+0000","last_became_active":"2023-10-14T12:18:46.489418+0000","last_became_peered":"2023-10-14T12:18:46.489418+0000","last_unstale":"2023-10-14T12:18:50.245049+0000","last_undegraded":"2023-10-14T12:18:50.245049+0000","last_fullsized":"2023-10-14T12:18:50.245049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500871+0000","last_change":"2023-10-14T12:18:47.506025+0000","last_active":"2023-10-14T12:18:48.500871+0000","last_peered":"2023-10-14T12:18:48.500871+0000","last_clean":"2023-10-14T12:18:48.500871+0000","last_became_active":"2023-10-14T12:18:47.505700+0000","last_became_peered":"2023-10-14T12:18:47.505700+0000","last_unstale":"2023-10-14T12:18:48.500871+0000","last_undegraded":"2023-10-14T12:18:48.500871+0000","last_fullsized":"2023-10-14T12:18:48.500871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500977+0000","last_change":"2023-10-14T12:18:46.486371+0000","last_active":"2023-10-14T12:18:48.500977+0000","last_peered":"2023-10-14T12:18:48.500977+0000","last_clean":"2023-10-14T12:18:48.500977+0000","last_became_active":"2023-10-14T12:18:46.486098+0000","last_became_peered":"2023-10-14T12:18:46.486098+0000","last_unstale":"2023-10-14T12:18:48.500977+0000","last_undegraded":"2023-10-14T12:18:48.500977+0000","last_fullsized":"2023-10-14T12:18:48.500977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352475+0000","last_change":"2023-10-14T12:18:47.517540+0000","last_active":"2023-10-14T12:18:50.352475+0000","last_peered":"2023-10-14T12:18:50.352475+0000","last_clean":"2023-10-14T12:18:50.352475+0000","last_became_active":"2023-10-14T12:18:47.517283+0000","last_became_peered":"2023-10-14T12:18:47.517283+0000","last_unstale":"2023-10-14T12:18:50.352475+0000","last_undegraded":"2023-10-14T12:18:50.352475+0000","last_fullsized":"2023-10-14T12:18:50.352475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.169009+0000","last_change":"2023-10-14T12:18:46.492599+0000","last_active":"2023-10-14T12:18:50.169009+0000","last_peered":"2023-10-14T12:18:50.169009+0000","last_clean":"2023-10-14T12:18:50.169009+0000","last_became_active":"2023-10-14T12:18:46.492296+0000","last_became_peered":"2023-10-14T12:18:46.492296+0000","last_unstale":"2023-10-14T12:18:50.169009+0000","last_undegraded":"2023-10-14T12:18:50.169009+0000","last_fullsized":"2023-10-14T12:18:50.169009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501088+0000","last_change":"2023-10-14T12:18:47.517351+0000","last_active":"2023-10-14T12:18:48.501088+0000","last_peered":"2023-10-14T12:18:48.501088+0000","last_clean":"2023-10-14T12:18:48.501088+0000","last_became_active":"2023-10-14T12:18:47.516208+0000","last_became_peered":"2023-10-14T12:18:47.516208+0000","last_unstale":"2023-10-14T12:18:48.501088+0000","last_undegraded":"2023-10-14T12:18:48.501088+0000","last_fullsized":"2023-10-14T12:18:48.501088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168896+0000","last_change":"2023-10-14T12:18:46.489437+0000","last_active":"2023-10-14T12:18:50.168896+0000","last_peered":"2023-10-14T12:18:50.168896+0000","last_clean":"2023-10-14T12:18:50.168896+0000","last_became_active":"2023-10-14T12:18:46.489122+0000","last_became_peered":"2023-10-14T12:18:46.489122+0000","last_unstale":"2023-10-14T12:18:50.168896+0000","last_undegraded":"2023-10-14T12:18:50.168896+0000","last_fullsized":"2023-10-14T12:18:50.168896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501421+0000","last_change":"2023-10-14T12:18:47.512921+0000","last_active":"2023-10-14T12:18:48.501421+0000","last_peered":"2023-10-14T12:18:48.501421+0000","last_clean":"2023-10-14T12:18:48.501421+0000","last_became_active":"2023-10-14T12:18:47.512426+0000","last_became_peered":"2023-10-14T12:18:47.512426+0000","last_unstale":"2023-10-14T12:18:48.501421+0000","last_undegraded":"2023-10-14T12:18:48.501421+0000","last_fullsized":"2023-10-14T12:18:48.501421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:30.575773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500674+0000","last_change":"2023-10-14T12:18:46.489840+0000","last_active":"2023-10-14T12:18:48.500674+0000","last_peered":"2023-10-14T12:18:48.500674+0000","last_clean":"2023-10-14T12:18:48.500674+0000","last_became_active":"2023-10-14T12:18:46.489548+0000","last_became_peered":"2023-10-14T12:18:46.489548+0000","last_unstale":"2023-10-14T12:18:48.500674+0000","last_undegraded":"2023-10-14T12:18:48.500674+0000","last_fullsized":"2023-10-14T12:18:48.500674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.768871+0000","last_change":"2023-10-14T12:18:47.505062+0000","last_active":"2023-10-14T12:18:49.768871+0000","last_peered":"2023-10-14T12:18:49.768871+0000","last_clean":"2023-10-14T12:18:49.768871+0000","last_became_active":"2023-10-14T12:18:47.504744+0000","last_became_peered":"2023-10-14T12:18:47.504744+0000","last_unstale":"2023-10-14T12:18:49.768871+0000","last_undegraded":"2023-10-14T12:18:49.768871+0000","last_fullsized":"2023-10-14T12:18:49.768871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:15.039932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444107+0000","last_change":"2023-10-14T12:18:46.495580+0000","last_active":"2023-10-14T12:18:49.444107+0000","last_peered":"2023-10-14T12:18:49.444107+0000","last_clean":"2023-10-14T12:18:49.444107+0000","last_became_active":"2023-10-14T12:18:46.495262+0000","last_became_peered":"2023-10-14T12:18:46.495262+0000","last_unstale":"2023-10-14T12:18:49.444107+0000","last_undegraded":"2023-10-14T12:18:49.444107+0000","last_fullsized":"2023-10-14T12:18:49.444107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352699+0000","last_change":"2023-10-14T12:18:47.509133+0000","last_active":"2023-10-14T12:18:50.352699+0000","last_peered":"2023-10-14T12:18:50.352699+0000","last_clean":"2023-10-14T12:18:50.352699+0000","last_became_active":"2023-10-14T12:18:47.508824+0000","last_became_peered":"2023-10-14T12:18:47.508824+0000","last_unstale":"2023-10-14T12:18:50.352699+0000","last_undegraded":"2023-10-14T12:18:50.352699+0000","last_fullsized":"2023-10-14T12:18:50.352699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500305+0000","last_change":"2023-10-14T12:18:46.489498+0000","last_active":"2023-10-14T12:18:48.500305+0000","last_peered":"2023-10-14T12:18:48.500305+0000","last_clean":"2023-10-14T12:18:48.500305+0000","last_became_active":"2023-10-14T12:18:46.489134+0000","last_became_peered":"2023-10-14T12:18:46.489134+0000","last_unstale":"2023-10-14T12:18:48.500305+0000","last_undegraded":"2023-10-14T12:18:48.500305+0000","last_fullsized":"2023-10-14T12:18:48.500305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500304+0000","last_change":"2023-10-14T12:18:47.500917+0000","last_active":"2023-10-14T12:18:48.500304+0000","last_peered":"2023-10-14T12:18:48.500304+0000","last_clean":"2023-10-14T12:18:48.500304+0000","last_became_active":"2023-10-14T12:18:47.500513+0000","last_became_peered":"2023-10-14T12:18:47.500513+0000","last_unstale":"2023-10-14T12:18:48.500304+0000","last_undegraded":"2023-10-14T12:18:48.500304+0000","last_fullsized":"2023-10-14T12:18:48.500304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500764+0000","last_change":"2023-10-14T12:18:46.485701+0000","last_active":"2023-10-14T12:18:48.500764+0000","last_peered":"2023-10-14T12:18:48.500764+0000","last_clean":"2023-10-14T12:18:48.500764+0000","last_became_active":"2023-10-14T12:18:46.485368+0000","last_became_peered":"2023-10-14T12:18:46.485368+0000","last_unstale":"2023-10-14T12:18:48.500764+0000","last_undegraded":"2023-10-14T12:18:48.500764+0000","last_fullsized":"2023-10-14T12:18:48.500764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:19.585802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651760+0000","last_change":"2023-10-14T12:18:47.497548+0000","last_active":"2023-10-14T12:18:48.651760+0000","last_peered":"2023-10-14T12:18:48.651760+0000","last_clean":"2023-10-14T12:18:48.651760+0000","last_became_active":"2023-10-14T12:18:47.497227+0000","last_became_peered":"2023-10-14T12:18:47.497227+0000","last_unstale":"2023-10-14T12:18:48.651760+0000","last_undegraded":"2023-10-14T12:18:48.651760+0000","last_fullsized":"2023-10-14T12:18:48.651760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444253+0000","last_change":"2023-10-14T12:18:46.491993+0000","last_active":"2023-10-14T12:18:49.444253+0000","last_peered":"2023-10-14T12:18:49.444253+0000","last_clean":"2023-10-14T12:18:49.444253+0000","last_became_active":"2023-10-14T12:18:46.491478+0000","last_became_peered":"2023-10-14T12:18:46.491478+0000","last_unstale":"2023-10-14T12:18:49.444253+0000","last_undegraded":"2023-10-14T12:18:49.444253+0000","last_fullsized":"2023-10-14T12:18:49.444253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501636+0000","last_change":"2023-10-14T12:18:47.510673+0000","last_active":"2023-10-14T12:18:48.501636+0000","last_peered":"2023-10-14T12:18:48.501636+0000","last_clean":"2023-10-14T12:18:48.501636+0000","last_became_active":"2023-10-14T12:18:47.510382+0000","last_became_peered":"2023-10-14T12:18:47.510382+0000","last_unstale":"2023-10-14T12:18:48.501636+0000","last_undegraded":"2023-10-14T12:18:48.501636+0000","last_fullsized":"2023-10-14T12:18:48.501636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:47.215959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501549+0000","last_change":"2023-10-14T12:18:46.487677+0000","last_active":"2023-10-14T12:18:48.501549+0000","last_peered":"2023-10-14T12:18:48.501549+0000","last_clean":"2023-10-14T12:18:48.501549+0000","last_became_active":"2023-10-14T12:18:46.487359+0000","last_became_peered":"2023-10-14T12:18:46.487359+0000","last_unstale":"2023-10-14T12:18:48.501549+0000","last_undegraded":"2023-10-14T12:18:48.501549+0000","last_fullsized":"2023-10-14T12:18:48.501549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:50.124419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352655+0000","last_change":"2023-10-14T12:18:47.521313+0000","last_active":"2023-10-14T12:18:50.352655+0000","last_peered":"2023-10-14T12:18:50.352655+0000","last_clean":"2023-10-14T12:18:50.352655+0000","last_became_active":"2023-10-14T12:18:47.521124+0000","last_became_peered":"2023-10-14T12:18:47.521124+0000","last_unstale":"2023-10-14T12:18:50.352655+0000","last_undegraded":"2023-10-14T12:18:50.352655+0000","last_fullsized":"2023-10-14T12:18:50.352655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:06.964141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651865+0000","last_change":"2023-10-14T12:18:46.488148+0000","last_active":"2023-10-14T12:18:48.651865+0000","last_peered":"2023-10-14T12:18:48.651865+0000","last_clean":"2023-10-14T12:18:48.651865+0000","last_became_active":"2023-10-14T12:18:46.487791+0000","last_became_peered":"2023-10-14T12:18:46.487791+0000","last_unstale":"2023-10-14T12:18:48.651865+0000","last_undegraded":"2023-10-14T12:18:48.651865+0000","last_fullsized":"2023-10-14T12:18:48.651865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:45.664244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769286+0000","last_change":"2023-10-14T12:18:47.512765+0000","last_active":"2023-10-14T12:18:49.769286+0000","last_peered":"2023-10-14T12:18:49.769286+0000","last_clean":"2023-10-14T12:18:49.769286+0000","last_became_active":"2023-10-14T12:18:47.512114+0000","last_became_peered":"2023-10-14T12:18:47.512114+0000","last_unstale":"2023-10-14T12:18:49.769286+0000","last_undegraded":"2023-10-14T12:18:49.769286+0000","last_fullsized":"2023-10-14T12:18:49.769286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:01.362772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444132+0000","last_change":"2023-10-14T12:18:46.493265+0000","last_active":"2023-10-14T12:18:49.444132+0000","last_peered":"2023-10-14T12:18:49.444132+0000","last_clean":"2023-10-14T12:18:49.444132+0000","last_became_active":"2023-10-14T12:18:46.493012+0000","last_became_peered":"2023-10-14T12:18:46.493012+0000","last_unstale":"2023-10-14T12:18:49.444132+0000","last_undegraded":"2023-10-14T12:18:49.444132+0000","last_fullsized":"2023-10-14T12:18:49.444132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353166+0000","last_change":"2023-10-14T12:18:47.510386+0000","last_active":"2023-10-14T12:18:50.353166+0000","last_peered":"2023-10-14T12:18:50.353166+0000","last_clean":"2023-10-14T12:18:50.353166+0000","last_became_active":"2023-10-14T12:18:47.510098+0000","last_became_peered":"2023-10-14T12:18:47.510098+0000","last_unstale":"2023-10-14T12:18:50.353166+0000","last_undegraded":"2023-10-14T12:18:50.353166+0000","last_fullsized":"2023-10-14T12:18:50.353166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:30.575773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.244932+0000","last_change":"2023-10-14T12:18:46.490324+0000","last_active":"2023-10-14T12:18:50.244932+0000","last_peered":"2023-10-14T12:18:50.244932+0000","last_clean":"2023-10-14T12:18:50.244932+0000","last_became_active":"2023-10-14T12:18:46.489914+0000","last_became_peered":"2023-10-14T12:18:46.489914+0000","last_unstale":"2023-10-14T12:18:50.244932+0000","last_undegraded":"2023-10-14T12:18:50.244932+0000","last_fullsized":"2023-10-14T12:18:50.244932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:00.358050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352280+0000","last_change":"2023-10-14T12:18:47.511080+0000","last_active":"2023-10-14T12:18:50.352280+0000","last_peered":"2023-10-14T12:18:50.352280+0000","last_clean":"2023-10-14T12:18:50.352280+0000","last_became_active":"2023-10-14T12:18:47.510729+0000","last_became_peered":"2023-10-14T12:18:47.510729+0000","last_unstale":"2023-10-14T12:18:50.352280+0000","last_undegraded":"2023-10-14T12:18:50.352280+0000","last_fullsized":"2023-10-14T12:18:50.352280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:44.510905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501219+0000","last_change":"2023-10-14T12:18:46.492854+0000","last_active":"2023-10-14T12:18:48.501219+0000","last_peered":"2023-10-14T12:18:48.501219+0000","last_clean":"2023-10-14T12:18:48.501219+0000","last_became_active":"2023-10-14T12:18:46.492536+0000","last_became_peered":"2023-10-14T12:18:46.492536+0000","last_unstale":"2023-10-14T12:18:48.501219+0000","last_undegraded":"2023-10-14T12:18:48.501219+0000","last_fullsized":"2023-10-14T12:18:48.501219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:21.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353155+0000","last_change":"2023-10-14T12:18:47.513637+0000","last_active":"2023-10-14T12:18:50.353155+0000","last_peered":"2023-10-14T12:18:50.353155+0000","last_clean":"2023-10-14T12:18:50.353155+0000","last_became_active":"2023-10-14T12:18:47.513263+0000","last_became_peered":"2023-10-14T12:18:47.513263+0000","last_unstale":"2023-10-14T12:18:50.353155+0000","last_undegraded":"2023-10-14T12:18:50.353155+0000","last_fullsized":"2023-10-14T12:18:50.353155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:20.704090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443932+0000","last_change":"2023-10-14T12:18:46.495076+0000","last_active":"2023-10-14T12:18:49.443932+0000","last_peered":"2023-10-14T12:18:49.443932+0000","last_clean":"2023-10-14T12:18:49.443932+0000","last_became_active":"2023-10-14T12:18:46.494780+0000","last_became_peered":"2023-10-14T12:18:46.494780+0000","last_unstale":"2023-10-14T12:18:49.443932+0000","last_undegraded":"2023-10-14T12:18:49.443932+0000","last_fullsized":"2023-10-14T12:18:49.443932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444027+0000","last_change":"2023-10-14T12:18:47.506950+0000","last_active":"2023-10-14T12:18:49.444027+0000","last_peered":"2023-10-14T12:18:49.444027+0000","last_clean":"2023-10-14T12:18:49.444027+0000","last_became_active":"2023-10-14T12:18:47.506480+0000","last_became_peered":"2023-10-14T12:18:47.506480+0000","last_unstale":"2023-10-14T12:18:49.444027+0000","last_undegraded":"2023-10-14T12:18:49.444027+0000","last_fullsized":"2023-10-14T12:18:49.444027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:26:46.668966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499104+0000","last_change":"2023-10-14T12:18:46.486865+0000","last_active":"2023-10-14T12:18:48.499104+0000","last_peered":"2023-10-14T12:18:48.499104+0000","last_clean":"2023-10-14T12:18:48.499104+0000","last_became_active":"2023-10-14T12:18:46.486537+0000","last_became_peered":"2023-10-14T12:18:46.486537+0000","last_unstale":"2023-10-14T12:18:48.499104+0000","last_undegraded":"2023-10-14T12:18:48.499104+0000","last_fullsized":"2023-10-14T12:18:48.499104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:59.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352872+0000","last_change":"2023-10-14T12:18:47.511494+0000","last_active":"2023-10-14T12:18:50.352872+0000","last_peered":"2023-10-14T12:18:50.352872+0000","last_clean":"2023-10-14T12:18:50.352872+0000","last_became_active":"2023-10-14T12:18:47.511109+0000","last_became_peered":"2023-10-14T12:18:47.511109+0000","last_unstale":"2023-10-14T12:18:50.352872+0000","last_undegraded":"2023-10-14T12:18:50.352872+0000","last_fullsized":"2023-10-14T12:18:50.352872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:56:57.037606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769115+0000","last_change":"2023-10-14T12:18:46.488089+0000","last_active":"2023-10-14T12:18:49.769115+0000","last_peered":"2023-10-14T12:18:49.769115+0000","last_clean":"2023-10-14T12:18:49.769115+0000","last_became_active":"2023-10-14T12:18:46.487778+0000","last_became_peered":"2023-10-14T12:18:46.487778+0000","last_unstale":"2023-10-14T12:18:49.769115+0000","last_undegraded":"2023-10-14T12:18:49.769115+0000","last_fullsized":"2023-10-14T12:18:49.769115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:51:57.421458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353136+0000","last_change":"2023-10-14T12:18:47.508911+0000","last_active":"2023-10-14T12:18:50.353136+0000","last_peered":"2023-10-14T12:18:50.353136+0000","last_clean":"2023-10-14T12:18:50.353136+0000","last_became_active":"2023-10-14T12:18:47.508621+0000","last_became_peered":"2023-10-14T12:18:47.508621+0000","last_unstale":"2023-10-14T12:18:50.353136+0000","last_undegraded":"2023-10-14T12:18:50.353136+0000","last_fullsized":"2023-10-14T12:18:50.353136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:18.615845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651805+0000","last_change":"2023-10-14T12:18:46.488275+0000","last_active":"2023-10-14T12:18:48.651805+0000","last_peered":"2023-10-14T12:18:48.651805+0000","last_clean":"2023-10-14T12:18:48.651805+0000","last_became_active":"2023-10-14T12:18:46.487981+0000","last_became_peered":"2023-10-14T12:18:46.487981+0000","last_unstale":"2023-10-14T12:18:48.651805+0000","last_undegraded":"2023-10-14T12:18:48.651805+0000","last_fullsized":"2023-10-14T12:18:48.651805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501360+0000","last_change":"2023-10-14T12:18:47.512865+0000","last_active":"2023-10-14T12:18:48.501360+0000","last_peered":"2023-10-14T12:18:48.501360+0000","last_clean":"2023-10-14T12:18:48.501360+0000","last_became_active":"2023-10-14T12:18:47.512117+0000","last_became_peered":"2023-10-14T12:18:47.512117+0000","last_unstale":"2023-10-14T12:18:48.501360+0000","last_undegraded":"2023-10-14T12:18:48.501360+0000","last_fullsized":"2023-10-14T12:18:48.501360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:20.704090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501126+0000","last_change":"2023-10-14T12:18:46.488158+0000","last_active":"2023-10-14T12:18:48.501126+0000","last_peered":"2023-10-14T12:18:48.501126+0000","last_clean":"2023-10-14T12:18:48.501126+0000","last_became_active":"2023-10-14T12:18:46.487808+0000","last_became_peered":"2023-10-14T12:18:46.487808+0000","last_unstale":"2023-10-14T12:18:48.501126+0000","last_undegraded":"2023-10-14T12:18:48.501126+0000","last_fullsized":"2023-10-14T12:18:48.501126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769274+0000","last_change":"2023-10-14T12:18:47.506873+0000","last_active":"2023-10-14T12:18:49.769274+0000","last_peered":"2023-10-14T12:18:49.769274+0000","last_clean":"2023-10-14T12:18:49.769274+0000","last_became_active":"2023-10-14T12:18:47.506563+0000","last_became_peered":"2023-10-14T12:18:47.506563+0000","last_unstale":"2023-10-14T12:18:49.769274+0000","last_undegraded":"2023-10-14T12:18:49.769274+0000","last_fullsized":"2023-10-14T12:18:49.769274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651592+0000","last_change":"2023-10-14T12:18:47.494275+0000","last_active":"2023-10-14T12:18:48.651592+0000","last_peered":"2023-10-14T12:18:48.651592+0000","last_clean":"2023-10-14T12:18:48.651592+0000","last_became_active":"2023-10-14T12:18:47.493948+0000","last_became_peered":"2023-10-14T12:18:47.493948+0000","last_unstale":"2023-10-14T12:18:48.651592+0000","last_undegraded":"2023-10-14T12:18:48.651592+0000","last_fullsized":"2023-10-14T12:18:48.651592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499214+0000","last_change":"2023-10-14T12:18:46.485430+0000","last_active":"2023-10-14T12:18:48.499214+0000","last_peered":"2023-10-14T12:18:48.499214+0000","last_clean":"2023-10-14T12:18:48.499214+0000","last_became_active":"2023-10-14T12:18:46.485097+0000","last_became_peered":"2023-10-14T12:18:46.485097+0000","last_unstale":"2023-10-14T12:18:48.499214+0000","last_undegraded":"2023-10-14T12:18:48.499214+0000","last_fullsized":"2023-10-14T12:18:48.499214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:35.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500519+0000","last_change":"2023-10-14T12:18:47.520808+0000","last_active":"2023-10-14T12:18:48.500519+0000","last_peered":"2023-10-14T12:18:48.500519+0000","last_clean":"2023-10-14T12:18:48.500519+0000","last_became_active":"2023-10-14T12:18:47.520421+0000","last_became_peered":"2023-10-14T12:18:47.520421+0000","last_unstale":"2023-10-14T12:18:48.500519+0000","last_undegraded":"2023-10-14T12:18:48.500519+0000","last_fullsized":"2023-10-14T12:18:48.500519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500975+0000","last_change":"2023-10-14T12:18:46.487688+0000","last_active":"2023-10-14T12:18:48.500975+0000","last_peered":"2023-10-14T12:18:48.500975+0000","last_clean":"2023-10-14T12:18:48.500975+0000","last_became_active":"2023-10-14T12:18:46.487378+0000","last_became_peered":"2023-10-14T12:18:46.487378+0000","last_unstale":"2023-10-14T12:18:48.500975+0000","last_undegraded":"2023-10-14T12:18:48.500975+0000","last_fullsized":"2023-10-14T12:18:48.500975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:33.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:47.494920+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:18:47.494920+0000","last_peered":"2023-10-14T12:18:47.494920+0000","last_clean":"2023-10-14T12:18:47.494920+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:18:47.494920+0000","last_undegraded":"2023-10-14T12:18:47.494920+0000","last_fullsized":"2023-10-14T12:18:47.494920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352259+0000","last_change":"2023-10-14T12:18:47.508543+0000","last_active":"2023-10-14T12:18:50.352259+0000","last_peered":"2023-10-14T12:18:50.352259+0000","last_clean":"2023-10-14T12:18:50.352259+0000","last_became_active":"2023-10-14T12:18:47.508263+0000","last_became_peered":"2023-10-14T12:18:47.508263+0000","last_unstale":"2023-10-14T12:18:50.352259+0000","last_undegraded":"2023-10-14T12:18:50.352259+0000","last_fullsized":"2023-10-14T12:18:50.352259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:05.917740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168717+0000","last_change":"2023-10-14T12:18:46.489896+0000","last_active":"2023-10-14T12:18:50.168717+0000","last_peered":"2023-10-14T12:18:50.168717+0000","last_clean":"2023-10-14T12:18:50.168717+0000","last_became_active":"2023-10-14T12:18:46.489571+0000","last_became_peered":"2023-10-14T12:18:46.489571+0000","last_unstale":"2023-10-14T12:18:50.168717+0000","last_undegraded":"2023-10-14T12:18:50.168717+0000","last_fullsized":"2023-10-14T12:18:50.168717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:47:04.913018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168987+0000","last_change":"2023-10-14T12:18:46.490891+0000","last_active":"2023-10-14T12:18:50.168987+0000","last_peered":"2023-10-14T12:18:50.168987+0000","last_clean":"2023-10-14T12:18:50.168987+0000","last_became_active":"2023-10-14T12:18:46.490638+0000","last_became_peered":"2023-10-14T12:18:46.490638+0000","last_unstale":"2023-10-14T12:18:50.168987+0000","last_undegraded":"2023-10-14T12:18:50.168987+0000","last_fullsized":"2023-10-14T12:18:50.168987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:05.959419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651814+0000","last_change":"2023-10-14T12:18:47.494381+0000","last_active":"2023-10-14T12:18:48.651814+0000","last_peered":"2023-10-14T12:18:48.651814+0000","last_clean":"2023-10-14T12:18:48.651814+0000","last_became_active":"2023-10-14T12:18:47.493740+0000","last_became_peered":"2023-10-14T12:18:47.493740+0000","last_unstale":"2023-10-14T12:18:48.651814+0000","last_undegraded":"2023-10-14T12:18:48.651814+0000","last_fullsized":"2023-10-14T12:18:48.651814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168766+0000","last_change":"2023-10-14T12:18:46.492626+0000","last_active":"2023-10-14T12:18:50.168766+0000","last_peered":"2023-10-14T12:18:50.168766+0000","last_clean":"2023-10-14T12:18:50.168766+0000","last_became_active":"2023-10-14T12:18:46.492238+0000","last_became_peered":"2023-10-14T12:18:46.492238+0000","last_unstale":"2023-10-14T12:18:50.168766+0000","last_undegraded":"2023-10-14T12:18:50.168766+0000","last_fullsized":"2023-10-14T12:18:50.168766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:04.096031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500978+0000","last_change":"2023-10-14T12:18:47.505508+0000","last_active":"2023-10-14T12:18:48.500978+0000","last_peered":"2023-10-14T12:18:48.500978+0000","last_clean":"2023-10-14T12:18:48.500978+0000","last_became_active":"2023-10-14T12:18:47.505204+0000","last_became_peered":"2023-10-14T12:18:47.505204+0000","last_unstale":"2023-10-14T12:18:48.500978+0000","last_undegraded":"2023-10-14T12:18:48.500978+0000","last_fullsized":"2023-10-14T12:18:48.500978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:49.917570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444144+0000","last_change":"2023-10-14T12:18:46.489860+0000","last_active":"2023-10-14T12:18:49.444144+0000","last_peered":"2023-10-14T12:18:49.444144+0000","last_clean":"2023-10-14T12:18:49.444144+0000","last_became_active":"2023-10-14T12:18:46.489554+0000","last_became_peered":"2023-10-14T12:18:46.489554+0000","last_unstale":"2023-10-14T12:18:49.444144+0000","last_undegraded":"2023-10-14T12:18:49.444144+0000","last_fullsized":"2023-10-14T12:18:49.444144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352643+0000","last_change":"2023-10-14T12:18:47.501705+0000","last_active":"2023-10-14T12:18:50.352643+0000","last_peered":"2023-10-14T12:18:50.352643+0000","last_clean":"2023-10-14T12:18:50.352643+0000","last_became_active":"2023-10-14T12:18:47.499259+0000","last_became_peered":"2023-10-14T12:18:47.499259+0000","last_unstale":"2023-10-14T12:18:50.352643+0000","last_undegraded":"2023-10-14T12:18:50.352643+0000","last_fullsized":"2023-10-14T12:18:50.352643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168657+0000","last_change":"2023-10-14T12:18:46.489770+0000","last_active":"2023-10-14T12:18:50.168657+0000","last_peered":"2023-10-14T12:18:50.168657+0000","last_clean":"2023-10-14T12:18:50.168657+0000","last_became_active":"2023-10-14T12:18:46.489289+0000","last_became_peered":"2023-10-14T12:18:46.489289+0000","last_unstale":"2023-10-14T12:18:50.168657+0000","last_undegraded":"2023-10-14T12:18:50.168657+0000","last_fullsized":"2023-10-14T12:18:50.168657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:43:48.474711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.769054+0000","last_change":"2023-10-14T12:18:47.506908+0000","last_active":"2023-10-14T12:18:49.769054+0000","last_peered":"2023-10-14T12:18:49.769054+0000","last_clean":"2023-10-14T12:18:49.769054+0000","last_became_active":"2023-10-14T12:18:47.506651+0000","last_became_peered":"2023-10-14T12:18:47.506651+0000","last_unstale":"2023-10-14T12:18:49.769054+0000","last_undegraded":"2023-10-14T12:18:49.769054+0000","last_fullsized":"2023-10-14T12:18:49.769054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:51.129141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651573+0000","last_change":"2023-10-14T12:18:46.491315+0000","last_active":"2023-10-14T12:18:48.651573+0000","last_peered":"2023-10-14T12:18:48.651573+0000","last_clean":"2023-10-14T12:18:48.651573+0000","last_became_active":"2023-10-14T12:18:46.490992+0000","last_became_peered":"2023-10-14T12:18:46.490992+0000","last_unstale":"2023-10-14T12:18:48.651573+0000","last_undegraded":"2023-10-14T12:18:48.651573+0000","last_fullsized":"2023-10-14T12:18:48.651573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:39.561079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.496045+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.495676+0000","last_became_peered":"2023-10-14T12:18:47.495676+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651651+0000","last_change":"2023-10-14T12:18:46.493273+0000","last_active":"2023-10-14T12:18:48.651651+0000","last_peered":"2023-10-14T12:18:48.651651+0000","last_clean":"2023-10-14T12:18:48.651651+0000","last_became_active":"2023-10-14T12:18:46.492945+0000","last_became_peered":"2023-10-14T12:18:46.492945+0000","last_unstale":"2023-10-14T12:18:48.651651+0000","last_undegraded":"2023-10-14T12:18:48.651651+0000","last_fullsized":"2023-10-14T12:18:48.651651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500822+0000","last_change":"2023-10-14T12:18:47.504495+0000","last_active":"2023-10-14T12:18:48.500822+0000","last_peered":"2023-10-14T12:18:48.500822+0000","last_clean":"2023-10-14T12:18:48.500822+0000","last_became_active":"2023-10-14T12:18:47.504117+0000","last_became_peered":"2023-10-14T12:18:47.504117+0000","last_unstale":"2023-10-14T12:18:48.500822+0000","last_undegraded":"2023-10-14T12:18:48.500822+0000","last_fullsized":"2023-10-14T12:18:48.500822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:49.865578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.168843+0000","last_change":"2023-10-14T12:18:46.489933+0000","last_active":"2023-10-14T12:18:50.168843+0000","last_peered":"2023-10-14T12:18:50.168843+0000","last_clean":"2023-10-14T12:18:50.168843+0000","last_became_active":"2023-10-14T12:18:46.489656+0000","last_became_peered":"2023-10-14T12:18:46.489656+0000","last_unstale":"2023-10-14T12:18:50.168843+0000","last_undegraded":"2023-10-14T12:18:50.168843+0000","last_fullsized":"2023-10-14T12:18:50.168843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444202+0000","last_change":"2023-10-14T12:18:47.510691+0000","last_active":"2023-10-14T12:18:49.444202+0000","last_peered":"2023-10-14T12:18:49.444202+0000","last_clean":"2023-10-14T12:18:49.444202+0000","last_became_active":"2023-10-14T12:18:47.510404+0000","last_became_peered":"2023-10-14T12:18:47.510404+0000","last_unstale":"2023-10-14T12:18:49.444202+0000","last_undegraded":"2023-10-14T12:18:49.444202+0000","last_fullsized":"2023-10-14T12:18:49.444202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499536+0000","last_change":"2023-10-14T12:18:46.480875+0000","last_active":"2023-10-14T12:18:48.499536+0000","last_peered":"2023-10-14T12:18:48.499536+0000","last_clean":"2023-10-14T12:18:48.499536+0000","last_became_active":"2023-10-14T12:18:46.480351+0000","last_became_peered":"2023-10-14T12:18:46.480351+0000","last_unstale":"2023-10-14T12:18:48.499536+0000","last_undegraded":"2023-10-14T12:18:48.499536+0000","last_fullsized":"2023-10-14T12:18:48.499536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353141+0000","last_change":"2023-10-14T12:18:47.513547+0000","last_active":"2023-10-14T12:18:50.353141+0000","last_peered":"2023-10-14T12:18:50.353141+0000","last_clean":"2023-10-14T12:18:50.353141+0000","last_became_active":"2023-10-14T12:18:47.513269+0000","last_became_peered":"2023-10-14T12:18:47.513269+0000","last_unstale":"2023-10-14T12:18:50.353141+0000","last_undegraded":"2023-10-14T12:18:50.353141+0000","last_fullsized":"2023-10-14T12:18:50.353141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:47.569087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651762+0000","last_change":"2023-10-14T12:18:46.489993+0000","last_active":"2023-10-14T12:18:48.651762+0000","last_peered":"2023-10-14T12:18:48.651762+0000","last_clean":"2023-10-14T12:18:48.651762+0000","last_became_active":"2023-10-14T12:18:46.489684+0000","last_became_peered":"2023-10-14T12:18:46.489684+0000","last_unstale":"2023-10-14T12:18:48.651762+0000","last_undegraded":"2023-10-14T12:18:48.651762+0000","last_fullsized":"2023-10-14T12:18:48.651762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:43.506183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501154+0000","last_change":"2023-10-14T12:18:47.503531+0000","last_active":"2023-10-14T12:18:48.501154+0000","last_peered":"2023-10-14T12:18:48.501154+0000","last_clean":"2023-10-14T12:18:48.501154+0000","last_became_active":"2023-10-14T12:18:47.503243+0000","last_became_peered":"2023-10-14T12:18:47.503243+0000","last_unstale":"2023-10-14T12:18:48.501154+0000","last_undegraded":"2023-10-14T12:18:48.501154+0000","last_fullsized":"2023-10-14T12:18:48.501154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:18.615845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499451+0000","last_change":"2023-10-14T12:18:46.488590+0000","last_active":"2023-10-14T12:18:48.499451+0000","last_peered":"2023-10-14T12:18:48.499451+0000","last_clean":"2023-10-14T12:18:48.499451+0000","last_became_active":"2023-10-14T12:18:46.487442+0000","last_became_peered":"2023-10-14T12:18:46.487442+0000","last_unstale":"2023-10-14T12:18:48.499451+0000","last_undegraded":"2023-10-14T12:18:48.499451+0000","last_fullsized":"2023-10-14T12:18:48.499451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:45.461529+0000","last_clean_scrub_stamp":"2023-10-14T12:18:45.461529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:14.035210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.353411+0000","last_change":"2023-10-14T12:18:47.510800+0000","last_active":"2023-10-14T12:18:50.353411+0000","last_peered":"2023-10-14T12:18:50.353411+0000","last_clean":"2023-10-14T12:18:50.353411+0000","last_became_active":"2023-10-14T12:18:47.510526+0000","last_became_peered":"2023-10-14T12:18:47.510526+0000","last_unstale":"2023-10-14T12:18:50.353411+0000","last_undegraded":"2023-10-14T12:18:50.353411+0000","last_fullsized":"2023-10-14T12:18:50.353411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:47.215959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.443979+0000","last_change":"2023-10-14T12:18:47.506751+0000","last_active":"2023-10-14T12:18:49.443979+0000","last_peered":"2023-10-14T12:18:49.443979+0000","last_clean":"2023-10-14T12:18:49.443979+0000","last_became_active":"2023-10-14T12:18:47.506062+0000","last_became_peered":"2023-10-14T12:18:47.506062+0000","last_unstale":"2023-10-14T12:18:49.443979+0000","last_undegraded":"2023-10-14T12:18:49.443979+0000","last_fullsized":"2023-10-14T12:18:49.443979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.499359+0000","last_change":"2023-10-14T12:18:47.512676+0000","last_active":"2023-10-14T12:18:48.499359+0000","last_peered":"2023-10-14T12:18:48.499359+0000","last_clean":"2023-10-14T12:18:48.499359+0000","last_became_active":"2023-10-14T12:18:47.512314+0000","last_became_peered":"2023-10-14T12:18:47.512314+0000","last_unstale":"2023-10-14T12:18:48.499359+0000","last_undegraded":"2023-10-14T12:18:48.499359+0000","last_fullsized":"2023-10-14T12:18:48.499359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:34.943760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501459+0000","last_change":"2023-10-14T12:18:47.517326+0000","last_active":"2023-10-14T12:18:48.501459+0000","last_peered":"2023-10-14T12:18:48.501459+0000","last_clean":"2023-10-14T12:18:48.501459+0000","last_became_active":"2023-10-14T12:18:47.512255+0000","last_became_peered":"2023-10-14T12:18:47.512255+0000","last_unstale":"2023-10-14T12:18:48.501459+0000","last_undegraded":"2023-10-14T12:18:48.501459+0000","last_fullsized":"2023-10-14T12:18:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:20:10.981380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352599+0000","last_change":"2023-10-14T12:18:47.501741+0000","last_active":"2023-10-14T12:18:50.352599+0000","last_peered":"2023-10-14T12:18:50.352599+0000","last_clean":"2023-10-14T12:18:50.352599+0000","last_became_active":"2023-10-14T12:18:47.501392+0000","last_became_peered":"2023-10-14T12:18:47.501392+0000","last_unstale":"2023-10-14T12:18:50.352599+0000","last_undegraded":"2023-10-14T12:18:50.352599+0000","last_fullsized":"2023-10-14T12:18:50.352599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:20.590524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500920+0000","last_change":"2023-10-14T12:18:47.510665+0000","last_active":"2023-10-14T12:18:48.500920+0000","last_peered":"2023-10-14T12:18:48.500920+0000","last_clean":"2023-10-14T12:18:48.500920+0000","last_became_active":"2023-10-14T12:18:47.510347+0000","last_became_peered":"2023-10-14T12:18:47.510347+0000","last_unstale":"2023-10-14T12:18:48.500920+0000","last_undegraded":"2023-10-14T12:18:48.500920+0000","last_fullsized":"2023-10-14T12:18:48.500920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.651786+0000","last_change":"2023-10-14T12:18:47.497457+0000","last_active":"2023-10-14T12:18:48.651786+0000","last_peered":"2023-10-14T12:18:48.651786+0000","last_clean":"2023-10-14T12:18:48.651786+0000","last_became_active":"2023-10-14T12:18:47.497154+0000","last_became_peered":"2023-10-14T12:18:47.497154+0000","last_unstale":"2023-10-14T12:18:48.651786+0000","last_undegraded":"2023-10-14T12:18:48.651786+0000","last_fullsized":"2023-10-14T12:18:48.651786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444383+0000","last_change":"2023-10-14T12:18:47.509170+0000","last_active":"2023-10-14T12:18:49.444383+0000","last_peered":"2023-10-14T12:18:49.444383+0000","last_clean":"2023-10-14T12:18:49.444383+0000","last_became_active":"2023-10-14T12:18:47.508882+0000","last_became_peered":"2023-10-14T12:18:47.508882+0000","last_unstale":"2023-10-14T12:18:49.444383+0000","last_undegraded":"2023-10-14T12:18:49.444383+0000","last_fullsized":"2023-10-14T12:18:49.444383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:22.070861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500863+0000","last_change":"2023-10-14T12:18:47.505965+0000","last_active":"2023-10-14T12:18:48.500863+0000","last_peered":"2023-10-14T12:18:48.500863+0000","last_clean":"2023-10-14T12:18:48.500863+0000","last_became_active":"2023-10-14T12:18:47.505663+0000","last_became_peered":"2023-10-14T12:18:47.505663+0000","last_unstale":"2023-10-14T12:18:48.500863+0000","last_undegraded":"2023-10-14T12:18:48.500863+0000","last_fullsized":"2023-10-14T12:18:48.500863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500816+0000","last_change":"2023-10-14T12:18:47.503352+0000","last_active":"2023-10-14T12:18:48.500816+0000","last_peered":"2023-10-14T12:18:48.500816+0000","last_clean":"2023-10-14T12:18:48.500816+0000","last_became_active":"2023-10-14T12:18:47.502998+0000","last_became_peered":"2023-10-14T12:18:47.502998+0000","last_unstale":"2023-10-14T12:18:48.500816+0000","last_undegraded":"2023-10-14T12:18:48.500816+0000","last_fullsized":"2023-10-14T12:18:48.500816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:07:54.067528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.500214+0000","last_change":"2023-10-14T12:18:47.509290+0000","last_active":"2023-10-14T12:18:48.500214+0000","last_peered":"2023-10-14T12:18:48.500214+0000","last_clean":"2023-10-14T12:18:48.500214+0000","last_became_active":"2023-10-14T12:18:47.508938+0000","last_became_peered":"2023-10-14T12:18:47.508938+0000","last_unstale":"2023-10-14T12:18:48.500214+0000","last_undegraded":"2023-10-14T12:18:48.500214+0000","last_fullsized":"2023-10-14T12:18:48.500214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:08:43.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:48.501012+0000","last_change":"2023-10-14T12:18:47.517756+0000","last_active":"2023-10-14T12:18:48.501012+0000","last_peered":"2023-10-14T12:18:48.501012+0000","last_clean":"2023-10-14T12:18:48.501012+0000","last_became_active":"2023-10-14T12:18:47.516277+0000","last_became_peered":"2023-10-14T12:18:47.516277+0000","last_unstale":"2023-10-14T12:18:48.501012+0000","last_undegraded":"2023-10-14T12:18:48.501012+0000","last_fullsized":"2023-10-14T12:18:48.501012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:35:08.123467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:50.352466+0000","last_change":"2023-10-14T12:18:47.518451+0000","last_active":"2023-10-14T12:18:50.352466+0000","last_peered":"2023-10-14T12:18:50.352466+0000","last_clean":"2023-10-14T12:18:50.352466+0000","last_became_active":"2023-10-14T12:18:47.518127+0000","last_became_peered":"2023-10-14T12:18:47.518127+0000","last_unstale":"2023-10-14T12:18:50.352466+0000","last_undegraded":"2023-10-14T12:18:50.352466+0000","last_fullsized":"2023-10-14T12:18:50.352466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:05.100753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T12:18:49.444296+0000","last_change":"2023-10-14T12:18:47.510708+0000","last_active":"2023-10-14T12:18:49.444296+0000","last_peered":"2023-10-14T12:18:49.444296+0000","last_clean":"2023-10-14T12:18:49.444296+0000","last_became_active":"2023-10-14T12:18:47.510385+0000","last_became_peered":"2023-10-14T12:18:47.510385+0000","last_unstale":"2023-10-14T12:18:49.444296+0000","last_undegraded":"2023-10-14T12:18:49.444296+0000","last_fullsized":"2023-10-14T12:18:49.444296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:46.466251+0000","last_clean_scrub_stamp":"2023-10-14T12:18:46.466251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:59.133078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:18:56.893 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T12:18:56.895 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T12:18:56.895 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T12:18:56.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T12:18:57.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.049+0000 7f638b52d700 1 Processor -- start 2023-10-14T12:18:57.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.049+0000 7f638b52d700 1 -- start start 2023-10-14T12:18:57.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f638b52d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f63840b7140 0x7f63840cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f638b52d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638415f450 con 0x7f638415b790 2023-10-14T12:18:57.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f638b52d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63840cc5f0 con 0x7f63840cc1c0 2023-10-14T12:18:57.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f638b52d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638415f6a0 con 0x7f63840b7140 2023-10-14T12:18:57.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f63892c9700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f638415b790 0x7f63840d0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55490/0 (socket says 172.21.15.32:55490) 2023-10-14T12:18:57.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f63892c9700 1 -- 172.21.15.32:0/1157500555 learned_addr learned my addr 172.21.15.32:0/1157500555 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:57.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f6388ac8700 1 --2- 172.21.15.32:0/1157500555 >> v2:172.21.15.92:3300/0 conn(0x7f63840b7140 0x7f63840cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f637bfff700 1 -- 172.21.15.32:0/1157500555 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808045545 0 0) 0x7f638415f450 con 0x7f638415b790 2023-10-14T12:18:57.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f637bfff700 1 -- 172.21.15.32:0/1157500555 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63700035b0 con 0x7f638415b790 2023-10-14T12:18:57.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f6388ac8700 1 -- 172.21.15.32:0/1157500555 >> v1:172.21.15.92:6789/0 conn(0x7f63840cc1c0 legacy=0x7f63840cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f6388ac8700 1 -- 172.21.15.32:0/1157500555 >> v1:172.21.15.32:6789/0 conn(0x7f638415b790 legacy=0x7f63840d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.050+0000 7f6388ac8700 1 -- 172.21.15.32:0/1157500555 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638415f980 con 0x7f63840b7140 2023-10-14T12:18:57.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f6388ac8700 1 --2- 172.21.15.32:0/1157500555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63840b7140 0x7f63840cbc80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6374009840 tx=0x7f6374009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d9badec3900abe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f637bfff700 1 -- 172.21.15.32:0/1157500555 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374011830 con 0x7f63840b7140 2023-10-14T12:18:57.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f637bfff700 1 -- 172.21.15.32:0/1157500555 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6374011990 con 0x7f63840b7140 2023-10-14T12:18:57.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f637bfff700 1 -- 172.21.15.32:0/1157500555 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374011d20 con 0x7f63840b7140 2023-10-14T12:18:57.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 -- 172.21.15.32:0/1157500555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63840b7140 msgr2=0x7f63840cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 --2- 172.21.15.32:0/1157500555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63840b7140 0x7f63840cbc80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6374009840 tx=0x7f6374009b50 comp rx=0 tx=0).stop 2023-10-14T12:18:57.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 -- 172.21.15.32:0/1157500555 shutdown_connections 2023-10-14T12:18:57.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 --2- 172.21.15.32:0/1157500555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63840b7140 0x7f63840cbc80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 -- 172.21.15.32:0/1157500555 >> 172.21.15.32:0/1157500555 conn(0x7f63840665a0 msgr2=0x7f6384066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:57.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 -- 172.21.15.32:0/1157500555 shutdown_connections 2023-10-14T12:18:57.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.051+0000 7f638b52d700 1 -- 172.21.15.32:0/1157500555 wait complete. 2023-10-14T12:18:57.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.052+0000 7f638b52d700 1 Processor -- start 2023-10-14T12:18:57.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.052+0000 7f638b52d700 1 -- start start 2023-10-14T12:18:57.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f638b52d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 0x7f6384143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f638b52d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63840cc1c0 0x7f63841440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f638b52d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638415b790 0x7f63840c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f638b52d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638413e690 con 0x7f63840b7140 2023-10-14T12:18:57.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f638b52d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638415ea60 con 0x7f638415b790 2023-10-14T12:18:57.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f638b52d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6384156560 con 0x7f63840cc1c0 2023-10-14T12:18:57.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f63892c9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 0x7f6384143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f63892c9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 0x7f6384143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38472/0 (socket says 172.21.15.32:38472) 2023-10-14T12:18:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.053+0000 7f63892c9700 1 -- 172.21.15.32:0/575682063 learned_addr learned my addr 172.21.15.32:0/575682063 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f6388ac8700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63840cc1c0 0x7f63841440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f6389aca700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638415b790 0x7f63840c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f63892c9700 1 -- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63840cc1c0 msgr2=0x7f63841440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f63892c9700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63840cc1c0 0x7f63841440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f63892c9700 1 -- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638415b790 msgr2=0x7f63840c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f63892c9700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638415b790 0x7f63840c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f63892c9700 1 -- 172.21.15.32:0/575682063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740094a0 con 0x7f63840b7140 2023-10-14T12:18:57.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f63892c9700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 0x7f6384143ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6380001eb0 tx=0x7f638000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380005d70 con 0x7f63840b7140 2023-10-14T12:18:57.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63800070d0 con 0x7f63840b7140 2023-10-14T12:18:57.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380007460 con 0x7f63840b7140 2023-10-14T12:18:57.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6384156840 con 0x7f63840b7140 2023-10-14T12:18:57.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.054+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638415ed40 con 0x7f63840b7140 2023-10-14T12:18:57.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.055+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6384156d60 con 0x7f63840b7140 2023-10-14T12:18:57.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.055+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63800075c0 con 0x7f63840b7140 2023-10-14T12:18:57.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.056+0000 7f6379ffb700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f636806af00 0x7f636806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.056+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6380088a90 con 0x7f63840b7140 2023-10-14T12:18:57.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.056+0000 7f6388ac8700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f636806af00 0x7f636806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.056+0000 7f6388ac8700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f636806af00 0x7f636806d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6374009840 tx=0x7f6374008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.060+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6384156d60 con 0x7f63840b7140 2023-10-14T12:18:57.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.304+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6384156d60 con 0x7f63840b7140 2023-10-14T12:18:57.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.305+0000 7f6379ffb700 1 -- 172.21.15.32:0/575682063 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6380017040 con 0x7f63840b7140 2023-10-14T12:18:57.307 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:57.308 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T12:18:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f636806af00 msgr2=0x7f636806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f636806af00 0x7f636806d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6374009840 tx=0x7f6374008030 comp rx=0 tx=0).stop 2023-10-14T12:18:57.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 msgr2=0x7f6384143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 0x7f6384143ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6380001eb0 tx=0x7f638000c860 comp rx=0 tx=0).stop 2023-10-14T12:18:57.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 shutdown_connections 2023-10-14T12:18:57.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f636806af00 0x7f636806d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638415b790 0x7f63840c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63840b7140 0x7f6384143ba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 --2- 172.21.15.32:0/575682063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63840cc1c0 0x7f63841440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 >> 172.21.15.32:0/575682063 conn(0x7f63840665a0 msgr2=0x7f6384159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 shutdown_connections 2023-10-14T12:18:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.307+0000 7f638b52d700 1 -- 172.21.15.32:0/575682063 wait complete. 2023-10-14T12:18:57.321 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T12:18:57.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:57.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.444+0000 7f428a266700 1 Processor -- start 2023-10-14T12:18:57.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.444+0000 7f428a266700 1 -- start start 2023-10-14T12:18:57.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f428a266700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f428406e750 0x7f42840ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f428a266700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f42840b54f0 0x7f42840cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f428a266700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840b5c70 con 0x7f428406eb30 2023-10-14T12:18:57.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f428a266700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840b5990 con 0x7f428406e750 2023-10-14T12:18:57.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f428a266700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428415b2b0 con 0x7f42840b54f0 2023-10-14T12:18:57.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f4283fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f428406e750 0x7f42840ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f4283fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f428406e750 0x7f42840ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38480/0 (socket says 172.21.15.32:38480) 2023-10-14T12:18:57.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f4283fff700 1 -- 172.21.15.32:0/419744502 learned_addr learned my addr 172.21.15.32:0/419744502 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:57.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.445+0000 7f4288803700 1 --2- 172.21.15.32:0/419744502 >> v2:172.21.15.92:3300/0 conn(0x7f42840b54f0 0x7f42840cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4283fff700 1 -- 172.21.15.32:0/419744502 >> v2:172.21.15.92:3300/0 conn(0x7f42840b54f0 msgr2=0x7f42840cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:57.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4283fff700 1 --2- 172.21.15.32:0/419744502 >> v2:172.21.15.92:3300/0 conn(0x7f42840b54f0 0x7f42840cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4283fff700 1 -- 172.21.15.32:0/419744502 >> v1:172.21.15.92:6789/0 conn(0x7f428406eb30 legacy=0x7f428415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4283fff700 1 -- 172.21.15.32:0/419744502 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428415b590 con 0x7f428406e750 2023-10-14T12:18:57.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4283fff700 1 --2- 172.21.15.32:0/419744502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f428406e750 0x7f42840ceec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f426c0098f0 tx=0x7f426c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96fa9aefe1f091c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4282ffd700 1 -- 172.21.15.32:0/419744502 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00b860 con 0x7f428406e750 2023-10-14T12:18:57.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4282ffd700 1 -- 172.21.15.32:0/419744502 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c00b9c0 con 0x7f428406e750 2023-10-14T12:18:57.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f4282ffd700 1 -- 172.21.15.32:0/419744502 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00bd50 con 0x7f428406e750 2023-10-14T12:18:57.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f428a266700 1 -- 172.21.15.32:0/419744502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f428406e750 msgr2=0x7f42840ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.446+0000 7f428a266700 1 --2- 172.21.15.32:0/419744502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f428406e750 0x7f42840ceec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f426c0098f0 tx=0x7f426c009c00 comp rx=0 tx=0).stop 2023-10-14T12:18:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.447+0000 7f428a266700 1 -- 172.21.15.32:0/419744502 shutdown_connections 2023-10-14T12:18:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.447+0000 7f428a266700 1 --2- 172.21.15.32:0/419744502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f428406e750 0x7f42840ceec0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.447+0000 7f428a266700 1 --2- 172.21.15.32:0/419744502 >> v2:172.21.15.92:3300/0 conn(0x7f42840b54f0 0x7f42840cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.447+0000 7f428a266700 1 -- 172.21.15.32:0/419744502 >> 172.21.15.32:0/419744502 conn(0x7f42840cc6f0 msgr2=0x7f42840ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.447+0000 7f428a266700 1 -- 172.21.15.32:0/419744502 shutdown_connections 2023-10-14T12:18:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.447+0000 7f428a266700 1 -- 172.21.15.32:0/419744502 wait complete. 2023-10-14T12:18:57.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.448+0000 7f428a266700 1 Processor -- start 2023-10-14T12:18:57.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.448+0000 7f428a266700 1 -- start start 2023-10-14T12:18:57.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f428a266700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f428406e750 0x7f42840b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f428a266700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428406eb30 0x7f4284153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f428a266700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 0x7f4284147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f428a266700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42840b3390 con 0x7f42840b54f0 2023-10-14T12:18:57.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f428a266700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42840b4a80 con 0x7f428406eb30 2023-10-14T12:18:57.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f428a266700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42840b2a60 con 0x7f428406e750 2023-10-14T12:18:57.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 0x7f4284147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 0x7f4284147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38490/0 (socket says 172.21.15.32:38490) 2023-10-14T12:18:57.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 -- 172.21.15.32:0/1874443715 learned_addr learned my addr 172.21.15.32:0/1874443715 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:57.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4283fff700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f428406e750 0x7f42840b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f42837fe700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428406eb30 0x7f4284153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 -- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f428406e750 msgr2=0x7f42840b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f428406e750 0x7f42840b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 -- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428406eb30 msgr2=0x7f4284153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428406eb30 0x7f4284153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 -- 172.21.15.32:0/1874443715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009550 con 0x7f42840b54f0 2023-10-14T12:18:57.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f42837fe700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428406eb30 0x7f4284153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:57.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4288803700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 0x7f4284147bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f427c007e30 tx=0x7f427c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.449+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00eea0 con 0x7f42840b54f0 2023-10-14T12:18:57.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.450+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c014420 con 0x7f42840b54f0 2023-10-14T12:18:57.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.450+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42840b2d40 con 0x7f42840b54f0 2023-10-14T12:18:57.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.450+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0147d0 con 0x7f42840b54f0 2023-10-14T12:18:57.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.450+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42840b4690 con 0x7f42840b54f0 2023-10-14T12:18:57.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.451+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42840b4850 con 0x7f42840b54f0 2023-10-14T12:18:57.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.451+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f427c014930 con 0x7f42840b54f0 2023-10-14T12:18:57.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.451+0000 7f4280ff9700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f426406af00 0x7f426406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.452+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f427c089d60 con 0x7f42840b54f0 2023-10-14T12:18:57.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.452+0000 7f4283fff700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f426406af00 0x7f426406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.452+0000 7f4283fff700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f426406af00 0x7f426406d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f426c014040 tx=0x7f426c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.456+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f427c054ea0 con 0x7f42840b54f0 2023-10-14T12:18:57.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.656+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4284067d20 con 0x7f42840b54f0 2023-10-14T12:18:57.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.657+0000 7f4280ff9700 1 -- 172.21.15.32:0/1874443715 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f427c0584c0 con 0x7f42840b54f0 2023-10-14T12:18:57.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:57.660 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f426406af00 msgr2=0x7f426406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f426406af00 0x7f426406d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f426c014040 tx=0x7f426c008030 comp rx=0 tx=0).stop 2023-10-14T12:18:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 msgr2=0x7f4284147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 0x7f4284147bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f427c007e30 tx=0x7f427c00e3c0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 shutdown_connections 2023-10-14T12:18:57.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42840b54f0 0x7f4284147bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f428406e750 0x7f42840b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f426406af00 0x7f426406d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 --2- 172.21.15.32:0/1874443715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428406eb30 0x7f4284153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 >> 172.21.15.32:0/1874443715 conn(0x7f42840cc6f0 msgr2=0x7f428415f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:57.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 shutdown_connections 2023-10-14T12:18:57.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.660+0000 7f428a266700 1 -- 172.21.15.32:0/1874443715 wait complete. 2023-10-14T12:18:57.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:18:57.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:18:57.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 Processor -- start 2023-10-14T12:18:57.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 -- start start 2023-10-14T12:18:57.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb3dc15eab0 0x7fb3dc0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3dc0cf6d0 0x7fb3dc0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0cfb60 con 0x7fb3dc0cf6d0 2023-10-14T12:18:57.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc15ee90 con 0x7fb3dc15eab0 2023-10-14T12:18:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3e201c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc158370 con 0x7fb3dc0d1bc0 2023-10-14T12:18:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.801+0000 7fb3daffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3dc0cf6d0 0x7fb3dc0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3dc0cf6d0 0x7fb3dc0d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38496/0 (socket says 172.21.15.32:38496) 2023-10-14T12:18:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 -- 172.21.15.32:0/2187066397 learned_addr learned my addr 172.21.15.32:0/2187066397 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:57.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3dbfff700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3db7fe700 1 --2- 172.21.15.32:0/2187066397 >> v2:172.21.15.92:3300/0 conn(0x7fb3dc15eab0 0x7fb3dc0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 -- 172.21.15.32:0/2187066397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 msgr2=0x7fb3dc161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:57.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 -- 172.21.15.32:0/2187066397 >> v2:172.21.15.92:3300/0 conn(0x7fb3dc15eab0 msgr2=0x7fb3dc0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:57.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 --2- 172.21.15.32:0/2187066397 >> v2:172.21.15.92:3300/0 conn(0x7fb3dc15eab0 0x7fb3dc0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 -- 172.21.15.32:0/2187066397 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0d23b0 con 0x7fb3dc0cf6d0 2023-10-14T12:18:57.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3dbfff700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:57.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3db7fe700 1 --2- 172.21.15.32:0/2187066397 >> v2:172.21.15.92:3300/0 conn(0x7fb3dc15eab0 0x7fb3dc0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:57.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3daffd700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc0d1680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc067550 tx=0x7fb3cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51c2e7c25f19a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3da7fc700 1 -- 172.21.15.32:0/2187066397 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00b870 con 0x7fb3dc0cf6d0 2023-10-14T12:18:57.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3da7fc700 1 -- 172.21.15.32:0/2187066397 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00b9d0 con 0x7fb3dc0cf6d0 2023-10-14T12:18:57.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.802+0000 7fb3da7fc700 1 -- 172.21.15.32:0/2187066397 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00bd60 con 0x7fb3dc0cf6d0 2023-10-14T12:18:57.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 -- 172.21.15.32:0/2187066397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc0cf6d0 msgr2=0x7fb3dc0d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc0d1680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc067550 tx=0x7fb3cc009bd0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 -- 172.21.15.32:0/2187066397 shutdown_connections 2023-10-14T12:18:57.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 --2- 172.21.15.32:0/2187066397 >> v2:172.21.15.92:3300/0 conn(0x7fb3dc15eab0 0x7fb3dc0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 --2- 172.21.15.32:0/2187066397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc0d1680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 -- 172.21.15.32:0/2187066397 >> 172.21.15.32:0/2187066397 conn(0x7fb3dc0665a0 msgr2=0x7fb3dc066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:57.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 -- 172.21.15.32:0/2187066397 shutdown_connections 2023-10-14T12:18:57.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.803+0000 7fb3e201c700 1 -- 172.21.15.32:0/2187066397 wait complete. 2023-10-14T12:18:57.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.804+0000 7fb3e201c700 1 Processor -- start 2023-10-14T12:18:57.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.804+0000 7fb3e201c700 1 -- start start 2023-10-14T12:18:57.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3e201c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3e201c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3e201c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 0x7fb3dc06d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3e201c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15f030 con 0x7fb3dc15eab0 2023-10-14T12:18:57.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3e201c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15f2f0 con 0x7fb3dc0cf6d0 2023-10-14T12:18:57.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3e201c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1452c0 con 0x7fb3dc0d1bc0 2023-10-14T12:18:57.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 0x7fb3dc06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 0x7fb3dc06d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38504/0 (socket says 172.21.15.32:38504) 2023-10-14T12:18:57.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 -- 172.21.15.32:0/548589532 learned_addr learned my addr 172.21.15.32:0/548589532 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:57.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3daffd700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3db7fe700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 -- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 msgr2=0x7fb3dc06cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc06cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 -- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3dc0cf6d0 msgr2=0x7fb3dc145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:57.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 -- 172.21.15.32:0/548589532 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009550 con 0x7fb3dc15eab0 2023-10-14T12:18:57.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3db7fe700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:57.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.805+0000 7fb3dbfff700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 0x7fb3dc06d010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4007db0 tx=0x7fb3d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.806+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400ddd0 con 0x7fb3dc15eab0 2023-10-14T12:18:57.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.806+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400f040 con 0x7fb3dc15eab0 2023-10-14T12:18:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.806+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc1455a0 con 0x7fb3dc15eab0 2023-10-14T12:18:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.806+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4003c60 con 0x7fb3dc15eab0 2023-10-14T12:18:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.806+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc15f5d0 con 0x7fb3dc15eab0 2023-10-14T12:18:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.807+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0cdce0 con 0x7fb3dc15eab0 2023-10-14T12:18:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.807+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb3d4004030 con 0x7fb3dc15eab0 2023-10-14T12:18:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.807+0000 7fb3c3fff700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb3c806af00 0x7fb3c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.808+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3d4089600 con 0x7fb3dc15eab0 2023-10-14T12:18:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.808+0000 7fb3db7fe700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb3c806af00 0x7fb3c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.808+0000 7fb3db7fe700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb3c806af00 0x7fb3c806d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc1541e0 tx=0x7fb3d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:57.813+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3dc0cdce0 con 0x7fb3dc15eab0 2023-10-14T12:18:58.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.013+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3dc145ac0 con 0x7fb3dc15eab0 2023-10-14T12:18:58.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.013+0000 7fb3c3fff700 1 -- 172.21.15.32:0/548589532 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3dc145ac0 con 0x7fb3dc15eab0 2023-10-14T12:18:58.016 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:18:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb3c806af00 msgr2=0x7fb3c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb3c806af00 0x7fb3c806d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc1541e0 tx=0x7fb3d0008040 comp rx=0 tx=0).stop 2023-10-14T12:18:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 msgr2=0x7fb3dc06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 0x7fb3dc06d010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4007db0 tx=0x7fb3d400d3b0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 shutdown_connections 2023-10-14T12:18:58.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc15eab0 0x7fb3dc06d010 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb3c806af00 0x7fb3c806d3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3dc0cf6d0 0x7fb3dc145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 --2- 172.21.15.32:0/548589532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb3dc0d1bc0 0x7fb3dc06cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 >> 172.21.15.32:0/548589532 conn(0x7fb3dc0665a0 msgr2=0x7fb3dc156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 shutdown_connections 2023-10-14T12:18:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.016+0000 7fb3e201c700 1 -- 172.21.15.32:0/548589532 wait complete. 2023-10-14T12:18:58.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:18:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.155+0000 7fe8617dc700 1 Processor -- start 2023-10-14T12:18:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.155+0000 7fe8617dc700 1 -- start start 2023-10-14T12:18:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe8617dc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe85c15ab10 0x7fe85c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe8617dc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe85c0cfe30 0x7fe85c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe8617dc700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c15e7a0 con 0x7fe85c0b1f50 2023-10-14T12:18:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe8617dc700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c15f730 con 0x7fe85c15ab10 2023-10-14T12:18:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe8617dc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c0b29a0 con 0x7fe85c0cfe30 2023-10-14T12:18:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe85a7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe85c0b1f50 0x7fe85c0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55532/0 (socket says 172.21.15.32:55532) 2023-10-14T12:18:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe85affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe85c15ab10 0x7fe85c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.156+0000 7fe85a7fc700 1 -- 172.21.15.32:0/1779976304 learned_addr learned my addr 172.21.15.32:0/1779976304 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe85b7fe700 1 --2- 172.21.15.32:0/1779976304 >> v2:172.21.15.92:3300/0 conn(0x7fe85c0cfe30 0x7fe85c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe85affd700 1 -- 172.21.15.32:0/1779976304 >> v2:172.21.15.92:3300/0 conn(0x7fe85c0cfe30 msgr2=0x7fe85c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe85affd700 1 --2- 172.21.15.32:0/1779976304 >> v2:172.21.15.92:3300/0 conn(0x7fe85c0cfe30 0x7fe85c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe85affd700 1 -- 172.21.15.32:0/1779976304 >> v1:172.21.15.32:6789/0 conn(0x7fe85c0b1f50 legacy=0x7fe85c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe859ffb700 1 -- 172.21.15.32:0/1779976304 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031987497 0 0) 0x7fe85c15e7a0 con 0x7fe85c0b1f50 2023-10-14T12:18:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe85affd700 1 -- 172.21.15.32:0/1779976304 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0b2c80 con 0x7fe85c15ab10 2023-10-14T12:18:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe85affd700 1 --2- 172.21.15.32:0/1779976304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c15ab10 0x7fe85c15f1f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0d03e0 tx=0x7fe850009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8e38fcb449c347 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe859ffb700 1 -- 172.21.15.32:0/1779976304 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850011830 con 0x7fe85c15ab10 2023-10-14T12:18:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe859ffb700 1 -- 172.21.15.32:0/1779976304 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850011990 con 0x7fe85c15ab10 2023-10-14T12:18:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.157+0000 7fe859ffb700 1 -- 172.21.15.32:0/1779976304 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850011d20 con 0x7fe85c15ab10 2023-10-14T12:18:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 -- 172.21.15.32:0/1779976304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c15ab10 msgr2=0x7fe85c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 --2- 172.21.15.32:0/1779976304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c15ab10 0x7fe85c15f1f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0d03e0 tx=0x7fe850009b20 comp rx=0 tx=0).stop 2023-10-14T12:18:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 -- 172.21.15.32:0/1779976304 shutdown_connections 2023-10-14T12:18:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 --2- 172.21.15.32:0/1779976304 >> v2:172.21.15.92:3300/0 conn(0x7fe85c0cfe30 0x7fe85c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 --2- 172.21.15.32:0/1779976304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c15ab10 0x7fe85c15f1f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 -- 172.21.15.32:0/1779976304 >> 172.21.15.32:0/1779976304 conn(0x7fe85c06dae0 msgr2=0x7fe85c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 -- 172.21.15.32:0/1779976304 shutdown_connections 2023-10-14T12:18:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.158+0000 7fe8617dc700 1 -- 172.21.15.32:0/1779976304 wait complete. 2023-10-14T12:18:58.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.159+0000 7fe8617dc700 1 Processor -- start 2023-10-14T12:18:58.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.159+0000 7fe8617dc700 1 -- start start 2023-10-14T12:18:58.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 0x7fe85c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe85c0cfe30 0x7fe85c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe85c15ab10 0x7fe85c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0b5180 con 0x7fe85c0b1f50 2023-10-14T12:18:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0b4500 con 0x7fe85c15ab10 2023-10-14T12:18:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0b47e0 con 0x7fe85c0cfe30 2023-10-14T12:18:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 0x7fe85c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 0x7fe85c156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38514/0 (socket says 172.21.15.32:38514) 2023-10-14T12:18:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 -- 172.21.15.32:0/3042186432 learned_addr learned my addr 172.21.15.32:0/3042186432 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85b7fe700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe85c15ab10 0x7fe85c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85a7fc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe85c0cfe30 0x7fe85c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 -- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe85c0cfe30 msgr2=0x7fe85c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe85c0cfe30 0x7fe85c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 -- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe85c15ab10 msgr2=0x7fe85c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe85c15ab10 0x7fe85c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 -- 172.21.15.32:0/3042186432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500094a0 con 0x7fe85c0b1f50 2023-10-14T12:18:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe85affd700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 0x7fe85c156f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8500090b0 tx=0x7fe850004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500036a0 con 0x7fe85c0b1f50 2023-10-14T12:18:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850021070 con 0x7fe85c0b1f50 2023-10-14T12:18:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c0b4ac0 con 0x7fe85c0b1f50 2023-10-14T12:18:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850003a20 con 0x7fe85c0b1f50 2023-10-14T12:18:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.161+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c0c9520 con 0x7fe85c0b1f50 2023-10-14T12:18:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.162+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c0c7260 con 0x7fe85c0b1f50 2023-10-14T12:18:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.162+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe850003b80 con 0x7fe85c0b1f50 2023-10-14T12:18:58.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.162+0000 7fe8437fe700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe84806af00 0x7fe84806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.163+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe850023070 con 0x7fe85c0b1f50 2023-10-14T12:18:58.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.163+0000 7fe85a7fc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe84806af00 0x7fe84806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.163+0000 7fe85a7fc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe84806af00 0x7fe84806d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0c9be0 tx=0x7fe84c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.167+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe850058170 con 0x7fe85c0b1f50 2023-10-14T12:18:58.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.367+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe85c067d20 con 0x7fe85c0b1f50 2023-10-14T12:18:58.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.367+0000 7fe8437fe700 1 -- 172.21.15.32:0/3042186432 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe85005b790 con 0x7fe85c0b1f50 2023-10-14T12:18:58.370 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:18:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe84806af00 msgr2=0x7fe84806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe84806af00 0x7fe84806d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0c9be0 tx=0x7fe84c009040 comp rx=0 tx=0).stop 2023-10-14T12:18:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 msgr2=0x7fe85c156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 0x7fe85c156f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8500090b0 tx=0x7fe850004750 comp rx=0 tx=0).stop 2023-10-14T12:18:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 shutdown_connections 2023-10-14T12:18:58.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe84806af00 0x7fe84806d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe85c15ab10 0x7fe85c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe85c0b1f50 0x7fe85c156f90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 --2- 172.21.15.32:0/3042186432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe85c0cfe30 0x7fe85c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 >> 172.21.15.32:0/3042186432 conn(0x7fe85c06dae0 msgr2=0x7fe85c0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:58.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 shutdown_connections 2023-10-14T12:18:58.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.370+0000 7fe8617dc700 1 -- 172.21.15.32:0/3042186432 wait complete. 2023-10-14T12:18:58.384 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:18:58.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.510+0000 7f8804027700 1 Processor -- start 2023-10-14T12:18:58.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.510+0000 7f8804027700 1 -- start start 2023-10-14T12:18:58.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.511+0000 7f8804027700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc15e2f0 0x7f87fc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.511+0000 7f8804027700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f87fc06a840 0x7f87fc06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.511+0000 7f8804027700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0b2d60 con 0x7f87fc0cd950 2023-10-14T12:18:58.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.511+0000 7f8804027700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc1619a0 con 0x7f87fc06a840 2023-10-14T12:18:58.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.511+0000 7f8804027700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc06b1f0 con 0x7f87fc15e2f0 2023-10-14T12:18:58.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88015c2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc15e2f0 0x7f87fc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88025c4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f87fc06a840 0x7f87fc06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f8801dc3700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f87fc0cd950 0x7f87fc15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54422/0 (socket says 172.21.15.32:54422) 2023-10-14T12:18:58.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f8801dc3700 1 -- 172.21.15.32:0/3854602332 learned_addr learned my addr 172.21.15.32:0/3854602332 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:58.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88015c2700 1 -- 172.21.15.32:0/3854602332 >> v2:172.21.15.92:3300/0 conn(0x7f87fc06a840 msgr2=0x7f87fc06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:58.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88015c2700 1 --2- 172.21.15.32:0/3854602332 >> v2:172.21.15.92:3300/0 conn(0x7f87fc06a840 0x7f87fc06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88015c2700 1 -- 172.21.15.32:0/3854602332 >> v1:172.21.15.92:6789/0 conn(0x7f87fc0cd950 legacy=0x7f87fc15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88015c2700 1 -- 172.21.15.32:0/3854602332 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0cdd30 con 0x7f87fc15e2f0 2023-10-14T12:18:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88025c4700 1 --2- 172.21.15.32:0/3854602332 >> v2:172.21.15.92:3300/0 conn(0x7f87fc06a840 0x7f87fc06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:18:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f88015c2700 1 --2- 172.21.15.32:0/3854602332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc15e2f0 0x7f87fc0cede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009820 tx=0x7f87f8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7c61caf5ff59776 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f8800dc1700 1 -- 172.21.15.32:0/3854602332 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8005e30 con 0x7f87fc15e2f0 2023-10-14T12:18:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f8800dc1700 1 -- 172.21.15.32:0/3854602332 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8006030 con 0x7f87fc15e2f0 2023-10-14T12:18:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.512+0000 7f8800dc1700 1 -- 172.21.15.32:0/3854602332 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80063c0 con 0x7f87fc15e2f0 2023-10-14T12:18:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 -- 172.21.15.32:0/3854602332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc15e2f0 msgr2=0x7f87fc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 --2- 172.21.15.32:0/3854602332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc15e2f0 0x7f87fc0cede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009820 tx=0x7f87f8009b30 comp rx=0 tx=0).stop 2023-10-14T12:18:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 -- 172.21.15.32:0/3854602332 shutdown_connections 2023-10-14T12:18:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 --2- 172.21.15.32:0/3854602332 >> v2:172.21.15.92:3300/0 conn(0x7f87fc06a840 0x7f87fc06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 --2- 172.21.15.32:0/3854602332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc15e2f0 0x7f87fc0cede0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 -- 172.21.15.32:0/3854602332 >> 172.21.15.32:0/3854602332 conn(0x7f87fc06dae0 msgr2=0x7f87fc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:58.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 -- 172.21.15.32:0/3854602332 shutdown_connections 2023-10-14T12:18:58.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.513+0000 7f8804027700 1 -- 172.21.15.32:0/3854602332 wait complete. 2023-10-14T12:18:58.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.514+0000 7f8804027700 1 Processor -- start 2023-10-14T12:18:58.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.514+0000 7f8804027700 1 -- start start 2023-10-14T12:18:58.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8804027700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87fc06a840 0x7f87fc0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8804027700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc0cd950 0x7f87fc151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8804027700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 0x7f87fc0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8804027700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b3080 con 0x7f87fc15e2f0 2023-10-14T12:18:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8804027700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b3ee0 con 0x7f87fc06a840 2023-10-14T12:18:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8804027700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b32d0 con 0x7f87fc0cd950 2023-10-14T12:18:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 0x7f87fc0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 0x7f87fc0c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38532/0 (socket says 172.21.15.32:38532) 2023-10-14T12:18:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 -- 172.21.15.32:0/3587385621 learned_addr learned my addr 172.21.15.32:0/3587385621 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88015c2700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc0cd950 0x7f87fc151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8801dc3700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87fc06a840 0x7f87fc0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 -- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc0cd950 msgr2=0x7f87fc151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc0cd950 0x7f87fc151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 -- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87fc06a840 msgr2=0x7f87fc0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87fc06a840 0x7f87fc0ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f88025c4700 1 -- 172.21.15.32:0/3587385621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4009a70 con 0x7f87fc15e2f0 2023-10-14T12:18:58.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.515+0000 7f8801dc3700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87fc06a840 0x7f87fc0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:58.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.516+0000 7f88025c4700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 0x7f87fc0c8300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009f00 tx=0x7f87f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.516+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4009d70 con 0x7f87fc15e2f0 2023-10-14T12:18:58.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.516+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f400f040 con 0x7f87fc15e2f0 2023-10-14T12:18:58.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.516+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f8009430 con 0x7f87fc15e2f0 2023-10-14T12:18:58.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.516+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4014680 con 0x7f87fc15e2f0 2023-10-14T12:18:58.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.516+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc0b3890 con 0x7f87fc15e2f0 2023-10-14T12:18:58.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.517+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc067d20 con 0x7f87fc15e2f0 2023-10-14T12:18:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.517+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f87f40147e0 con 0x7f87fc15e2f0 2023-10-14T12:18:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.518+0000 7f87f27fc700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f87e006af00 0x7f87e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.518+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87f408a350 con 0x7f87fc15e2f0 2023-10-14T12:18:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.518+0000 7f8801dc3700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f87e006af00 0x7f87e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.518+0000 7f8801dc3700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f87e006af00 0x7f87e006d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87ec007fd0 tx=0x7f87ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.522+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87f4055490 con 0x7f87fc15e2f0 2023-10-14T12:18:58.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.722+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87fc0b4020 con 0x7f87fc15e2f0 2023-10-14T12:18:58.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.723+0000 7f87f27fc700 1 -- 172.21.15.32:0/3587385621 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f4058ab0 con 0x7f87fc15e2f0 2023-10-14T12:18:58.724 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:18:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f87e006af00 msgr2=0x7f87e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f87e006af00 0x7f87e006d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87ec007fd0 tx=0x7f87ec009040 comp rx=0 tx=0).stop 2023-10-14T12:18:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 msgr2=0x7f87fc0c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 0x7f87fc0c8300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009f00 tx=0x7f87f400c3a0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 shutdown_connections 2023-10-14T12:18:58.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87fc15e2f0 0x7f87fc0c8300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f87e006af00 0x7f87e006d3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87fc06a840 0x7f87fc0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 --2- 172.21.15.32:0/3587385621 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87fc0cd950 0x7f87fc151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 >> 172.21.15.32:0/3587385621 conn(0x7f87fc06dae0 msgr2=0x7f87fc1607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:58.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 shutdown_connections 2023-10-14T12:18:58.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.725+0000 7f8804027700 1 -- 172.21.15.32:0/3587385621 wait complete. 2023-10-14T12:18:58.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:18:58.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.861+0000 7f31492f0700 1 Processor -- start 2023-10-14T12:18:58.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31492f0700 1 -- start start 2023-10-14T12:18:58.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31492f0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f314415dce0 0x7f31440d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31492f0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3144161e70 0x7f314415f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31492f0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314415f0d0 con 0x7f31440ceee0 2023-10-14T12:18:58.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31492f0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440cf850 con 0x7f3144161e70 2023-10-14T12:18:58.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31492f0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440d2990 con 0x7f314415dce0 2023-10-14T12:18:58.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31437fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3144161e70 0x7f314415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.862+0000 7f31437fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3144161e70 0x7f314415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38540/0 (socket says 172.21.15.32:38540) 2023-10-14T12:18:58.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f31437fe700 1 -- 172.21.15.32:0/4123448824 learned_addr learned my addr 172.21.15.32:0/4123448824 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:58.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f3142ffd700 1 --2- 172.21.15.32:0/4123448824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f314415dce0 0x7f31440d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f31437fe700 1 -- 172.21.15.32:0/4123448824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f314415dce0 msgr2=0x7f31440d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:58.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f31437fe700 1 --2- 172.21.15.32:0/4123448824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f314415dce0 0x7f31440d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f31437fe700 1 -- 172.21.15.32:0/4123448824 >> v1:172.21.15.92:6789/0 conn(0x7f31440ceee0 legacy=0x7f3144161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:58.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f31437fe700 1 -- 172.21.15.32:0/4123448824 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440d1690 con 0x7f3144161e70 2023-10-14T12:18:58.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f31437fe700 1 --2- 172.21.15.32:0/4123448824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3144161e70 0x7f314415f560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f313c009e50 tx=0x7f313c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4839c7e77200901a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f3141ffb700 1 -- 172.21.15.32:0/4123448824 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00e070 con 0x7f3144161e70 2023-10-14T12:18:58.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f3141ffb700 1 -- 172.21.15.32:0/4123448824 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c003a20 con 0x7f3144161e70 2023-10-14T12:18:58.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.863+0000 7f3141ffb700 1 -- 172.21.15.32:0/4123448824 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c003dd0 con 0x7f3144161e70 2023-10-14T12:18:58.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 -- 172.21.15.32:0/4123448824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3144161e70 msgr2=0x7f314415f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 --2- 172.21.15.32:0/4123448824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3144161e70 0x7f314415f560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f313c009e50 tx=0x7f313c00b330 comp rx=0 tx=0).stop 2023-10-14T12:18:58.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 -- 172.21.15.32:0/4123448824 shutdown_connections 2023-10-14T12:18:58.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 --2- 172.21.15.32:0/4123448824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3144161e70 0x7f314415f560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 --2- 172.21.15.32:0/4123448824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f314415dce0 0x7f31440d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 -- 172.21.15.32:0/4123448824 >> 172.21.15.32:0/4123448824 conn(0x7f314409ca80 msgr2=0x7f31440d37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:58.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 -- 172.21.15.32:0/4123448824 shutdown_connections 2023-10-14T12:18:58.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.864+0000 7f31492f0700 1 -- 172.21.15.32:0/4123448824 wait complete. 2023-10-14T12:18:58.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.865+0000 7f31492f0700 1 Processor -- start 2023-10-14T12:18:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 -- start start 2023-10-14T12:18:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 0x7f314409dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314415dce0 0x7f314409fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3144161e70 0x7f31440a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440a08c0 con 0x7f31440ceee0 2023-10-14T12:18:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440a0ba0 con 0x7f314415dce0 2023-10-14T12:18:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.866+0000 7f31492f0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440a0e80 con 0x7f3144161e70 2023-10-14T12:18:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 0x7f314409dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 0x7f314409dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38542/0 (socket says 172.21.15.32:38542) 2023-10-14T12:18:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 -- 172.21.15.32:0/2557287036 learned_addr learned my addr 172.21.15.32:0/2557287036 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f31427fc700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314415dce0 0x7f314409fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f31437fe700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3144161e70 0x7f31440a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 -- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3144161e70 msgr2=0x7f31440a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3144161e70 0x7f31440a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 -- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314415dce0 msgr2=0x7f314409fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314415dce0 0x7f314409fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 -- 172.21.15.32:0/2557287036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009b30 con 0x7f31440ceee0 2023-10-14T12:18:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f31427fc700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314415dce0 0x7f314409fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f31437fe700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3144161e70 0x7f31440a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:18:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f3142ffd700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 0x7f314409dfa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f313800d7d0 tx=0x7f313800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380125f0 con 0x7f31440ceee0 2023-10-14T12:18:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440a1160 con 0x7f31440ceee0 2023-10-14T12:18:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138012750 con 0x7f31440ceee0 2023-10-14T12:18:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31441f3550 con 0x7f31440ceee0 2023-10-14T12:18:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.867+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138012ac0 con 0x7f31440ceee0 2023-10-14T12:18:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.868+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31440cbc40 con 0x7f31440ceee0 2023-10-14T12:18:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.868+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3138012c20 con 0x7f31440ceee0 2023-10-14T12:18:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.869+0000 7f312b7fe700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f313006af00 0x7f313006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.869+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3138089920 con 0x7f31440ceee0 2023-10-14T12:18:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.869+0000 7f31427fc700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f313006af00 0x7f313006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.870+0000 7f31427fc700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f313006af00 0x7f313006d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f314415d6d0 tx=0x7f3134008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:58.873+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3138054950 con 0x7f31440ceee0 2023-10-14T12:18:59.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.116+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f314404ebb0 con 0x7f31440ceee0 2023-10-14T12:18:59.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.117+0000 7f312b7fe700 1 -- 172.21.15.32:0/2557287036 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f3138012ed0 con 0x7f31440ceee0 2023-10-14T12:18:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:59.119 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:18:59.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f313006af00 msgr2=0x7f313006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f313006af00 0x7f313006d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f314415d6d0 tx=0x7f3134008040 comp rx=0 tx=0).stop 2023-10-14T12:18:59.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 msgr2=0x7f314409dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 0x7f314409dfa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f313800d7d0 tx=0x7f313800db90 comp rx=0 tx=0).stop 2023-10-14T12:18:59.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 shutdown_connections 2023-10-14T12:18:59.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3144161e70 0x7f31440a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31440ceee0 0x7f314409dfa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f313006af00 0x7f313006d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 --2- 172.21.15.32:0/2557287036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314415dce0 0x7f314409fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 >> 172.21.15.32:0/2557287036 conn(0x7f314409ca80 msgr2=0x7f31440d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:59.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 shutdown_connections 2023-10-14T12:18:59.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.119+0000 7f31492f0700 1 -- 172.21.15.32:0/2557287036 wait complete. 2023-10-14T12:18:59.124 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:18:59.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:18:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.260+0000 7f9c3971b700 1 Processor -- start 2023-10-14T12:18:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.260+0000 7f9c3971b700 1 -- start start 2023-10-14T12:18:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c3971b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c340b7050 0x7f9c3415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c3971b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3415e4e0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c3971b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c340d28e0 con 0x7f9c340d3fc0 2023-10-14T12:18:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c3971b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c340b7560 con 0x7f9c340b7050 2023-10-14T12:18:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c32ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9c3415dbc0 0x7f9c340d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55574/0 (socket says 172.21.15.32:55574) 2023-10-14T12:18:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c32ffd700 1 -- 172.21.15.32:0/1645164177 learned_addr learned my addr 172.21.15.32:0/1645164177 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c337fe700 1 --2- 172.21.15.32:0/1645164177 >> v2:172.21.15.32:3300/0 conn(0x7f9c340b7050 0x7f9c3415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c31ffb700 1 -- 172.21.15.32:0/1645164177 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662381316 0 0) 0x7f9c3415e4e0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c31ffb700 1 -- 172.21.15.32:0/1645164177 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1c0035b0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c337fe700 1 -- 172.21.15.32:0/1645164177 >> v1:172.21.15.92:6789/0 conn(0x7f9c340d3fc0 legacy=0x7f9c340d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c337fe700 1 -- 172.21.15.32:0/1645164177 >> v1:172.21.15.32:6789/0 conn(0x7f9c3415dbc0 legacy=0x7f9c340d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c337fe700 1 -- 172.21.15.32:0/1645164177 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340b7840 con 0x7f9c340b7050 2023-10-14T12:18:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.261+0000 7f9c337fe700 1 --2- 172.21.15.32:0/1645164177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c340b7050 0x7f9c3415dfa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009d90 tx=0x7f9c2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60ea6da7fa0c22f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c31ffb700 1 -- 172.21.15.32:0/1645164177 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00e070 con 0x7f9c340b7050 2023-10-14T12:18:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c31ffb700 1 -- 172.21.15.32:0/1645164177 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c00bb20 con 0x7f9c340b7050 2023-10-14T12:18:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c31ffb700 1 -- 172.21.15.32:0/1645164177 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c012430 con 0x7f9c340b7050 2023-10-14T12:18:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 -- 172.21.15.32:0/1645164177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c340b7050 msgr2=0x7f9c3415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 --2- 172.21.15.32:0/1645164177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c340b7050 0x7f9c3415dfa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009d90 tx=0x7f9c2c00b330 comp rx=0 tx=0).stop 2023-10-14T12:18:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 -- 172.21.15.32:0/1645164177 shutdown_connections 2023-10-14T12:18:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 --2- 172.21.15.32:0/1645164177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c340b7050 0x7f9c3415dfa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 -- 172.21.15.32:0/1645164177 >> 172.21.15.32:0/1645164177 conn(0x7f9c3409cb40 msgr2=0x7f9c340d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 -- 172.21.15.32:0/1645164177 shutdown_connections 2023-10-14T12:18:59.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.262+0000 7f9c3971b700 1 -- 172.21.15.32:0/1645164177 wait complete. 2023-10-14T12:18:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.264+0000 7f9c3971b700 1 Processor -- start 2023-10-14T12:18:59.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.264+0000 7f9c3971b700 1 -- start start 2023-10-14T12:18:59.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c3971b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c340b7050 0x7f9c3414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c3971b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340d3fc0 0x7f9c34148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c3971b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 0x7f9c3414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c3971b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34148f40 con 0x7f9c3415dbc0 2023-10-14T12:18:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c3971b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c341491e0 con 0x7f9c340b7050 2023-10-14T12:18:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c3971b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c341494c0 con 0x7f9c340d3fc0 2023-10-14T12:18:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 0x7f9c3414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 0x7f9c3414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38560/0 (socket says 172.21.15.32:38560) 2023-10-14T12:18:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 -- 172.21.15.32:0/3777414518 learned_addr learned my addr 172.21.15.32:0/3777414518 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c32ffd700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c340b7050 0x7f9c3414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c327fc700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340d3fc0 0x7f9c34148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 -- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340d3fc0 msgr2=0x7f9c34148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340d3fc0 0x7f9c34148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 -- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c340b7050 msgr2=0x7f9c3414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c340b7050 0x7f9c3414b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 -- 172.21.15.32:0/3777414518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009a70 con 0x7f9c3415dbc0 2023-10-14T12:18:59.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.265+0000 7f9c337fe700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 0x7f9c3414a280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c3406b4b0 tx=0x7f9c2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.266+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c012430 con 0x7f9c3415dbc0 2023-10-14T12:18:59.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.266+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c020070 con 0x7f9c3415dbc0 2023-10-14T12:18:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.266+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c341497a0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.266+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c004280 con 0x7f9c3415dbc0 2023-10-14T12:18:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.266+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34149d60 con 0x7f9c3415dbc0 2023-10-14T12:18:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.267+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3404ebb0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.268+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c2c0043e0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.268+0000 7f9c1b7fe700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c2006af00 0x7f9c2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.268+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c2c022070 con 0x7f9c3415dbc0 2023-10-14T12:18:59.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.268+0000 7f9c32ffd700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c2006af00 0x7f9c2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.269+0000 7f9c32ffd700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c2006af00 0x7f9c2006d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9c280010e0 tx=0x7f9c28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.272+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c2c056bc0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.475+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c34149ef0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.476+0000 7f9c1b7fe700 1 -- 172.21.15.32:0/3777414518 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f9c2c05a1e0 con 0x7f9c3415dbc0 2023-10-14T12:18:59.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:18:59.478 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:18:59.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c2006af00 msgr2=0x7f9c2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c2006af00 0x7f9c2006d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9c280010e0 tx=0x7f9c28009040 comp rx=0 tx=0).stop 2023-10-14T12:18:59.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 msgr2=0x7f9c3414a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 0x7f9c3414a280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c3406b4b0 tx=0x7f9c2c004ad0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 shutdown_connections 2023-10-14T12:18:59.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c3415dbc0 0x7f9c3414a280 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c2006af00 0x7f9c2006d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c340b7050 0x7f9c3414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 --2- 172.21.15.32:0/3777414518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340d3fc0 0x7f9c34148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 >> 172.21.15.32:0/3777414518 conn(0x7f9c3409cb40 msgr2=0x7f9c3415ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:59.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 shutdown_connections 2023-10-14T12:18:59.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.479+0000 7f9c3971b700 1 -- 172.21.15.32:0/3777414518 wait complete. 2023-10-14T12:18:59.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:18:59.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:18:59.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.620+0000 7fb0c779c700 1 Processor -- start 2023-10-14T12:18:59.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.620+0000 7fb0c779c700 1 -- start start 2023-10-14T12:18:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c779c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c779c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb0c00d3fc0 0x7fb0c00d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c779c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0c00b7050 0x7fb0c00d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c779c700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c015e4e0 con 0x7fb0c00b7050 2023-10-14T12:18:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c779c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c00b7560 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c779c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00b7840 con 0x7fb0c015dbc0 2023-10-14T12:18:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0c00b7050 0x7fb0c00d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0c00b7050 0x7fb0c00d2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38568/0 (socket says 172.21.15.32:38568) 2023-10-14T12:18:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 -- 172.21.15.32:0/3049983873 learned_addr learned my addr 172.21.15.32:0/3049983873 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5538700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c4d37700 1 --2- 172.21.15.32:0/3049983873 >> v2:172.21.15.92:3300/0 conn(0x7fb0c00d3fc0 0x7fb0c00d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 -- 172.21.15.32:0/3049983873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 msgr2=0x7fb0c015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:59.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 -- 172.21.15.32:0/3049983873 >> v2:172.21.15.92:3300/0 conn(0x7fb0c00d3fc0 msgr2=0x7fb0c00d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:59.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 --2- 172.21.15.32:0/3049983873 >> v2:172.21.15.92:3300/0 conn(0x7fb0c00d3fc0 0x7fb0c00d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 -- 172.21.15.32:0/3049983873 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c00b7b20 con 0x7fb0c00b7050 2023-10-14T12:18:59.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5538700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:18:59.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0c5d39700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00b7050 0x7fb0c00d2000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00d13f0 tx=0x7fb0b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff9dd759a936ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.621+0000 7fb0b7fff700 1 -- 172.21.15.32:0/3049983873 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800e070 con 0x7fb0c00b7050 2023-10-14T12:18:59.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0b7fff700 1 -- 172.21.15.32:0/3049983873 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b800b9c0 con 0x7fb0c00b7050 2023-10-14T12:18:59.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0b7fff700 1 -- 172.21.15.32:0/3049983873 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800bd70 con 0x7fb0c00b7050 2023-10-14T12:18:59.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 -- 172.21.15.32:0/3049983873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00b7050 msgr2=0x7fb0c00d2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00b7050 0x7fb0c00d2000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00d13f0 tx=0x7fb0b800b330 comp rx=0 tx=0).stop 2023-10-14T12:18:59.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 -- 172.21.15.32:0/3049983873 shutdown_connections 2023-10-14T12:18:59.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00b7050 0x7fb0c00d2000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3049983873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3049983873 >> v2:172.21.15.92:3300/0 conn(0x7fb0c00d3fc0 0x7fb0c00d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 -- 172.21.15.32:0/3049983873 >> 172.21.15.32:0/3049983873 conn(0x7fb0c009cb40 msgr2=0x7fb0c00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 -- 172.21.15.32:0/3049983873 shutdown_connections 2023-10-14T12:18:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.622+0000 7fb0c779c700 1 -- 172.21.15.32:0/3049983873 wait complete. 2023-10-14T12:18:59.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.624+0000 7fb0c779c700 1 Processor -- start 2023-10-14T12:18:59.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.624+0000 7fb0c779c700 1 -- start start 2023-10-14T12:18:59.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c779c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0c00b7050 0x7fb0c0159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c779c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 0x7fb0c009f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c779c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c009f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c779c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c015a010 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c779c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c009d630 con 0x7fb0c00b7050 2023-10-14T12:18:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c779c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c015ada0 con 0x7fb0c015dbc0 2023-10-14T12:18:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 0x7fb0c009f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 0x7fb0c009f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38572/0 (socket says 172.21.15.32:38572) 2023-10-14T12:18:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 -- 172.21.15.32:0/3776528344 learned_addr learned my addr 172.21.15.32:0/3776528344 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c5538700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0c00b7050 0x7fb0c0159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c5d39700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c009f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 -- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 msgr2=0x7fb0c009f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c009f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 -- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0c00b7050 msgr2=0x7fb0c0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0c00b7050 0x7fb0c0159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 -- 172.21.15.32:0/3776528344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8009b30 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0c4d37700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 0x7fb0c009f080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000e810 tx=0x7fb0b000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.625+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000c070 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.626+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0013610 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.626+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c015b080 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.626+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00139a0 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.626+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c00cd8e0 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.627+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c015b5a0 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.627+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0b0013b00 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.627+0000 7fb0b5ffb700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb0a406af00 0x7fb0a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.628+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0b0089290 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.628+0000 7fb0c5538700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb0a406af00 0x7fb0a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.628+0000 7fb0c5538700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb0a406af00 0x7fb0a406d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c960 tx=0x7fb0bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.632+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0b0054340 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.829+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0c004ebb0 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.830+0000 7fb0b5ffb700 1 -- 172.21.15.32:0/3776528344 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0b0009440 con 0x7fb0c00d3fc0 2023-10-14T12:18:59.831 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:18:59.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.831+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb0a406af00 msgr2=0x7fb0a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.831+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb0a406af00 0x7fb0a406d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c960 tx=0x7fb0bc008040 comp rx=0 tx=0).stop 2023-10-14T12:18:59.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.831+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 msgr2=0x7fb0c009f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.831+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 0x7fb0c009f080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000e810 tx=0x7fb0b000eb20 comp rx=0 tx=0).stop 2023-10-14T12:18:59.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 shutdown_connections 2023-10-14T12:18:59.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb0c015dbc0 0x7fb0c009f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb0a406af00 0x7fb0a406d3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0c00b7050 0x7fb0c0159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 --2- 172.21.15.32:0/3776528344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0c00d3fc0 0x7fb0c009f080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 >> 172.21.15.32:0/3776528344 conn(0x7fb0c009cb40 msgr2=0x7fb0c015cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 shutdown_connections 2023-10-14T12:18:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.832+0000 7fb0c779c700 1 -- 172.21.15.32:0/3776528344 wait complete. 2023-10-14T12:18:59.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:18:59.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.972+0000 7fca2f7de700 1 Processor -- start 2023-10-14T12:18:59.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.972+0000 7fca2f7de700 1 -- start start 2023-10-14T12:18:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.972+0000 7fca2f7de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca2815ab10 0x7fca2815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2f7de700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca280cfe30 0x7fca280cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2f7de700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2815e7a0 con 0x7fca280b1f50 2023-10-14T12:18:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2f7de700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2815f730 con 0x7fca280cfe30 2023-10-14T12:18:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2f7de700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca280b29a0 con 0x7fca2815ab10 2023-10-14T12:18:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2cd79700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fca280b1f50 0x7fca280cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55602/0 (socket says 172.21.15.32:55602) 2023-10-14T12:18:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2cd79700 1 -- 172.21.15.32:0/774800168 learned_addr learned my addr 172.21.15.32:0/774800168 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:18:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2dd7b700 1 --2- 172.21.15.32:0/774800168 >> v2:172.21.15.32:3300/0 conn(0x7fca280cfe30 0x7fca280cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2d57a700 1 --2- 172.21.15.32:0/774800168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca2815ab10 0x7fca2815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2dd7b700 1 -- 172.21.15.32:0/774800168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca2815ab10 msgr2=0x7fca2815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:18:59.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2dd7b700 1 --2- 172.21.15.32:0/774800168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca2815ab10 0x7fca2815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2dd7b700 1 -- 172.21.15.32:0/774800168 >> v1:172.21.15.32:6789/0 conn(0x7fca280b1f50 legacy=0x7fca280cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca1ffff700 1 -- 172.21.15.32:0/774800168 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808117194 0 0) 0x7fca2815e7a0 con 0x7fca280b1f50 2023-10-14T12:18:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2dd7b700 1 -- 172.21.15.32:0/774800168 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280b2c80 con 0x7fca280cfe30 2023-10-14T12:18:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca2dd7b700 1 --2- 172.21.15.32:0/774800168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca280cfe30 0x7fca280cbf40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca20009d90 tx=0x7fca2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954a3ca7a481a398 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca1ffff700 1 -- 172.21.15.32:0/774800168 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000e070 con 0x7fca280cfe30 2023-10-14T12:18:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca1ffff700 1 -- 172.21.15.32:0/774800168 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000bbd0 con 0x7fca280cfe30 2023-10-14T12:18:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.973+0000 7fca1ffff700 1 -- 172.21.15.32:0/774800168 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20012430 con 0x7fca280cfe30 2023-10-14T12:18:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 -- 172.21.15.32:0/774800168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca280cfe30 msgr2=0x7fca280cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 --2- 172.21.15.32:0/774800168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca280cfe30 0x7fca280cbf40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca20009d90 tx=0x7fca2000b330 comp rx=0 tx=0).stop 2023-10-14T12:18:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 -- 172.21.15.32:0/774800168 shutdown_connections 2023-10-14T12:18:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 --2- 172.21.15.32:0/774800168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca280cfe30 0x7fca280cbf40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 --2- 172.21.15.32:0/774800168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca2815ab10 0x7fca2815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 -- 172.21.15.32:0/774800168 >> 172.21.15.32:0/774800168 conn(0x7fca2806dae0 msgr2=0x7fca2806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:18:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 -- 172.21.15.32:0/774800168 shutdown_connections 2023-10-14T12:18:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.974+0000 7fca2f7de700 1 -- 172.21.15.32:0/774800168 wait complete. 2023-10-14T12:18:59.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.975+0000 7fca2f7de700 1 Processor -- start 2023-10-14T12:18:59.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.975+0000 7fca2f7de700 1 -- start start 2023-10-14T12:18:59.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2f7de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca280b1f50 0x7fca2814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2f7de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca280cfe30 0x7fca280b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2f7de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 0x7fca280b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2f7de700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2814ebf0 con 0x7fca2815ab10 2023-10-14T12:18:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2f7de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2815cc80 con 0x7fca280cfe30 2023-10-14T12:18:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2f7de700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2815ced0 con 0x7fca280b1f50 2023-10-14T12:18:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 0x7fca280b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 0x7fca280b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38586/0 (socket says 172.21.15.32:38586) 2023-10-14T12:18:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 -- 172.21.15.32:0/4294819903 learned_addr learned my addr 172.21.15.32:0/4294819903 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:18:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2d57a700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca280b1f50 0x7fca2814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2cd79700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca280cfe30 0x7fca280b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 -- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca280b1f50 msgr2=0x7fca2814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca280b1f50 0x7fca2814e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 -- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca280cfe30 msgr2=0x7fca280b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:18:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca280cfe30 0x7fca280b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:18:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.976+0000 7fca2dd7b700 1 -- 172.21.15.32:0/4294819903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009a70 con 0x7fca2815ab10 2023-10-14T12:18:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.977+0000 7fca2dd7b700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 0x7fca280b1380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca20013000 tx=0x7fca20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.977+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20012430 con 0x7fca2815ab10 2023-10-14T12:18:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.977+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20020070 con 0x7fca2815ab10 2023-10-14T12:18:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.977+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2815d1b0 con 0x7fca2815ab10 2023-10-14T12:18:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.977+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20004280 con 0x7fca2815ab10 2023-10-14T12:18:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.977+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2815d770 con 0x7fca2815ab10 2023-10-14T12:18:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.978+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca28067d20 con 0x7fca2815ab10 2023-10-14T12:18:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.978+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca200043e0 con 0x7fca2815ab10 2023-10-14T12:18:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.979+0000 7fca1dffb700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca0c06af00 0x7fca0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:18:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.979+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca20022070 con 0x7fca2815ab10 2023-10-14T12:18:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.979+0000 7fca2d57a700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca0c06af00 0x7fca0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:18:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.979+0000 7fca2d57a700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca0c06af00 0x7fca0c06d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca280c5490 tx=0x7fca18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:18:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:18:59.983+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca20056a10 con 0x7fca2815ab10 2023-10-14T12:19:00.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.184+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca280afc10 con 0x7fca2815ab10 2023-10-14T12:19:00.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.184+0000 7fca1dffb700 1 -- 172.21.15.32:0/4294819903 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca2005a030 con 0x7fca2815ab10 2023-10-14T12:19:00.186 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:00.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca0c06af00 msgr2=0x7fca0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca0c06af00 0x7fca0c06d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca280c5490 tx=0x7fca18008040 comp rx=0 tx=0).stop 2023-10-14T12:19:00.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 msgr2=0x7fca280b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 0x7fca280b1380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca20013000 tx=0x7fca20004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 shutdown_connections 2023-10-14T12:19:00.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2815ab10 0x7fca280b1380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca280b1f50 0x7fca2814e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca0c06af00 0x7fca0c06d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 --2- 172.21.15.32:0/4294819903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca280cfe30 0x7fca280b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 >> 172.21.15.32:0/4294819903 conn(0x7fca2806dae0 msgr2=0x7fca28158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:00.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 shutdown_connections 2023-10-14T12:19:00.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.187+0000 7fca2f7de700 1 -- 172.21.15.32:0/4294819903 wait complete. 2023-10-14T12:19:00.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:00.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.327+0000 7f2d493bf700 1 Processor -- start 2023-10-14T12:19:00.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.327+0000 7f2d493bf700 1 -- start start 2023-10-14T12:19:00.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d493bf700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2d4415dbc0 0x7f2d4415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d493bf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2d440b7050 0x7f2d440d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d493bf700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4415e4e0 con 0x7f2d440d3fc0 2023-10-14T12:19:00.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d493bf700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440b7560 con 0x7f2d4415dbc0 2023-10-14T12:19:00.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d493bf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440b7840 con 0x7f2d440b7050 2023-10-14T12:19:00.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d42ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2d4415dbc0 0x7f2d4415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d42ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2d4415dbc0 0x7f2d4415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38590/0 (socket says 172.21.15.32:38590) 2023-10-14T12:19:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3077564787 learned_addr learned my addr 172.21.15.32:0/3077564787 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d437fe700 1 --2- 172.21.15.32:0/3077564787 >> v2:172.21.15.92:3300/0 conn(0x7f2d440b7050 0x7f2d440d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3077564787 >> v2:172.21.15.92:3300/0 conn(0x7f2d440b7050 msgr2=0x7f2d440d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.328+0000 7f2d42ffd700 1 --2- 172.21.15.32:0/3077564787 >> v2:172.21.15.92:3300/0 conn(0x7f2d440b7050 0x7f2d440d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3077564787 >> v1:172.21.15.92:6789/0 conn(0x7f2d440d3fc0 legacy=0x7f2d440d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3077564787 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440b7b20 con 0x7f2d4415dbc0 2023-10-14T12:19:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d42ffd700 1 --2- 172.21.15.32:0/3077564787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d4415dbc0 0x7f2d4415dfa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d440cdea0 tx=0x7f2d38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfad582a5c431af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d41ffb700 1 -- 172.21.15.32:0/3077564787 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38005e30 con 0x7f2d4415dbc0 2023-10-14T12:19:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d41ffb700 1 -- 172.21.15.32:0/3077564787 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38004030 con 0x7f2d4415dbc0 2023-10-14T12:19:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d41ffb700 1 -- 172.21.15.32:0/3077564787 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380043e0 con 0x7f2d4415dbc0 2023-10-14T12:19:00.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 -- 172.21.15.32:0/3077564787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d4415dbc0 msgr2=0x7f2d4415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 --2- 172.21.15.32:0/3077564787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d4415dbc0 0x7f2d4415dfa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d440cdea0 tx=0x7f2d38009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 -- 172.21.15.32:0/3077564787 shutdown_connections 2023-10-14T12:19:00.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 --2- 172.21.15.32:0/3077564787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d4415dbc0 0x7f2d4415dfa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 --2- 172.21.15.32:0/3077564787 >> v2:172.21.15.92:3300/0 conn(0x7f2d440b7050 0x7f2d440d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 -- 172.21.15.32:0/3077564787 >> 172.21.15.32:0/3077564787 conn(0x7f2d4409cb40 msgr2=0x7f2d440d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:00.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 -- 172.21.15.32:0/3077564787 shutdown_connections 2023-10-14T12:19:00.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.329+0000 7f2d493bf700 1 -- 172.21.15.32:0/3077564787 wait complete. 2023-10-14T12:19:00.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 Processor -- start 2023-10-14T12:19:00.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 -- start start 2023-10-14T12:19:00.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 0x7f2d441f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d440d3fc0 0x7f2d440cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4415dbc0 0x7f2d440ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441f40c0 con 0x7f2d440b7050 2023-10-14T12:19:00.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441f3540 con 0x7f2d4415dbc0 2023-10-14T12:19:00.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.331+0000 7f2d493bf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441f3820 con 0x7f2d440d3fc0 2023-10-14T12:19:00.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 0x7f2d441f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 0x7f2d441f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38594/0 (socket says 172.21.15.32:38594) 2023-10-14T12:19:00.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 -- 172.21.15.32:0/2460082673 learned_addr learned my addr 172.21.15.32:0/2460082673 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:00.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d437fe700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4415dbc0 0x7f2d440ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d427fc700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d440d3fc0 0x7f2d440cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 -- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d440d3fc0 msgr2=0x7f2d440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d440d3fc0 0x7f2d440cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 -- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4415dbc0 msgr2=0x7f2d440ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4415dbc0 0x7f2d440ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 -- 172.21.15.32:0/2460082673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38009500 con 0x7f2d440b7050 2023-10-14T12:19:00.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d42ffd700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 0x7f2d441f2f10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009130 tx=0x7f2d38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:00.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38003c70 con 0x7f2d440b7050 2023-10-14T12:19:00.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38003dd0 con 0x7f2d440b7050 2023-10-14T12:19:00.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d441f3b00 con 0x7f2d440b7050 2023-10-14T12:19:00.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011660 con 0x7f2d440b7050 2023-10-14T12:19:00.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.332+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d440cc910 con 0x7f2d440b7050 2023-10-14T12:19:00.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.333+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404ebb0 con 0x7f2d440b7050 2023-10-14T12:19:00.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.334+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d380117c0 con 0x7f2d440b7050 2023-10-14T12:19:00.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.334+0000 7f2d2b7fe700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2d3006af00 0x7f2d3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.334+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d3808a790 con 0x7f2d440b7050 2023-10-14T12:19:00.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.334+0000 7f2d427fc700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2d3006af00 0x7f2d3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.335+0000 7f2d427fc700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2d3006af00 0x7f2d3006d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406d860 tx=0x7f2d34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:00.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.339+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d380559f0 con 0x7f2d440b7050 2023-10-14T12:19:00.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.539+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d440cbd50 con 0x7f2d440b7050 2023-10-14T12:19:00.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.540+0000 7f2d2b7fe700 1 -- 172.21.15.32:0/2460082673 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d38059010 con 0x7f2d440b7050 2023-10-14T12:19:00.541 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:00.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2d3006af00 msgr2=0x7f2d3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2d3006af00 0x7f2d3006d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406d860 tx=0x7f2d34009040 comp rx=0 tx=0).stop 2023-10-14T12:19:00.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 msgr2=0x7f2d441f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 0x7f2d441f2f10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009130 tx=0x7f2d38004750 comp rx=0 tx=0).stop 2023-10-14T12:19:00.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 shutdown_connections 2023-10-14T12:19:00.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2d3006af00 0x7f2d3006d3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4415dbc0 0x7f2d440ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440b7050 0x7f2d441f2f10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 --2- 172.21.15.32:0/2460082673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d440d3fc0 0x7f2d440cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 >> 172.21.15.32:0/2460082673 conn(0x7f2d4409cb40 msgr2=0x7f2d440b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:00.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 shutdown_connections 2023-10-14T12:19:00.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.542+0000 7f2d493bf700 1 -- 172.21.15.32:0/2460082673 wait complete. 2023-10-14T12:19:00.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:00.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.678+0000 7f3b8e5b6700 1 Processor -- start 2023-10-14T12:19:00.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b8e5b6700 1 -- start start 2023-10-14T12:19:00.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b8e5b6700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b8815eab0 0x7f3b880cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b8e5b6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b880d1d90 0x7f3b880cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b8e5b6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8815ee90 con 0x7f3b880cf6d0 2023-10-14T12:19:00.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b8e5b6700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b880d21c0 con 0x7f3b8815eab0 2023-10-14T12:19:00.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b8e5b6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880cfb60 con 0x7f3b880d1d90 2023-10-14T12:19:00.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.679+0000 7f3b87fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b8815eab0 0x7f3b880cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b8815eab0 0x7f3b880cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38602/0 (socket says 172.21.15.32:38602) 2023-10-14T12:19:00.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 -- 172.21.15.32:0/2924113795 learned_addr learned my addr 172.21.15.32:0/2924113795 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:00.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b8cb53700 1 --2- 172.21.15.32:0/2924113795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b880d1d90 0x7f3b880cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 -- 172.21.15.32:0/2924113795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b880d1d90 msgr2=0x7f3b880cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:00.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 --2- 172.21.15.32:0/2924113795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b880d1d90 0x7f3b880cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 -- 172.21.15.32:0/2924113795 >> v1:172.21.15.92:6789/0 conn(0x7f3b880cf6d0 legacy=0x7f3b880d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 -- 172.21.15.32:0/2924113795 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88158370 con 0x7f3b8815eab0 2023-10-14T12:19:00.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b87fff700 1 --2- 172.21.15.32:0/2924113795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8815eab0 0x7f3b880cf190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b780098f0 tx=0x7f3b78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c7c983dbdf88ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:00.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b86ffd700 1 -- 172.21.15.32:0/2924113795 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78011830 con 0x7f3b8815eab0 2023-10-14T12:19:00.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b86ffd700 1 -- 172.21.15.32:0/2924113795 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78011990 con 0x7f3b8815eab0 2023-10-14T12:19:00.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.680+0000 7f3b86ffd700 1 -- 172.21.15.32:0/2924113795 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78011d20 con 0x7f3b8815eab0 2023-10-14T12:19:00.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/2924113795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8815eab0 msgr2=0x7f3b880cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/2924113795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8815eab0 0x7f3b880cf190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b780098f0 tx=0x7f3b78009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:00.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/2924113795 shutdown_connections 2023-10-14T12:19:00.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/2924113795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b880d1d90 0x7f3b880cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/2924113795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8815eab0 0x7f3b880cf190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/2924113795 >> 172.21.15.32:0/2924113795 conn(0x7f3b880665a0 msgr2=0x7f3b88066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:00.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/2924113795 shutdown_connections 2023-10-14T12:19:00.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.681+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/2924113795 wait complete. 2023-10-14T12:19:00.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.682+0000 7f3b8e5b6700 1 Processor -- start 2023-10-14T12:19:00.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.682+0000 7f3b8e5b6700 1 -- start start 2023-10-14T12:19:00.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8e5b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b880cf6d0 0x7f3b88161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8e5b6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 0x7f3b881f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8e5b6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b8815eab0 0x7f3b880c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8e5b6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88162090 con 0x7f3b880d1d90 2023-10-14T12:19:00.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8e5b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c7ce0 con 0x7f3b880cf6d0 2023-10-14T12:19:00.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8e5b6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c5520 con 0x7f3b8815eab0 2023-10-14T12:19:00.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 0x7f3b881f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 0x7f3b881f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38610/0 (socket says 172.21.15.32:38610) 2023-10-14T12:19:00.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 -- 172.21.15.32:0/3675618966 learned_addr learned my addr 172.21.15.32:0/3675618966 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:00.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b87fff700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b880cf6d0 0x7f3b88161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8cb53700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b8815eab0 0x7f3b880c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 -- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b8815eab0 msgr2=0x7f3b880c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b8815eab0 0x7f3b880c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 -- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b880cf6d0 msgr2=0x7f3b88161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b880cf6d0 0x7f3b88161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 -- 172.21.15.32:0/3675618966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009550 con 0x7f3b880d1d90 2023-10-14T12:19:00.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b8cb53700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b8815eab0 0x7f3b880c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:00.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.683+0000 7f3b877fe700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 0x7f3b881f2c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c450 tx=0x7f3b7c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:00.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.684+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0052d0 con 0x7f3b880d1d90 2023-10-14T12:19:00.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.684+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c005430 con 0x7f3b880d1d90 2023-10-14T12:19:00.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.684+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0038c0 con 0x7f3b880d1d90 2023-10-14T12:19:00.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.684+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b880c5800 con 0x7f3b880d1d90 2023-10-14T12:19:00.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.684+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b880c5dc0 con 0x7f3b880d1d90 2023-10-14T12:19:00.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.684+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b88067d20 con 0x7f3b880d1d90 2023-10-14T12:19:00.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.685+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b7c003a20 con 0x7f3b880d1d90 2023-10-14T12:19:00.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.685+0000 7f3b84ff9700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b7406af00 0x7f3b7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:00.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.686+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b7c0889d0 con 0x7f3b880d1d90 2023-10-14T12:19:00.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.686+0000 7f3b87fff700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b7406af00 0x7f3b7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:00.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.686+0000 7f3b87fff700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b7406af00 0x7f3b7406d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009c40 tx=0x7f3b78008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:00.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.690+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b7c0539e0 con 0x7f3b880d1d90 2023-10-14T12:19:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.935+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b880b3d70 con 0x7f3b880d1d90 2023-10-14T12:19:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.935+0000 7f3b84ff9700 1 -- 172.21.15.32:0/3675618966 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f3b7c017090 con 0x7f3b880d1d90 2023-10-14T12:19:00.937 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:00.937 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:19:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b7406af00 msgr2=0x7f3b7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b7406af00 0x7f3b7406d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009c40 tx=0x7f3b78008030 comp rx=0 tx=0).stop 2023-10-14T12:19:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 msgr2=0x7f3b881f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 0x7f3b881f2c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c450 tx=0x7f3b7c00c760 comp rx=0 tx=0).stop 2023-10-14T12:19:00.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 shutdown_connections 2023-10-14T12:19:00.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b8815eab0 0x7f3b880c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b7406af00 0x7f3b7406d3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b880cf6d0 0x7f3b88161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 --2- 172.21.15.32:0/3675618966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b880d1d90 0x7f3b881f2c40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:00.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 >> 172.21.15.32:0/3675618966 conn(0x7f3b880665a0 msgr2=0x7f3b8806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:00.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 shutdown_connections 2023-10-14T12:19:00.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:00.938+0000 7f3b8e5b6700 1 -- 172.21.15.32:0/3675618966 wait complete. 2023-10-14T12:19:00.942 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:19:00.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.075+0000 7efeaa91f700 1 Processor -- start 2023-10-14T12:19:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.075+0000 7efeaa91f700 1 -- start start 2023-10-14T12:19:01.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efeaa91f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efea40d0c70 0x7efea40cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efeaa91f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efeaa91f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea40d23e0 con 0x7efea415b740 2023-10-14T12:19:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efeaa91f700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea415bb20 con 0x7efea40d0c70 2023-10-14T12:19:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efeaa91f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea40cf190 con 0x7efea40c5110 2023-10-14T12:19:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea37fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efea40d0c70 0x7efea40cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7efea415b740 0x7efea40d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55640/0 (socket says 172.21.15.32:55640) 2023-10-14T12:19:01.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea3fff700 1 -- 172.21.15.32:0/2415239660 learned_addr learned my addr 172.21.15.32:0/2415239660 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:01.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea8ebc700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea2ffd700 1 -- 172.21.15.32:0/2415239660 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536516260 0 0) 0x7efe94001110 con 0x7efea415b740 2023-10-14T12:19:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea2ffd700 1 -- 172.21.15.32:0/2415239660 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8c0035b0 con 0x7efea415b740 2023-10-14T12:19:01.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea37fe700 1 -- 172.21.15.32:0/2415239660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 msgr2=0x7efea40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:01.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea37fe700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea37fe700 1 -- 172.21.15.32:0/2415239660 >> v1:172.21.15.32:6789/0 conn(0x7efea415b740 legacy=0x7efea40d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea37fe700 1 -- 172.21.15.32:0/2415239660 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40cbd40 con 0x7efea40d0c70 2023-10-14T12:19:01.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea8ebc700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.076+0000 7efea37fe700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40cdfd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efe98009840 tx=0x7efe98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8345800884a3b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efea2ffd700 1 -- 172.21.15.32:0/2415239660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98011830 con 0x7efea40d0c70 2023-10-14T12:19:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efea2ffd700 1 -- 172.21.15.32:0/2415239660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98011990 con 0x7efea40d0c70 2023-10-14T12:19:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efea2ffd700 1 -- 172.21.15.32:0/2415239660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98011d20 con 0x7efea40d0c70 2023-10-14T12:19:01.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 -- 172.21.15.32:0/2415239660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 msgr2=0x7efea40cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40cdfd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efe98009840 tx=0x7efe98009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:01.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 -- 172.21.15.32:0/2415239660 shutdown_connections 2023-10-14T12:19:01.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 --2- 172.21.15.32:0/2415239660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40cdfd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 -- 172.21.15.32:0/2415239660 >> 172.21.15.32:0/2415239660 conn(0x7efea40665a0 msgr2=0x7efea4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:01.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 -- 172.21.15.32:0/2415239660 shutdown_connections 2023-10-14T12:19:01.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.077+0000 7efeaa91f700 1 -- 172.21.15.32:0/2415239660 wait complete. 2023-10-14T12:19:01.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.078+0000 7efeaa91f700 1 Processor -- start 2023-10-14T12:19:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 -- start start 2023-10-14T12:19:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea4151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea415b740 0x7efea40c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40a9260 con 0x7efea40d0c70 2023-10-14T12:19:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40a9540 con 0x7efea415b740 2023-10-14T12:19:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efeaa91f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea40a9820 con 0x7efea40c5110 2023-10-14T12:19:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efea37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efea37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38622/0 (socket says 172.21.15.32:38622) 2023-10-14T12:19:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.079+0000 7efea37fe700 1 -- 172.21.15.32:0/1968102805 learned_addr learned my addr 172.21.15.32:0/1968102805 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea37fe700 1 -- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 msgr2=0x7efea4151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea37fe700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea4151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea37fe700 1 -- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea415b740 msgr2=0x7efea40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea8ebc700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea415b740 0x7efea40c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea37fe700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea415b740 0x7efea40c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea37fe700 1 -- 172.21.15.32:0/1968102805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980094a0 con 0x7efea40d0c70 2023-10-14T12:19:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea37fe700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40c5a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efe98009fd0 tx=0x7efe98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980036a0 con 0x7efea40d0c70 2023-10-14T12:19:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9801f070 con 0x7efea40d0c70 2023-10-14T12:19:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98003a60 con 0x7efea40d0c70 2023-10-14T12:19:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea40a9b00 con 0x7efea40d0c70 2023-10-14T12:19:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.080+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea40a8510 con 0x7efea40d0c70 2023-10-14T12:19:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.081+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea4067d20 con 0x7efea40d0c70 2023-10-14T12:19:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.081+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efe98003bc0 con 0x7efea40d0c70 2023-10-14T12:19:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.082+0000 7efea0ff9700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efe9006af00 0x7efe9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.082+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe98021070 con 0x7efea40d0c70 2023-10-14T12:19:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.082+0000 7efea3fff700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efe9006af00 0x7efe9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.082+0000 7efea3fff700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efe9006af00 0x7efe9006d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe94005910 tx=0x7efe94001150 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.086+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe98056020 con 0x7efea40d0c70 2023-10-14T12:19:01.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.288+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efea40cfe20 con 0x7efea40d0c70 2023-10-14T12:19:01.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.290+0000 7efea0ff9700 1 -- 172.21.15.32:0/1968102805 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7efe9802b090 con 0x7efea40d0c70 2023-10-14T12:19:01.291 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:01.291 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:01.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efe9006af00 msgr2=0x7efe9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efe9006af00 0x7efe9006d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe94005910 tx=0x7efe94001150 comp rx=0 tx=0).stop 2023-10-14T12:19:01.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 msgr2=0x7efea40c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40c5a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efe98009fd0 tx=0x7efe98004750 comp rx=0 tx=0).stop 2023-10-14T12:19:01.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 shutdown_connections 2023-10-14T12:19:01.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efe9006af00 0x7efe9006d3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea415b740 0x7efea40c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efea40c5110 0x7efea4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 --2- 172.21.15.32:0/1968102805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efea40d0c70 0x7efea40c5a80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 >> 172.21.15.32:0/1968102805 conn(0x7efea40665a0 msgr2=0x7efea40d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 shutdown_connections 2023-10-14T12:19:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.292+0000 7efeaa91f700 1 -- 172.21.15.32:0/1968102805 wait complete. 2023-10-14T12:19:01.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:01.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.430+0000 7fac747ac700 1 Processor -- start 2023-10-14T12:19:01.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.430+0000 7fac747ac700 1 -- start start 2023-10-14T12:19:01.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac747ac700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fac6c15ab10 0x7fac6c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac747ac700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fac6c0cfe30 0x7fac6c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac747ac700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c15e7a0 con 0x7fac6c0b1f50 2023-10-14T12:19:01.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac747ac700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c15f730 con 0x7fac6c0cfe30 2023-10-14T12:19:01.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac747ac700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c0b29a0 con 0x7fac6c15ab10 2023-10-14T12:19:01.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fac6c0cfe30 0x7fac6c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fac6c0cfe30 0x7fac6c0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38632/0 (socket says 172.21.15.32:38632) 2023-10-14T12:19:01.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac71d47700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fac6c0b1f50 0x7fac6c0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55654/0 (socket says 172.21.15.32:55654) 2023-10-14T12:19:01.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 -- 172.21.15.32:0/119935536 learned_addr learned my addr 172.21.15.32:0/119935536 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:01.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 -- 172.21.15.32:0/119935536 >> v2:172.21.15.92:3300/0 conn(0x7fac6c15ab10 msgr2=0x7fac6c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:01.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72548700 1 --2- 172.21.15.32:0/119935536 >> v2:172.21.15.92:3300/0 conn(0x7fac6c15ab10 0x7fac6c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 --2- 172.21.15.32:0/119935536 >> v2:172.21.15.92:3300/0 conn(0x7fac6c15ab10 0x7fac6c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 -- 172.21.15.32:0/119935536 >> v1:172.21.15.32:6789/0 conn(0x7fac6c0b1f50 legacy=0x7fac6c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac71546700 1 -- 172.21.15.32:0/119935536 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579588092 0 0) 0x7fac6c15e7a0 con 0x7fac6c0b1f50 2023-10-14T12:19:01.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 -- 172.21.15.32:0/119935536 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0b2c80 con 0x7fac6c0cfe30 2023-10-14T12:19:01.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72548700 1 --2- 172.21.15.32:0/119935536 >> v2:172.21.15.92:3300/0 conn(0x7fac6c15ab10 0x7fac6c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:01.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.431+0000 7fac72d49700 1 --2- 172.21.15.32:0/119935536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0cbf40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0d0430 tx=0x7fac6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1874ebe4e682b9ef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac71546700 1 -- 172.21.15.32:0/119935536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400e070 con 0x7fac6c0cfe30 2023-10-14T12:19:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac71546700 1 -- 172.21.15.32:0/119935536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6400b9c0 con 0x7fac6c0cfe30 2023-10-14T12:19:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac71546700 1 -- 172.21.15.32:0/119935536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400bd70 con 0x7fac6c0cfe30 2023-10-14T12:19:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 -- 172.21.15.32:0/119935536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 msgr2=0x7fac6c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 --2- 172.21.15.32:0/119935536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0cbf40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0d0430 tx=0x7fac6400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:01.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 -- 172.21.15.32:0/119935536 shutdown_connections 2023-10-14T12:19:01.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 --2- 172.21.15.32:0/119935536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0cbf40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 --2- 172.21.15.32:0/119935536 >> v2:172.21.15.92:3300/0 conn(0x7fac6c15ab10 0x7fac6c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 -- 172.21.15.32:0/119935536 >> 172.21.15.32:0/119935536 conn(0x7fac6c06dae0 msgr2=0x7fac6c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:01.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 -- 172.21.15.32:0/119935536 shutdown_connections 2023-10-14T12:19:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.432+0000 7fac747ac700 1 -- 172.21.15.32:0/119935536 wait complete. 2023-10-14T12:19:01.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 Processor -- start 2023-10-14T12:19:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 -- start start 2023-10-14T12:19:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac6c0b1f50 0x7fac6c153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac6c15ab10 0x7fac6c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c154250 con 0x7fac6c0cfe30 2023-10-14T12:19:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0b3500 con 0x7fac6c0b1f50 2023-10-14T12:19:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac747ac700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0b4080 con 0x7fac6c15ab10 2023-10-14T12:19:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac71d47700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac71d47700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38636/0 (socket says 172.21.15.32:38636) 2023-10-14T12:19:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.434+0000 7fac71d47700 1 -- 172.21.15.32:0/3363622288 learned_addr learned my addr 172.21.15.32:0/3363622288 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac72548700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac6c0b1f50 0x7fac6c153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac72d49700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac6c15ab10 0x7fac6c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac71d47700 1 -- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac6c15ab10 msgr2=0x7fac6c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac71d47700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac6c15ab10 0x7fac6c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac71d47700 1 -- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac6c0b1f50 msgr2=0x7fac6c153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac71d47700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac6c0b1f50 0x7fac6c153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac71d47700 1 -- 172.21.15.32:0/3363622288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64009b30 con 0x7fac6c0cfe30 2023-10-14T12:19:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac71d47700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0b4510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fac6800c4a0 tx=0x7fac6800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680074e0 con 0x7fac6c0cfe30 2023-10-14T12:19:01.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac68007640 con 0x7fac6c0cfe30 2023-10-14T12:19:01.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c0b3750 con 0x7fac6c0cfe30 2023-10-14T12:19:01.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68005a50 con 0x7fac6c0cfe30 2023-10-14T12:19:01.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.435+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c0b3d10 con 0x7fac6c0cfe30 2023-10-14T12:19:01.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.436+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c0b4210 con 0x7fac6c0cfe30 2023-10-14T12:19:01.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.437+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac68005bb0 con 0x7fac6c0cfe30 2023-10-14T12:19:01.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.437+0000 7fac62ffd700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fac5006af00 0x7fac5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:01.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.437+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac68088970 con 0x7fac6c0cfe30 2023-10-14T12:19:01.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.437+0000 7fac72548700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fac5006af00 0x7fac5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:01.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.438+0000 7fac72548700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fac5006af00 0x7fac5006d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac5c006fd0 tx=0x7fac5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:01.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.442+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac68053a20 con 0x7fac6c0cfe30 2023-10-14T12:19:01.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.686+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac6c067d20 con 0x7fac6c0cfe30 2023-10-14T12:19:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.687+0000 7fac62ffd700 1 -- 172.21.15.32:0/3363622288 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fac68017020 con 0x7fac6c0cfe30 2023-10-14T12:19:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:01.689 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:19:01.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fac5006af00 msgr2=0x7fac5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fac5006af00 0x7fac5006d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac5c006fd0 tx=0x7fac5c008040 comp rx=0 tx=0).stop 2023-10-14T12:19:01.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 msgr2=0x7fac6c0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:01.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0b4510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fac6800c4a0 tx=0x7fac6800c7b0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 shutdown_connections 2023-10-14T12:19:01.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac6c15ab10 0x7fac6c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fac5006af00 0x7fac5006d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac6c0b1f50 0x7fac6c153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 --2- 172.21.15.32:0/3363622288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac6c0cfe30 0x7fac6c0b4510 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 >> 172.21.15.32:0/3363622288 conn(0x7fac6c06dae0 msgr2=0x7fac6c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 shutdown_connections 2023-10-14T12:19:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:01.689+0000 7fac747ac700 1 -- 172.21.15.32:0/3363622288 wait complete. 2023-10-14T12:19:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:19:02.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:18:46.896041+0000', 'modified': '2023-10-14T12:18:49.918084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4250': {'gid': 4250, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6837/2838644499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 2838644499}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 2838644499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T12:19:02.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:19:02.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T12:19:02.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.243+0000 7f7f8245e700 1 Processor -- start 2023-10-14T12:19:02.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.243+0000 7f7f8245e700 1 -- start start 2023-10-14T12:19:02.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.243+0000 7f7f8245e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 0x7f7f7c15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f8245e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c0ce350 con 0x7f7f7c0d1fc0 2023-10-14T12:19:02.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f8245e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c162630 con 0x7f7f7c161f10 2023-10-14T12:19:02.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f8245e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0b5140 con 0x7f7f7c15d9e0 2023-10-14T12:19:02.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7f7c0d1fc0 0x7f7f7c161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55668/0 (socket says 172.21.15.32:55668) 2023-10-14T12:19:02.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7b7fe700 1 -- 172.21.15.32:0/1302905105 learned_addr learned my addr 172.21.15.32:0/1302905105 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:02.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586229850 0 0) 0x7f7f7c0ce350 con 0x7f7f7c0d1fc0 2023-10-14T12:19:02.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 0x7f7f7c15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f640035b0 con 0x7f7f7c0d1fc0 2023-10-14T12:19:02.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 135832823 0 0) 0x7f7f640035b0 con 0x7f7f7c0d1fc0 2023-10-14T12:19:02.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 msgr2=0x7f7f7c15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 0x7f7f7c15ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 >> v1:172.21.15.92:6789/0 conn(0x7f7f7c161f10 legacy=0x7f7f7c167b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0ce5f0 con 0x7f7f7c0d1fc0 2023-10-14T12:19:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f7f70001670 con 0x7f7f7c0d1fc0 2023-10-14T12:19:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 >> v1:172.21.15.32:6789/0 conn(0x7f7f7c0d1fc0 legacy=0x7f7f7c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64003a30 0x7f7f64003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 0x7f7f64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f64004d90 0x7f7f64005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0b5140 con 0x7f7f64004d90 2023-10-14T12:19:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6400bb50 con 0x7f7f64003a30 2023-10-14T12:19:02.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6400bd10 con 0x7f7f7c15d9e0 2023-10-14T12:19:02.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.244+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f64004d90 0x7f7f64005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 0x7f7f64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64003a30 0x7f7f64003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f809fb700 1 -- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 msgr2=0x7f7f64004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c15d9e0 0x7f7f64004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f809fb700 1 -- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64003a30 msgr2=0x7f7f64003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64003a30 0x7f7f64003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f809fb700 1 -- 172.21.15.32:0/1302905105 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640035b0 con 0x7f7f64004d90 2023-10-14T12:19:02.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f64004d90 0x7f7f64005210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c210 tx=0x7f7f64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4742c5c8c4841526 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74001df0 con 0x7f7f64004d90 2023-10-14T12:19:02.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400cd70 con 0x7f7f64004d90 2023-10-14T12:19:02.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.245+0000 7f7f7affd700 1 -- 172.21.15.32:0/1302905105 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74003c40 con 0x7f7f64004d90 2023-10-14T12:19:02.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f8245e700 1 -- 172.21.15.32:0/1302905105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f64004d90 msgr2=0x7f7f64005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f8245e700 1 --2- 172.21.15.32:0/1302905105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f64004d90 0x7f7f64005210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c210 tx=0x7f7f64005880 comp rx=0 tx=0).stop 2023-10-14T12:19:02.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f809fb700 1 -- 172.21.15.32:0/1302905105 reap_dead start 2023-10-14T12:19:02.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f8245e700 1 -- 172.21.15.32:0/1302905105 shutdown_connections 2023-10-14T12:19:02.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f8245e700 1 -- 172.21.15.32:0/1302905105 >> 172.21.15.32:0/1302905105 conn(0x7f7f7c09cb40 msgr2=0x7f7f7c0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f8245e700 1 -- 172.21.15.32:0/1302905105 shutdown_connections 2023-10-14T12:19:02.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.246+0000 7f7f8245e700 1 -- 172.21.15.32:0/1302905105 wait complete. 2023-10-14T12:19:02.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.247+0000 7f7f8245e700 1 Processor -- start 2023-10-14T12:19:02.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.247+0000 7f7f8245e700 1 -- start start 2023-10-14T12:19:02.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f8245e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64004d90 0x7f7f7c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f8245e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c1f0ad0 0x7f7f7c1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f8245e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 0x7f7f7c0d1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f8245e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0d1d50 con 0x7f7f7c0d1360 2023-10-14T12:19:02.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f8245e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1f4570 con 0x7f7f64004d90 2023-10-14T12:19:02.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f8245e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1f0f50 con 0x7f7f7c1f0ad0 2023-10-14T12:19:02.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 0x7f7f7c0d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 0x7f7f7c0d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38658/0 (socket says 172.21.15.32:38658) 2023-10-14T12:19:02.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 -- 172.21.15.32:0/720540453 learned_addr learned my addr 172.21.15.32:0/720540453 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64004d90 0x7f7f7c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c1f0ad0 0x7f7f7c1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 -- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c1f0ad0 msgr2=0x7f7f7c1f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c1f0ad0 0x7f7f7c1f4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 -- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64004d90 msgr2=0x7f7f7c0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64004d90 0x7f7f7c0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.248+0000 7f7f809fb700 1 -- 172.21.15.32:0/720540453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0c79c0 con 0x7f7f7c0d1360 2023-10-14T12:19:02.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.249+0000 7f7f809fb700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 0x7f7f7c0d1810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005040 tx=0x7f7f740014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.249+0000 7f7f78ff9700 1 -- 172.21.15.32:0/720540453 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74003c10 con 0x7f7f7c0d1360 2023-10-14T12:19:02.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.249+0000 7f7f78ff9700 1 -- 172.21.15.32:0/720540453 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74003d90 con 0x7f7f7c0d1360 2023-10-14T12:19:02.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.249+0000 7f7f78ff9700 1 -- 172.21.15.32:0/720540453 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74005310 con 0x7f7f7c0d1360 2023-10-14T12:19:02.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.249+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c0c7ca0 con 0x7f7f7c0d1360 2023-10-14T12:19:02.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.249+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c0c8260 con 0x7f7f7c0d1360 2023-10-14T12:19:02.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.251+0000 7f7f78ff9700 1 -- 172.21.15.32:0/720540453 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7f74019070 con 0x7f7f7c0d1360 2023-10-14T12:19:02.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.251+0000 7f7f78ff9700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f6806af00 0x7f7f6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.251+0000 7f7f78ff9700 1 -- 172.21.15.32:0/720540453 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f7408a1d0 con 0x7f7f7c0d1360 2023-10-14T12:19:02.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.251+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f6806af00 0x7f7f6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.252+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f6806af00 0x7f7f6806d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009c60 tx=0x7f7f6c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.253+0000 7f7f8e648b80 1 Processor -- start 2023-10-14T12:19:02.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.253+0000 7f7f8e648b80 1 -- start start 2023-10-14T12:19:02.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989baaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989ba8630 0x558989baafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989b7e010 0x558989b7e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989af4c20 con 0x558989ba3220 2023-10-14T12:19:02.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989ad9c10 con 0x558989ba8630 2023-10-14T12:19:02.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558989ad7530 con 0x558989b7e010 2023-10-14T12:19:02.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989baaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989baaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38662/0 (socket says 172.21.15.32:38662) 2023-10-14T12:19:02.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 -- 172.21.15.32:0/570665577 learned_addr learned my addr 172.21.15.32:0/570665577 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989ba8630 0x558989baafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f809fb700 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989b7e010 0x558989b7e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 -- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989b7e010 msgr2=0x558989b7e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989b7e010 0x558989b7e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 -- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989ba8630 msgr2=0x558989baafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989ba8630 0x558989baafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 -- 172.21.15.32:0/570665577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558989a903a0 con 0x558989ba3220 2023-10-14T12:19:02.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989baaa70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0043c0 tx=0x7f7f6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae0d463f1b053f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f61ffb700 1 -- 172.21.15.32:0/570665577 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0036a0 con 0x558989ba3220 2023-10-14T12:19:02.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.254+0000 7f7f61ffb700 1 -- 172.21.15.32:0/570665577 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c019070 con 0x558989ba3220 2023-10-14T12:19:02.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f61ffb700 1 -- 172.21.15.32:0/570665577 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c003a00 con 0x558989ba3220 2023-10-14T12:19:02.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 -- 172.21.15.32:0/570665577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 msgr2=0x558989baaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989baaa70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0043c0 tx=0x7f7f6c017000 comp rx=0 tx=0).stop 2023-10-14T12:19:02.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 -- 172.21.15.32:0/570665577 shutdown_connections 2023-10-14T12:19:02.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989b7e010 0x558989b7e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989baaa70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/570665577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989ba8630 0x558989baafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 -- 172.21.15.32:0/570665577 >> 172.21.15.32:0/570665577 conn(0x558989aadd80 msgr2=0x558989bc8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 -- 172.21.15.32:0/570665577 shutdown_connections 2023-10-14T12:19:02.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.255+0000 7f7f8e648b80 1 -- 172.21.15.32:0/570665577 wait complete. 2023-10-14T12:19:02.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.256+0000 7f7f8e648b80 1 -- start start 2023-10-14T12:19:02.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.256+0000 7f7f8e648b80 1 Processor -- start 2023-10-14T12:19:02.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b9a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989bc5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989ad2e20 con 0x558989ba8630 2023-10-14T12:19:02.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989a6f6c0 con 0x558989b7e010 2023-10-14T12:19:02.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558989a6f360 con 0x558989ba3220 2023-10-14T12:19:02.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f8e648b80 10 client.0 _ll_register_callbacks cb 0x5589898cc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:19:02.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989bc5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989bc5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38672/0 (socket says 172.21.15.32:38672) 2023-10-14T12:19:02.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 -- 172.21.15.32:0/1328532868 learned_addr learned my addr 172.21.15.32:0/1328532868 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b9a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 -- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 msgr2=0x558989ba4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 -- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 msgr2=0x558989b9a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b9a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 -- 172.21.15.32:0/1328532868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c0040a0 con 0x558989ba8630 2023-10-14T12:19:02.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f809fb700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989bc5a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f74001b50 tx=0x7f7f740591b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660b8931668b6c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.257+0000 7f7f5affd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-14T12:19:02.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f5affd700 1 -- 172.21.15.32:0/1328532868 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74059610 con 0x558989ba8630 2023-10-14T12:19:02.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f5affd700 1 -- 172.21.15.32:0/1328532868 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f7405d0d0 con 0x558989ba8630 2023-10-14T12:19:02.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558989b735b0 con 0x558989ba8630 2023-10-14T12:19:02.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f5affd700 1 -- 172.21.15.32:0/1328532868 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f740614b0 con 0x558989ba8630 2023-10-14T12:19:02.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 10 client.4629 fetch_fsmap learned FSMap version 8 2023-10-14T12:19:02.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5589898fdd90 con 0x558989ba8630 2023-10-14T12:19:02.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f5affd700 1 -- 172.21.15.32:0/1328532868 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558989b735b0 con 0x558989ba8630 2023-10-14T12:19:02.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f5affd700 1 -- 172.21.15.32:0/1328532868 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7f74088250 con 0x558989ba8630 2023-10-14T12:19:02.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T12:19:02.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 10 client.4629 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:19:02.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 20 client.4629 populate_metadata read hostname 'smithi032' 2023-10-14T12:19:02.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989ba1940 0x558989ba1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 4 client.4629 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:19:02.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 --> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558989acbe00 con 0x558989ba1940 2023-10-14T12:19:02.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.258+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989ba1940 0x558989ba1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.259+0000 7f7f5affd700 10 client.4629 ms_handle_connect on v2:172.21.15.92:6836/2838644499 2023-10-14T12:19:02.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.259+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989ba1940 0x558989ba1d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402f1957a796623a server_cookie=6483057219aa984c in_seq=0 out_seq=0 2023-10-14T12:19:02.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.259+0000 7f7f5affd700 1 -- 172.21.15.32:0/1328532868 <== mds.0 v2:172.21.15.92:6836/2838644499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558989acbe00 con 0x558989ba1940 2023-10-14T12:19:02.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.259+0000 7f7f5affd700 10 client.4629 handle_command_reply: tid=0 2023-10-14T12:19:02.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.259+0000 7f7f8e648b80 1 client.4629 shutdown 2023-10-14T12:19:02.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 msgr2=0x558989bc5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989bc5a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f74001b50 tx=0x7f7f740591b0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 shutdown_connections 2023-10-14T12:19:02.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989ba1940 0x558989ba1d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989bc5a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b9a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/1328532868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 >> 172.21.15.32:0/1328532868 conn(0x558989aadd80 msgr2=0x558989bc8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f5affd700 0 client.4629 ms_handle_reset on v2:172.21.15.92:6836/2838644499 2023-10-14T12:19:02.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 shutdown_connections 2023-10-14T12:19:02.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 1 -- 172.21.15.32:0/1328532868 wait complete. 2023-10-14T12:19:02.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.260+0000 7f7f8e648b80 20 client.4629 trim_cache size 0 max 16384 2023-10-14T12:19:02.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.278+0000 7f7f8e648b80 1 Processor -- start 2023-10-14T12:19:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.278+0000 7f7f8e648b80 1 -- start start 2023-10-14T12:19:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b75360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989b808f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba8630 0x558989ba4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589899538d0 con 0x558989ba3220 2023-10-14T12:19:02.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989baed30 con 0x558989b7e010 2023-10-14T12:19:02.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558989b7cd00 con 0x558989ba8630 2023-10-14T12:19:02.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989b808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989b808f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38676/0 (socket says 172.21.15.32:38676) 2023-10-14T12:19:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 -- 172.21.15.32:0/2610864078 learned_addr learned my addr 172.21.15.32:0/2610864078 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b75360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f809fb700 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba8630 0x558989ba4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 -- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba8630 msgr2=0x558989ba4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba8630 0x558989ba4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 -- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 msgr2=0x558989b75360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b75360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 -- 172.21.15.32:0/2610864078 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558989b75e10 con 0x558989ba3220 2023-10-14T12:19:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989b808f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f70000c00 tx=0x7f7f70006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8e1508c9d67311 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f627fc700 1 -- 172.21.15.32:0/2610864078 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700072d0 con 0x558989ba3220 2023-10-14T12:19:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f627fc700 1 -- 172.21.15.32:0/2610864078 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70007430 con 0x558989ba3220 2023-10-14T12:19:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.279+0000 7f7f627fc700 1 -- 172.21.15.32:0/2610864078 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700077a0 con 0x558989ba3220 2023-10-14T12:19:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 -- 172.21.15.32:0/2610864078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 msgr2=0x558989b808f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989b808f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f70000c00 tx=0x7f7f70006040 comp rx=0 tx=0).stop 2023-10-14T12:19:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 -- 172.21.15.32:0/2610864078 shutdown_connections 2023-10-14T12:19:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba8630 0x558989ba4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989b75360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/2610864078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba3220 0x558989b808f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 -- 172.21.15.32:0/2610864078 >> 172.21.15.32:0/2610864078 conn(0x558989aadd80 msgr2=0x558989ba3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 -- 172.21.15.32:0/2610864078 shutdown_connections 2023-10-14T12:19:02.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.280+0000 7f7f8e648b80 1 -- 172.21.15.32:0/2610864078 wait complete. 2023-10-14T12:19:02.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.281+0000 7f7f8e648b80 1 -- start start 2023-10-14T12:19:02.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.281+0000 7f7f8e648b80 1 Processor -- start 2023-10-14T12:19:02.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989c2f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989ba1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989ba7960 con 0x558989ba8630 2023-10-14T12:19:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558989bd85d0 con 0x558989b7e010 2023-10-14T12:19:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558989ba1dd0 con 0x558989ba3220 2023-10-14T12:19:02.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 10 client.0 _ll_register_callbacks cb 0x7f7f74058b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:19:02.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989ba1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989ba1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38686/0 (socket says 172.21.15.32:38686) 2023-10-14T12:19:02.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 -- 172.21.15.32:0/3431276003 learned_addr learned my addr 172.21.15.32:0/3431276003 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989c2f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f7b7fe700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 -- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 msgr2=0x558989ba7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 -- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 msgr2=0x558989c2f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989c2f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 -- 172.21.15.32:0/3431276003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c0ce5f0 con 0x558989ba8630 2023-10-14T12:19:02.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f809fb700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989ba1300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400d010 tx=0x7f7f74088660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5f78b898615953 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f5affd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-14T12:19:02.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f5affd700 1 -- 172.21.15.32:0/3431276003 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74058940 con 0x558989ba8630 2023-10-14T12:19:02.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f5affd700 1 -- 172.21.15.32:0/3431276003 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f7405d0e0 con 0x558989ba8630 2023-10-14T12:19:02.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.282+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f6c019070 con 0x558989ba8630 2023-10-14T12:19:02.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f5affd700 1 -- 172.21.15.32:0/3431276003 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f740614b0 con 0x558989ba8630 2023-10-14T12:19:02.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 10 client.4635 fetch_fsmap learned FSMap version 8 2023-10-14T12:19:02.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5589898e6c10 con 0x558989ba8630 2023-10-14T12:19:02.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f5affd700 1 -- 172.21.15.32:0/3431276003 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74070080 con 0x558989ba8630 2023-10-14T12:19:02.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f5affd700 1 -- 172.21.15.32:0/3431276003 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7f74061020 con 0x558989ba8630 2023-10-14T12:19:02.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T12:19:02.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 10 client.4635 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:19:02.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 20 client.4635 populate_metadata read hostname 'smithi032' 2023-10-14T12:19:02.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989b7f7f0 0x558989b7fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 4 client.4635 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:19:02.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 --> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558989acbb20 con 0x558989b7f7f0 2023-10-14T12:19:02.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.283+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989b7f7f0 0x558989b7fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f5affd700 10 client.4635 ms_handle_connect on v2:172.21.15.92:6836/2838644499 2023-10-14T12:19:02.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f7bfff700 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989b7f7f0 0x558989b7fbd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e89271042a37fb7 server_cookie=dcf3e4ddaca1354e in_seq=0 out_seq=0 2023-10-14T12:19:02.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f5affd700 1 -- 172.21.15.32:0/3431276003 <== mds.0 v2:172.21.15.92:6836/2838644499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558989acbb20 con 0x558989b7f7f0 2023-10-14T12:19:02.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f5affd700 10 client.4635 handle_command_reply: tid=0 2023-10-14T12:19:02.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 client.4635 shutdown 2023-10-14T12:19:02.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 msgr2=0x558989ba1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989ba1300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400d010 tx=0x7f7f74088660 comp rx=0 tx=0).stop 2023-10-14T12:19:02.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 shutdown_connections 2023-10-14T12:19:02.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:6836/2838644499,v1:172.21.15.92:6837/2838644499] conn(0x558989b7f7f0 0x558989b7fbd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558989ba8630 0x558989ba1300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558989b7e010 0x558989c2f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 --2- 172.21.15.32:0/3431276003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558989ba3220 0x558989ba7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f5affd700 0 client.4635 ms_handle_reset on v2:172.21.15.92:6836/2838644499 2023-10-14T12:19:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 >> 172.21.15.32:0/3431276003 conn(0x558989aadd80 msgr2=0x558989bc8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 shutdown_connections 2023-10-14T12:19:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 1 -- 172.21.15.32:0/3431276003 wait complete. 2023-10-14T12:19:02.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.284+0000 7f7f8e648b80 20 client.4635 trim_cache size 0 max 16384 2023-10-14T12:19:02.311 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:02.311 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed", 2023-10-14T12:19:02.311 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-10-14T12:19:02.311 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4250, 2023-10-14T12:19:02.312 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-10-14T12:19:02.312 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-10-14T12:19:02.312 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2023-10-14T12:19:02.312 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 14.787309595, 2023-10-14T12:19:02.312 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 8, 2023-10-14T12:19:02.313 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 21, 2023-10-14T12:19:02.313 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 21, 2023-10-14T12:19:02.313 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 21.842473719000001 2023-10-14T12:19:02.313 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:02.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f6806af00 msgr2=0x7f7f6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f6806af00 0x7f7f6806d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009c60 tx=0x7f7f6c009210 comp rx=0 tx=0).stop 2023-10-14T12:19:02.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 msgr2=0x7f7f7c0d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 0x7f7f7c0d1810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005040 tx=0x7f7f740014a0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 shutdown_connections 2023-10-14T12:19:02.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f7c0d1360 0x7f7f7c0d1810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f6806af00 0x7f7f6806d3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f64004d90 0x7f7f7c0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 --2- 172.21.15.32:0/720540453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f7c1f0ad0 0x7f7f7c1f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 >> 172.21.15.32:0/720540453 conn(0x7f7f7c09cb40 msgr2=0x7f7f7c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 shutdown_connections 2023-10-14T12:19:02.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.285+0000 7f7f8245e700 1 -- 172.21.15.32:0/720540453 wait complete. 2023-10-14T12:19:02.317 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T12:19:02.341 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T12:19:02.341 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T12:19:02.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.342 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:02.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-10-14T12:19:02.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:19:02.432 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2023-10-14T12:19:02.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.432 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:02.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-10-14T12:19:02.558 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2023-10-14T12:19:02.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:19:02.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.560 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T12:19:02.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.582 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-14T12:19:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-14T12:19:02.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:19:02.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.659 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T12:19:02.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:02.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-14T12:19:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-14T12:19:02.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:19:02.796 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-14T12:19:02.796 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:19:02.796 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:02.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:19:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.923+0000 7fc61e170700 1 Processor -- start 2023-10-14T12:19:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.923+0000 7fc61e170700 1 -- start start 2023-10-14T12:19:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.923+0000 7fc61e170700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61806d0c0 0x7fc6180727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc61e170700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc61815e1c0 0x7fc61815e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc61e170700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc618071aa0 con 0x7fc61815a580 2023-10-14T12:19:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc61e170700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61815f140 con 0x7fc61815e1c0 2023-10-14T12:19:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc61e170700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61815ebb0 con 0x7fc61806d0c0 2023-10-14T12:19:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc61815e1c0 0x7fc61815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc61815e1c0 0x7fc61815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38694/0 (socket says 172.21.15.32:38694) 2023-10-14T12:19:02.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 -- 172.21.15.32:0/3936462532 learned_addr learned my addr 172.21.15.32:0/3936462532 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc616ffd700 1 --2- 172.21.15.32:0/3936462532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61806d0c0 0x7fc6180727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 -- 172.21.15.32:0/3936462532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61806d0c0 msgr2=0x7fc6180727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:02.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 --2- 172.21.15.32:0/3936462532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61806d0c0 0x7fc6180727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 -- 172.21.15.32:0/3936462532 >> v1:172.21.15.92:6789/0 conn(0x7fc61815a580 legacy=0x7fc61806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 -- 172.21.15.32:0/3936462532 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61815ee60 con 0x7fc61815e1c0 2023-10-14T12:19:02.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc617fff700 1 --2- 172.21.15.32:0/3936462532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61815e1c0 0x7fc61815e670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc610009e50 tx=0x7fc61000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbe2f1d0b1c0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc6167fc700 1 -- 172.21.15.32:0/3936462532 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61000e070 con 0x7fc61815e1c0 2023-10-14T12:19:02.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc6167fc700 1 -- 172.21.15.32:0/3936462532 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61000b9c0 con 0x7fc61815e1c0 2023-10-14T12:19:02.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.924+0000 7fc6167fc700 1 -- 172.21.15.32:0/3936462532 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61000bd70 con 0x7fc61815e1c0 2023-10-14T12:19:02.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 -- 172.21.15.32:0/3936462532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61815e1c0 msgr2=0x7fc61815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 --2- 172.21.15.32:0/3936462532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61815e1c0 0x7fc61815e670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc610009e50 tx=0x7fc61000b330 comp rx=0 tx=0).stop 2023-10-14T12:19:02.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 -- 172.21.15.32:0/3936462532 shutdown_connections 2023-10-14T12:19:02.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 --2- 172.21.15.32:0/3936462532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61815e1c0 0x7fc61815e670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 --2- 172.21.15.32:0/3936462532 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61806d0c0 0x7fc6180727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 -- 172.21.15.32:0/3936462532 >> 172.21.15.32:0/3936462532 conn(0x7fc61806afb0 msgr2=0x7fc6180cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:02.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 -- 172.21.15.32:0/3936462532 shutdown_connections 2023-10-14T12:19:02.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.925+0000 7fc61e170700 1 -- 172.21.15.32:0/3936462532 wait complete. 2023-10-14T12:19:02.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.926+0000 7fc61e170700 1 Processor -- start 2023-10-14T12:19:02.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.926+0000 7fc61e170700 1 -- start start 2023-10-14T12:19:02.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc61e170700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 0x7fc6181f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc61e170700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61815a580 0x7fc618150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc61e170700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61815e1c0 0x7fc6180ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc61e170700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180afb30 con 0x7fc61806d0c0 2023-10-14T12:19:02.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc61e170700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180afe10 con 0x7fc61815a580 2023-10-14T12:19:02.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc61e170700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180b00f0 con 0x7fc61815e1c0 2023-10-14T12:19:02.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc6177fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 0x7fc6181f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc6177fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 0x7fc6181f4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38696/0 (socket says 172.21.15.32:38696) 2023-10-14T12:19:02.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc6177fe700 1 -- 172.21.15.32:0/1622839907 learned_addr learned my addr 172.21.15.32:0/1622839907 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:02.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc617fff700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61815e1c0 0x7fc6180ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc616ffd700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61815a580 0x7fc618150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc6177fe700 1 -- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61815e1c0 msgr2=0x7fc6180ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.927+0000 7fc6177fe700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61815e1c0 0x7fc6180ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc6177fe700 1 -- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61815a580 msgr2=0x7fc618150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc6177fe700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61815a580 0x7fc618150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc6177fe700 1 -- 172.21.15.32:0/1622839907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610009b30 con 0x7fc61806d0c0 2023-10-14T12:19:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc6177fe700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 0x7fc6181f4080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c4e0 tx=0x7fc60800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6080052d0 con 0x7fc61806d0c0 2023-10-14T12:19:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608005430 con 0x7fc61806d0c0 2023-10-14T12:19:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6080038c0 con 0x7fc61806d0c0 2023-10-14T12:19:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6180b03d0 con 0x7fc61806d0c0 2023-10-14T12:19:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.928+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6181f45c0 con 0x7fc61806d0c0 2023-10-14T12:19:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.929+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6180b08f0 con 0x7fc61806d0c0 2023-10-14T12:19:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.929+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc608003a20 con 0x7fc61806d0c0 2023-10-14T12:19:02.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.930+0000 7fc5fffff700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc60406af00 0x7fc60406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:02.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.930+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6080888d0 con 0x7fc61806d0c0 2023-10-14T12:19:02.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.930+0000 7fc616ffd700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc60406af00 0x7fc60406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:02.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.930+0000 7fc616ffd700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc60406af00 0x7fc60406d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6180af730 tx=0x7fc60c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:02.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:02.934+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6180b08f0 con 0x7fc61806d0c0 2023-10-14T12:19:03.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.182+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc61804ebb0 con 0x7fc61806d0c0 2023-10-14T12:19:03.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.183+0000 7fc5fffff700 1 -- 172.21.15.32:0/1622839907 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc608017070 con 0x7fc61806d0c0 2023-10-14T12:19:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T12:19:03.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc60406af00 msgr2=0x7fc60406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:03.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc60406af00 0x7fc60406d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6180af730 tx=0x7fc60c008040 comp rx=0 tx=0).stop 2023-10-14T12:19:03.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 msgr2=0x7fc6181f4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:03.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 0x7fc6181f4080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c4e0 tx=0x7fc60800c7f0 comp rx=0 tx=0).stop 2023-10-14T12:19:03.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 shutdown_connections 2023-10-14T12:19:03.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc61815e1c0 0x7fc6180ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:03.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc61806d0c0 0x7fc6181f4080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc60406af00 0x7fc60406d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 --2- 172.21.15.32:0/1622839907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc61815a580 0x7fc618150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 >> 172.21.15.32:0/1622839907 conn(0x7fc61806afb0 msgr2=0x7fc618159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 shutdown_connections 2023-10-14T12:19:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:03.185+0000 7fc61e170700 1 -- 172.21.15.32:0/1622839907 wait complete. 2023-10-14T12:19:03.199 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:19:03.199 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:19:03.199 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-10-14T12:19:03.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T12:19:03.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:03.200 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:19:03.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:19:03.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:19:03.201 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:19:03.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.202 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-10-14T12:19:03.219 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:03.220 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:03.221 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:03.221 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:03.221 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:03.222 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:19:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:03.222 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T12:19:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42337sec preferred_lft 42337sec 2023-10-14T12:19:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-10-14T12:19:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:03.223 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:03.224 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:19:03.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.225 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:03.225 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:03.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:19:03.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2023-10-14T12:19:03.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2023-10-14T12:19:03.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:19:03.227 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:03.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.392 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:19:03.421 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-10-14T12:19:03.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.423 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-10-14T12:19:03.490 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-10-14T12:19:03.490 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:19:03.490 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T12:19:03.491 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T12:19:03.491 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:19:03.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.492 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:03.492 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:03.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T12:19:03.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T12:19:03.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T12:19:03.494 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:03.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.727 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:03.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.745 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-10-14T12:19:03.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.801 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:03.802 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:03.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:19:03.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T12:19:03.803 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:03.896 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T12:19:03.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:03.897 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:03.897 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:03.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T12:19:03.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:19:03.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T12:19:03.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T12:19:03.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T12:19:03.899 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:04.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.103 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:04.104 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:04.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-10-14T12:19:04.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:19:04.105 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:04.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:04.211 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:04.232 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:19:04.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:04.232 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:04.289 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T12:19:04.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:04.384 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:04.384 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:04.518 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:04.518 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:04.519 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:04.519 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:04.519 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:04.519 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:04.520 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:04.520 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:04.558 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:04.558 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:04.559 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:04.559 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:04.559 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:04.559 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:04.559 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:04.560 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:04.560 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T12:19:04.560 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T12:19:04.560 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed" will pass to kernel 2023-10-14T12:19:04.565 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:19:04.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:04.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.600 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:04.688 INFO:teuthology.orchestra.run.smithi032.stdout:client4644 2023-10-14T12:19:04.688 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:04.689 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:04.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.707 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:04.793 INFO:teuthology.orchestra.run.smithi032.stdout:client4644 2023-10-14T12:19:04.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.794 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:04.841 INFO:teuthology.orchestra.run.smithi032.stdout:client4644 2023-10-14T12:19:04.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:04.842 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.client4644/status') 2023-10-14T12:19:04.897 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4644 (3)192.168.0.1:0/1291998779 2023-10-14T12:19:04.897 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2023-10-14T12:19:04.898 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2023-10-14T12:19:04.898 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2023-10-14T12:19:04.898 INFO:teuthology.orchestra.run.smithi032.stderr:69 bytes copied, 2.6728e-05 s, 2.6 MB/s 2023-10-14T12:19:04.899 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-14T12:19:04.899 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:19:04.899 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T12:19:04.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:19:05.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.024+0000 7f08f1d58700 1 Processor -- start 2023-10-14T12:19:05.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.024+0000 7f08f1d58700 1 -- start start 2023-10-14T12:19:05.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08f1d58700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f08ec15ab10 0x7f08ec15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08f1d58700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec0b1f50 0x7f08ec0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08f1d58700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08ec0b23d0 0x7f08ec0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08f1d58700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec15e7a0 con 0x7f08ec0b23d0 2023-10-14T12:19:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08f1d58700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec15f730 con 0x7f08ec15ab10 2023-10-14T12:19:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08f1d58700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0b29a0 con 0x7f08ec0b1f50 2023-10-14T12:19:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08ec0b23d0 0x7f08ec0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08ec0b23d0 0x7f08ec0cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38714/0 (socket says 172.21.15.32:38714) 2023-10-14T12:19:05.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 -- 172.21.15.32:0/2319278012 learned_addr learned my addr 172.21.15.32:0/2319278012 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:05.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08eaffd700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec0b1f50 0x7f08ec0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08eb7fe700 1 --2- 172.21.15.32:0/2319278012 >> v2:172.21.15.92:3300/0 conn(0x7f08ec15ab10 0x7f08ec15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 -- 172.21.15.32:0/2319278012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec0b1f50 msgr2=0x7f08ec0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:05.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec0b1f50 0x7f08ec0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 -- 172.21.15.32:0/2319278012 >> v2:172.21.15.92:3300/0 conn(0x7f08ec15ab10 msgr2=0x7f08ec15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:05.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 --2- 172.21.15.32:0/2319278012 >> v2:172.21.15.92:3300/0 conn(0x7f08ec15ab10 0x7f08ec15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 -- 172.21.15.32:0/2319278012 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0b2c80 con 0x7f08ec0b23d0 2023-10-14T12:19:05.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08eaffd700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec0b1f50 0x7f08ec0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:05.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08eb7fe700 1 --2- 172.21.15.32:0/2319278012 >> v2:172.21.15.92:3300/0 conn(0x7f08ec15ab10 0x7f08ec15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:05.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.025+0000 7f08ebfff700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0cfc60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0d0430 tx=0x7f08e400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6ce72891c642ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:05.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08ea7fc700 1 -- 172.21.15.32:0/2319278012 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4010070 con 0x7f08ec0b23d0 2023-10-14T12:19:05.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08ea7fc700 1 -- 172.21.15.32:0/2319278012 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400dd90 con 0x7f08ec0b23d0 2023-10-14T12:19:05.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08ea7fc700 1 -- 172.21.15.32:0/2319278012 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400b310 con 0x7f08ec0b23d0 2023-10-14T12:19:05.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 -- 172.21.15.32:0/2319278012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 msgr2=0x7f08ec0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:05.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0cfc60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0d0430 tx=0x7f08e400d430 comp rx=0 tx=0).stop 2023-10-14T12:19:05.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 -- 172.21.15.32:0/2319278012 shutdown_connections 2023-10-14T12:19:05.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0cfc60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2319278012 >> v2:172.21.15.92:3300/0 conn(0x7f08ec15ab10 0x7f08ec15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2319278012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec0b1f50 0x7f08ec0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 -- 172.21.15.32:0/2319278012 >> 172.21.15.32:0/2319278012 conn(0x7f08ec06dae0 msgr2=0x7f08ec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:05.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 -- 172.21.15.32:0/2319278012 shutdown_connections 2023-10-14T12:19:05.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.026+0000 7f08f1d58700 1 -- 172.21.15.32:0/2319278012 wait complete. 2023-10-14T12:19:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.027+0000 7f08f1d58700 1 Processor -- start 2023-10-14T12:19:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 -- start start 2023-10-14T12:19:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ec0b1f50 0x7f08ec156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec15ab10 0x7f08ec0adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0ae1b0 con 0x7f08ec0b23d0 2023-10-14T12:19:05.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0ae490 con 0x7f08ec0b1f50 2023-10-14T12:19:05.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08f1d58700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0ae770 con 0x7f08ec15ab10 2023-10-14T12:19:05.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.028+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38716/0 (socket says 172.21.15.32:38716) 2023-10-14T12:19:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 -- 172.21.15.32:0/2971233133 learned_addr learned my addr 172.21.15.32:0/2971233133 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 -- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec15ab10 msgr2=0x7f08ec0adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eb7fe700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ec0b1f50 0x7f08ec156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08ebfff700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec15ab10 0x7f08ec0adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec15ab10 0x7f08ec0adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 -- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ec0b1f50 msgr2=0x7f08ec156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ec0b1f50 0x7f08ec156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 -- 172.21.15.32:0/2971233133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e400bd40 con 0x7f08ec0b23d0 2023-10-14T12:19:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08eaffd700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0ad640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08d400e810 tx=0x7f08d400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4005c20 con 0x7f08ec0b23d0 2023-10-14T12:19:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d4005d80 con 0x7f08ec0b23d0 2023-10-14T12:19:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec0aea50 con 0x7f08ec0b23d0 2023-10-14T12:19:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4004250 con 0x7f08ec0b23d0 2023-10-14T12:19:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.029+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec0ca450 con 0x7f08ec0b23d0 2023-10-14T12:19:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.030+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec067d20 con 0x7f08ec0b23d0 2023-10-14T12:19:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.030+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f08d40043b0 con 0x7f08ec0b23d0 2023-10-14T12:19:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.031+0000 7f08e3fff700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f08cc06af00 0x7f08cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.031+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08d40892f0 con 0x7f08ec0b23d0 2023-10-14T12:19:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.031+0000 7f08eb7fe700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f08cc06af00 0x7f08cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.032+0000 7f08eb7fe700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f08cc06af00 0x7f08cc06d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009930 tx=0x7f08dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.036+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08d40543a0 con 0x7f08ec0b23d0 2023-10-14T12:19:05.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.281+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08ec15f510 con 0x7f08ec0b23d0 2023-10-14T12:19:05.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.282+0000 7f08e3fff700 1 -- 172.21.15.32:0/2971233133 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08d40579c0 con 0x7f08ec0b23d0 2023-10-14T12:19:05.283 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T12:19:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.283+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f08cc06af00 msgr2=0x7f08cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.283+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f08cc06af00 0x7f08cc06d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009930 tx=0x7f08dc008040 comp rx=0 tx=0).stop 2023-10-14T12:19:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.283+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 msgr2=0x7f08ec0ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.283+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0ad640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08d400e810 tx=0x7f08d400ebd0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 shutdown_connections 2023-10-14T12:19:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08ec15ab10 0x7f08ec0adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f08cc06af00 0x7f08cc06d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ec0b1f50 0x7f08ec156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 --2- 172.21.15.32:0/2971233133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0b23d0 0x7f08ec0ad640 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 >> 172.21.15.32:0/2971233133 conn(0x7f08ec06dae0 msgr2=0x7f08ec0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 shutdown_connections 2023-10-14T12:19:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:05.284+0000 7f08f1d58700 1 -- 172.21.15.32:0/2971233133 wait complete. 2023-10-14T12:19:05.297 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:19:05.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:19:05.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-10-14T12:19:05.298 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T12:19:05.299 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T12:19:05.299 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:19:05.299 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:19:05.299 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:19:05.302 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T12:19:05.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.304 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-10-14T12:19:05.322 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:05.322 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:05.322 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:05.323 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.323 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:05.323 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.323 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:05.323 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:05.324 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:05.324 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:05.324 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:19:05.324 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:05.325 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T12:19:05.325 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42335sec preferred_lft 42335sec 2023-10-14T12:19:05.325 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-10-14T12:19:05.325 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.325 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:05.325 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:05.326 INFO:teuthology.orchestra.run.smithi032.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:05.326 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 76:d4:34:dc:09:50 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:05.326 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:19:05.326 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.326 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ec1c:b2ff:feed:fd16/64 scope link tentative 2023-10-14T12:19:05.327 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.327 INFO:teuthology.orchestra.run.smithi032.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:19:05.327 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 76:d4:34:dc:09:50 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:19:05.327 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::74d4:34ff:fedc:950/64 scope link tentative 2023-10-14T12:19:05.327 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.328 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:19:05.388 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-10-14T12:19:05.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.390 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-10-14T12:19:05.448 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-10-14T12:19:05.449 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:19:05.449 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T12:19:05.449 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T12:19:05.449 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:19:05.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.451 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:05.451 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:05.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T12:19:05.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T12:19:05.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T12:19:05.453 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:05.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.557 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:05.574 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:19:05.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.575 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-10-14T12:19:05.632 INFO:teuthology.orchestra.run.smithi032.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T12:19:05.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.633 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:05.634 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:05.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:19:05.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T12:19:05.634 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:05.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.727 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T12:19:05.774 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.775 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether b2:f6:7f:81:89:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:19:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:19:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::b0f6:7fff:fe81:893f/64 scope link 2023-10-14T12:19:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T12:19:05.825 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.826 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether b2:f6:7f:81:89:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:19:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:19:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::b0f6:7fff:fe81:893f/64 scope link 2023-10-14T12:19:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:05.833 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T12:19:05.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:05.834 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:05.834 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:05.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T12:19:05.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T12:19:05.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T12:19:05.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T12:19:05.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T12:19:05.836 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:06.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.080 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:06.080 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:06.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.1 up 2023-10-14T12:19:06.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T12:19:06.081 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:06.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:06.200 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T12:19:06.230 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T12:19:06.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:06.231 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T12:19:06.288 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-14T12:19:06.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:06.376 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:06.376 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:06.405 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:06.405 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:06.406 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:06.406 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 2@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:06.406 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:06.406 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:06.479 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:06.480 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:06.480 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:06.480 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 2@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:06.480 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:06.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:06.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:06.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:06.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T12:19:06.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T12:19:06.482 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed" will pass to kernel 2023-10-14T12:19:06.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:19:06.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T12:19:06.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.511 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:06.584 INFO:teuthology.orchestra.run.smithi032.stdout:client4591 2023-10-14T12:19:06.585 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:06.585 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:06.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.645 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:06.718 INFO:teuthology.orchestra.run.smithi032.stdout:client4591 2023-10-14T12:19:06.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.719 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:06.791 INFO:teuthology.orchestra.run.smithi032.stdout:client4591 2023-10-14T12:19:06.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:06.792 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.client4591/status') 2023-10-14T12:19:06.873 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4591 (3)172.21.15.32:0/1619311778 2023-10-14T12:19:06.874 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2023-10-14T12:19:06.875 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2023-10-14T12:19:06.875 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2023-10-14T12:19:06.876 INFO:teuthology.orchestra.run.smithi032.stderr:70 bytes copied, 2.8521e-05 s, 2.5 MB/s 2023-10-14T12:19:06.876 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-14T12:19:06.876 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:19:06.876 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T12:19:06.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:19:07.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.039+0000 7f53ce15f700 1 Processor -- start 2023-10-14T12:19:07.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.039+0000 7f53ce15f700 1 -- start start 2023-10-14T12:19:07.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.039+0000 7f53ce15f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f53c80cfe30 0x7f53c80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.039+0000 7f53ce15f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c815e7a0 con 0x7f53c815f1f0 2023-10-14T12:19:07.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.039+0000 7f53ce15f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80b29a0 con 0x7f53c815ab10 2023-10-14T12:19:07.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.039+0000 7f53ce15f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80b2c80 con 0x7f53c80cfe30 2023-10-14T12:19:07.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c6ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f53c815f1f0 0x7f53c80cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55754/0 (socket says 172.21.15.32:55754) 2023-10-14T12:19:07.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c6ffd700 1 -- 172.21.15.32:0/3656705253 learned_addr learned my addr 172.21.15.32:0/3656705253 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:07.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c7fff700 1 --2- 172.21.15.32:0/3656705253 >> v2:172.21.15.92:3300/0 conn(0x7f53c80cfe30 0x7f53c80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828552552 0 0) 0x7f53c815e7a0 con 0x7f53c815f1f0 2023-10-14T12:19:07.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b00057c0 con 0x7f53c815f1f0 2023-10-14T12:19:07.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531709626 0 0) 0x7f53b00057c0 con 0x7f53c815f1f0 2023-10-14T12:19:07.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 >> v2:172.21.15.92:3300/0 conn(0x7f53c80cfe30 msgr2=0x7f53c80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:07.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 --2- 172.21.15.32:0/3656705253 >> v2:172.21.15.92:3300/0 conn(0x7f53c80cfe30 0x7f53c80cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 >> v1:172.21.15.92:6789/0 conn(0x7f53c815ab10 legacy=0x7f53c80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c815e9f0 con 0x7f53c815f1f0 2023-10-14T12:19:07.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f53bc0017f0 con 0x7f53c815f1f0 2023-10-14T12:19:07.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 >> v1:172.21.15.32:6789/0 conn(0x7f53c815f1f0 legacy=0x7f53c80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53b0005c10 0x7f53b0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b0006610 0x7f53b0006ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00072e0 0x7f53b000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80b2c80 con 0x7f53b00072e0 2023-10-14T12:19:07.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b000e240 con 0x7f53b0006610 2023-10-14T12:19:07.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b000e400 con 0x7f53b0005c10 2023-10-14T12:19:07.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.040+0000 7f53c7fff700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00072e0 0x7f53b000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c77fe700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53b0005c10 0x7f53b0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c6ffd700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b0006610 0x7f53b0006ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 -- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53b0005c10 msgr2=0x7f53b0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:07.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53b0005c10 0x7f53b0005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 -- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b0006610 msgr2=0x7f53b0006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:07.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b0006610 0x7f53b0006ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 -- 172.21.15.32:0/3656705253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00057c0 con 0x7f53b00072e0 2023-10-14T12:19:07.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c6ffd700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b0006610 0x7f53b0006ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:07.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 -- 172.21.15.32:0/3656705253 reap_dead start 2023-10-14T12:19:07.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c7fff700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00072e0 0x7f53b000dc20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b30 tx=0x7f53b0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591a5eeec0352015 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:07.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000e6c0 con 0x7f53b00072e0 2023-10-14T12:19:07.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000e820 con 0x7f53b00072e0 2023-10-14T12:19:07.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.041+0000 7f53c67fc700 1 -- 172.21.15.32:0/3656705253 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000ebb0 con 0x7f53b00072e0 2023-10-14T12:19:07.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 -- 172.21.15.32:0/3656705253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00072e0 msgr2=0x7f53b000dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00072e0 0x7f53b000dc20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b30 tx=0x7f53b0007a90 comp rx=0 tx=0).stop 2023-10-14T12:19:07.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 -- 172.21.15.32:0/3656705253 shutdown_connections 2023-10-14T12:19:07.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 --2- 172.21.15.32:0/3656705253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b00072e0 0x7f53b000dc20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 -- 172.21.15.32:0/3656705253 >> 172.21.15.32:0/3656705253 conn(0x7f53c806dae0 msgr2=0x7f53c806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:07.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 -- 172.21.15.32:0/3656705253 shutdown_connections 2023-10-14T12:19:07.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.042+0000 7f53ce15f700 1 -- 172.21.15.32:0/3656705253 wait complete. 2023-10-14T12:19:07.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.043+0000 7f53ce15f700 1 Processor -- start 2023-10-14T12:19:07.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.043+0000 7f53ce15f700 1 -- start start 2023-10-14T12:19:07.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53ce15f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b00072e0 0x7f53c815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53ce15f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 0x7f53c80ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53ce15f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53c8156940 0x7f53c81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53ce15f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80ae2a0 con 0x7f53c80cd7c0 2023-10-14T12:19:07.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53ce15f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c815d5c0 con 0x7f53b00072e0 2023-10-14T12:19:07.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53ce15f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c815d8a0 con 0x7f53c8156940 2023-10-14T12:19:07.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 0x7f53c80ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 0x7f53c80ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38744/0 (socket says 172.21.15.32:38744) 2023-10-14T12:19:07.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 -- 172.21.15.32:0/1237161545 learned_addr learned my addr 172.21.15.32:0/1237161545 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:07.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c77fe700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b00072e0 0x7f53c815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c7fff700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53c8156940 0x7f53c81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 -- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53c8156940 msgr2=0x7f53c81598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53c8156940 0x7f53c81598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 -- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b00072e0 msgr2=0x7f53c815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b00072e0 0x7f53c815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 -- 172.21.15.32:0/1237161545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c815db80 con 0x7f53c80cd7c0 2023-10-14T12:19:07.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c7fff700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53c8156940 0x7f53c81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:07.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.044+0000 7f53c6ffd700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 0x7f53c80ae760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00e7b0 tx=0x7f53bc00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:07.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.045+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0072e0 con 0x7f53c80cd7c0 2023-10-14T12:19:07.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.045+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc007440 con 0x7f53c80cd7c0 2023-10-14T12:19:07.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.045+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80cdc40 con 0x7f53c80cd7c0 2023-10-14T12:19:07.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.045+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc005830 con 0x7f53c80cd7c0 2023-10-14T12:19:07.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.045+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c815bee0 con 0x7f53c80cd7c0 2023-10-14T12:19:07.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.046+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c8067ae0 con 0x7f53c80cd7c0 2023-10-14T12:19:07.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.046+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53bc005990 con 0x7f53c80cd7c0 2023-10-14T12:19:07.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.047+0000 7f53affff700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f53b406af00 0x7f53b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:07.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.047+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53bc088d40 con 0x7f53c80cd7c0 2023-10-14T12:19:07.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.047+0000 7f53c77fe700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f53b406af00 0x7f53b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:07.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.047+0000 7f53c77fe700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f53b406af00 0x7f53b406d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f53b8012490 tx=0x7f53b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:07.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.051+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53bc053eb0 con 0x7f53c80cd7c0 2023-10-14T12:19:07.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.296+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53c80ca8a0 con 0x7f53c80cd7c0 2023-10-14T12:19:07.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.297+0000 7f53affff700 1 -- 172.21.15.32:0/1237161545 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53bc019070 con 0x7f53c80cd7c0 2023-10-14T12:19:07.299 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T12:19:07.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f53b406af00 msgr2=0x7f53b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f53b406af00 0x7f53b406d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f53b8012490 tx=0x7f53b8009040 comp rx=0 tx=0).stop 2023-10-14T12:19:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 msgr2=0x7f53c80ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 0x7f53c80ae760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00e7b0 tx=0x7f53bc00eac0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 shutdown_connections 2023-10-14T12:19:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53c8156940 0x7f53c81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f53b406af00 0x7f53b406d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53b00072e0 0x7f53c815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 --2- 172.21.15.32:0/1237161545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53c80cd7c0 0x7f53c80ae760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 >> 172.21.15.32:0/1237161545 conn(0x7f53c806dae0 msgr2=0x7f53c80b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 shutdown_connections 2023-10-14T12:19:07.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:07.299+0000 7f53ce15f700 1 -- 172.21.15.32:0/1237161545 wait complete. 2023-10-14T12:19:07.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:19:07.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:19:07.313 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-10-14T12:19:07.313 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T12:19:07.313 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T12:19:07.314 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:19:07.314 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:19:07.314 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:19:07.314 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T12:19:07.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.315 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-10-14T12:19:07.336 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:07.337 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:07.338 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:07.338 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:07.338 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:07.339 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:07.339 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:19:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:19:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42377sec preferred_lft 42377sec 2023-10-14T12:19:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::4bf3:5473:1210:5e06/64 scope link noprefixroute 2023-10-14T12:19:07.340 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:07.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:19:07.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.341 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:07.342 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:07.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:19:07.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2023-10-14T12:19:07.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2023-10-14T12:19:07.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:19:07.343 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:07.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.532 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:19:07.567 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-14T12:19:07.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.569 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-10-14T12:19:07.645 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-10-14T12:19:07.645 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:19:07.646 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:19:07.646 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:19:07.646 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:19:07.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.647 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:07.647 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:07.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:19:07.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:19:07.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:19:07.649 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:07.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.899 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T12:19:07.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.916 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-10-14T12:19:07.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:07.973 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:07.974 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:07.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:19:07.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T12:19:07.975 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:08.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T12:19:08.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.068 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:08.068 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:08.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T12:19:08.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:19:08.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T12:19:08.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T12:19:08.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T12:19:08.070 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:08.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.265 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:08.266 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:08.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-10-14T12:19:08.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:19:08.267 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:08.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:08.375 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T12:19:08.395 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T12:19:08.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:08.396 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T12:19:08.451 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-14T12:19:08.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:08.547 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:08.547 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:08.660 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:08.660 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:08.661 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:08.661 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with new device syntax: 1@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:08.661 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:08.661 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:08.661 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:08.662 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with new device syntax: 1@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T12:19:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T12:19:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed" will pass to kernel 2023-10-14T12:19:08.710 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:19:08.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T12:19:08.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.737 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:08.809 INFO:teuthology.orchestra.run.smithi092.stdout:client4603 2023-10-14T12:19:08.810 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:08.810 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:08.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.867 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:08.939 INFO:teuthology.orchestra.run.smithi092.stdout:client4603 2023-10-14T12:19:08.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:08.940 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:09.010 INFO:teuthology.orchestra.run.smithi092.stdout:client4603 2023-10-14T12:19:09.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.011 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.client4603/status') 2023-10-14T12:19:09.090 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.4603 (3)192.168.0.1:0/4275871751 2023-10-14T12:19:09.091 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2023-10-14T12:19:09.092 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2023-10-14T12:19:09.092 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2023-10-14T12:19:09.092 INFO:teuthology.orchestra.run.smithi092.stderr:69 bytes copied, 2.1406e-05 s, 3.2 MB/s 2023-10-14T12:19:09.093 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-14T12:19:09.093 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:19:09.093 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T12:19:09.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:19:09.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.232+0000 7f030ad6c700 1 Processor -- start 2023-10-14T12:19:09.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.232+0000 7f030ad6c700 1 -- start start 2023-10-14T12:19:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f030ad6c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0304157d40 0x7f03040cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f030ad6c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f030406de50 0x7f030415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f030ad6c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f030406e2b0 0x7f030415e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f030ad6c700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0304158120 con 0x7f0304157d40 2023-10-14T12:19:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f030ad6c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030406a840 con 0x7f030406e2b0 2023-10-14T12:19:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f030ad6c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03040cc530 con 0x7f030406de50 2023-10-14T12:19:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0304157d40 0x7f03040cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0304157d40 0x7f03040cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38748/0 (socket says 172.21.15.32:38748) 2023-10-14T12:19:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 -- 172.21.15.32:0/1899200242 learned_addr learned my addr 172.21.15.32:0/1899200242 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0303fff700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f030406de50 0x7f030415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0309309700 1 --2- 172.21.15.32:0/1899200242 >> v2:172.21.15.92:3300/0 conn(0x7f030406e2b0 0x7f030415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 -- 172.21.15.32:0/1899200242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f030406de50 msgr2=0x7f030415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f030406de50 0x7f030415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 -- 172.21.15.32:0/1899200242 >> v2:172.21.15.92:3300/0 conn(0x7f030406e2b0 msgr2=0x7f030415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 --2- 172.21.15.32:0/1899200242 >> v2:172.21.15.92:3300/0 conn(0x7f030406e2b0 0x7f030415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 -- 172.21.15.32:0/1899200242 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040caef0 con 0x7f0304157d40 2023-10-14T12:19:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0309309700 1 --2- 172.21.15.32:0/1899200242 >> v2:172.21.15.92:3300/0 conn(0x7f030406e2b0 0x7f030415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:09.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0303fff700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f030406de50 0x7f030415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:09.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.233+0000 7f0308b08700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0304157d40 0x7f03040cee90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03040ca470 tx=0x7f02f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2b6f30fc770872 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:09.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f03037fe700 1 -- 172.21.15.32:0/1899200242 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800b870 con 0x7f0304157d40 2023-10-14T12:19:09.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f03037fe700 1 -- 172.21.15.32:0/1899200242 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800b9d0 con 0x7f0304157d40 2023-10-14T12:19:09.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f03037fe700 1 -- 172.21.15.32:0/1899200242 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800bd60 con 0x7f0304157d40 2023-10-14T12:19:09.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 -- 172.21.15.32:0/1899200242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0304157d40 msgr2=0x7f03040cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:09.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0304157d40 0x7f03040cee90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03040ca470 tx=0x7f02f8009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 -- 172.21.15.32:0/1899200242 shutdown_connections 2023-10-14T12:19:09.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 --2- 172.21.15.32:0/1899200242 >> v2:172.21.15.92:3300/0 conn(0x7f030406e2b0 0x7f030415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0304157d40 0x7f03040cee90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 --2- 172.21.15.32:0/1899200242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f030406de50 0x7f030415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 -- 172.21.15.32:0/1899200242 >> 172.21.15.32:0/1899200242 conn(0x7f03040cc6f0 msgr2=0x7f03040ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:09.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 -- 172.21.15.32:0/1899200242 shutdown_connections 2023-10-14T12:19:09.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.234+0000 7f030ad6c700 1 -- 172.21.15.32:0/1899200242 wait complete. 2023-10-14T12:19:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 Processor -- start 2023-10-14T12:19:09.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 -- start start 2023-10-14T12:19:09.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 0x7f03040c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f030406e2b0 0x7f03040c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0304157d40 0x7f030406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040c4bd0 con 0x7f030406de50 2023-10-14T12:19:09.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.236+0000 7f030ad6c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040c6fe0 con 0x7f030406e2b0 2023-10-14T12:19:09.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f030ad6c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03040c3fc0 con 0x7f0304157d40 2023-10-14T12:19:09.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 0x7f03040c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 0x7f03040c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38754/0 (socket says 172.21.15.32:38754) 2023-10-14T12:19:09.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 -- 172.21.15.32:0/2032434132 learned_addr learned my addr 172.21.15.32:0/2032434132 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:09.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0309309700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0304157d40 0x7f030406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0303fff700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f030406e2b0 0x7f03040c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 -- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0304157d40 msgr2=0x7f030406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:09.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0304157d40 0x7f030406aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 -- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f030406e2b0 msgr2=0x7f03040c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:09.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f030406e2b0 0x7f03040c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 -- 172.21.15.32:0/2032434132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8009550 con 0x7f030406de50 2023-10-14T12:19:09.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0303fff700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f030406e2b0 0x7f03040c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:09.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f0308b08700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 0x7f03040c9840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f02f8014040 tx=0x7f02f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:09.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8004520 con 0x7f030406de50 2023-10-14T12:19:09.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f801e070 con 0x7f030406de50 2023-10-14T12:19:09.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80038e0 con 0x7f030406de50 2023-10-14T12:19:09.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040c42a0 con 0x7f030406de50 2023-10-14T12:19:09.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.237+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03040c4860 con 0x7f030406de50 2023-10-14T12:19:09.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.238+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0304067d20 con 0x7f030406de50 2023-10-14T12:19:09.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.239+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02f8003a40 con 0x7f030406de50 2023-10-14T12:19:09.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.239+0000 7f03017fa700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f02e806af00 0x7f02e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:09.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.239+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02f8020070 con 0x7f030406de50 2023-10-14T12:19:09.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.239+0000 7f0303fff700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f02e806af00 0x7f02e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:09.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.240+0000 7f0303fff700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f02e806af00 0x7f02e806d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02f0006fd0 tx=0x7f02f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:09.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.244+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02f8055db0 con 0x7f030406de50 2023-10-14T12:19:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.492+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f030406efe0 con 0x7f030406de50 2023-10-14T12:19:09.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.492+0000 7f03017fa700 1 -- 172.21.15.32:0/2032434132 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f02f802a020 con 0x7f030406de50 2023-10-14T12:19:09.494 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T12:19:09.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f02e806af00 msgr2=0x7f02e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:09.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f02e806af00 0x7f02e806d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02f0006fd0 tx=0x7f02f0008040 comp rx=0 tx=0).stop 2023-10-14T12:19:09.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 msgr2=0x7f03040c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:09.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 0x7f03040c9840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f02f8014040 tx=0x7f02f8004750 comp rx=0 tx=0).stop 2023-10-14T12:19:09.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 shutdown_connections 2023-10-14T12:19:09.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0304157d40 0x7f030406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030406de50 0x7f03040c9840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f02e806af00 0x7f02e806d3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 --2- 172.21.15.32:0/2032434132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f030406e2b0 0x7f03040c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:09.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 >> 172.21.15.32:0/2032434132 conn(0x7f03040cc6f0 msgr2=0x7f03040afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:09.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 shutdown_connections 2023-10-14T12:19:09.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:09.494+0000 7f030ad6c700 1 -- 172.21.15.32:0/2032434132 wait complete. 2023-10-14T12:19:09.508 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:19:09.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:19:09.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-10-14T12:19:09.508 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T12:19:09.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T12:19:09.509 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:19:09.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:19:09.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:19:09.510 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T12:19:09.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.510 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-10-14T12:19:09.528 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:09.528 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.529 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:09.529 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:09.530 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:09.530 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:09.530 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:09.530 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:19:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:19:09.531 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-10-14T12:19:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::4bf3:5473:1210:5e06/64 scope link noprefixroute 2023-10-14T12:19:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.532 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether a6:cc:63:f6:06:57 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:09.532 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:19:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c45b:9fff:fec1:926a/64 scope link 2023-10-14T12:19:09.533 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.533 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:19:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether a6:cc:63:f6:06:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:19:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::a4cc:63ff:fef6:657/64 scope link tentative 2023-10-14T12:19:09.534 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.535 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:19:09.593 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-14T12:19:09.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.595 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-10-14T12:19:09.654 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-10-14T12:19:09.654 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:19:09.654 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:19:09.655 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:19:09.655 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:19:09.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.656 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:09.656 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:09.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:19:09.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:19:09.657 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:19:09.657 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:09.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.759 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T12:19:09.775 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T12:19:09.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.776 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-10-14T12:19:09.833 INFO:teuthology.orchestra.run.smithi092.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T12:19:09.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.834 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:09.834 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:09.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:19:09.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T12:19:09.835 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:09.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.927 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T12:19:09.961 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:09.962 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:09.962 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:09.962 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.962 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:09.962 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.963 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:09.963 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 72:cd:45:81:e8:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:19:09.963 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:19:09.963 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.964 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::70cd:45ff:fe81:e8fc/64 scope link 2023-10-14T12:19:09.964 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:09.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:09.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T12:19:10.060 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:10.060 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:10.061 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:10.061 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:10.061 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:10.061 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:10.062 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:10.062 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 72:cd:45:81:e8:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:19:10.062 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:19:10.062 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:10.062 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::70cd:45ff:fe81:e8fc/64 scope link 2023-10-14T12:19:10.063 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:10.072 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T12:19:10.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.073 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:10.074 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:10.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T12:19:10.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T12:19:10.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T12:19:10.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T12:19:10.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T12:19:10.075 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:10.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.269 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T12:19:10.270 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T12:19:10.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.1 up 2023-10-14T12:19:10.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T12:19:10.271 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T12:19:10.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:10.399 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T12:19:10.419 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T12:19:10.419 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:10.420 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T12:19:10.475 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-14T12:19:10.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:10.560 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:10.561 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:10.588 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:10.588 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:10.589 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:10.589 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with new device syntax: 3@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:10.589 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:10.589 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:10.589 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:10.590 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:10.612 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:10.613 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:10.613 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:10.613 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with new device syntax: 3@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:10.613 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:10.614 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:10.614 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:10.614 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:10.614 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T12:19:10.614 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T12:19:10.615 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed" will pass to kernel 2023-10-14T12:19:10.616 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:19:10.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.616 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T12:19:10.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.646 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:10.718 INFO:teuthology.orchestra.run.smithi092.stdout:client4484 2023-10-14T12:19:10.719 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:10.719 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:10.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.776 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:10.848 INFO:teuthology.orchestra.run.smithi092.stdout:client4484 2023-10-14T12:19:10.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.849 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:19:10.920 INFO:teuthology.orchestra.run.smithi092.stdout:client4484 2023-10-14T12:19:10.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:10.921 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.client4484/status') 2023-10-14T12:19:10.999 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.4484 (3)192.168.0.2:0/144005279 2023-10-14T12:19:11.000 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2023-10-14T12:19:11.001 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2023-10-14T12:19:11.001 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2023-10-14T12:19:11.001 INFO:teuthology.orchestra.run.smithi092.stderr:68 bytes copied, 2.0695e-05 s, 3.3 MB/s 2023-10-14T12:19:11.002 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T12:19:11.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:11.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.160+0000 7f5356378700 1 Processor -- start 2023-10-14T12:19:11.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.160+0000 7f5356378700 1 -- start start 2023-10-14T12:19:11.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5356378700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f53500cd950 0x7f535015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5356378700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53500cede0 0x7f535015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5356378700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500cf260 con 0x7f535006a840 2023-10-14T12:19:11.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5356378700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53501619a0 con 0x7f53500cd950 2023-10-14T12:19:11.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5356378700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500b2d60 con 0x7f53500cede0 2023-10-14T12:19:11.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5354915700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f535006a840 0x7f5350161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55794/0 (socket says 172.21.15.32:55794) 2023-10-14T12:19:11.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.161+0000 7f5354915700 1 -- 172.21.15.32:0/3271369381 learned_addr learned my addr 172.21.15.32:0/3271369381 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:11.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534f7fe700 1 --2- 172.21.15.32:0/3271369381 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53500cede0 0x7f535015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534ffff700 1 --2- 172.21.15.32:0/3271369381 >> v2:172.21.15.92:3300/0 conn(0x7f53500cd950 0x7f535015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534effd700 1 -- 172.21.15.32:0/3271369381 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421920902 0 0) 0x7f53500cf260 con 0x7f535006a840 2023-10-14T12:19:11.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534effd700 1 -- 172.21.15.32:0/3271369381 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53380035b0 con 0x7f535006a840 2023-10-14T12:19:11.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534effd700 1 -- 172.21.15.32:0/3271369381 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349220976 0 0) 0x7f53380035b0 con 0x7f535006a840 2023-10-14T12:19:11.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534f7fe700 1 -- 172.21.15.32:0/3271369381 >> v2:172.21.15.92:3300/0 conn(0x7f53500cd950 msgr2=0x7f535015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:11.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534f7fe700 1 --2- 172.21.15.32:0/3271369381 >> v2:172.21.15.92:3300/0 conn(0x7f53500cd950 0x7f535015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534f7fe700 1 -- 172.21.15.32:0/3271369381 >> v1:172.21.15.32:6789/0 conn(0x7f535006a840 legacy=0x7f5350161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534f7fe700 1 -- 172.21.15.32:0/3271369381 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500cdd30 con 0x7f53500cede0 2023-10-14T12:19:11.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534ffff700 1 --2- 172.21.15.32:0/3271369381 >> v2:172.21.15.92:3300/0 conn(0x7f53500cd950 0x7f535015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:11.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534f7fe700 1 --2- 172.21.15.32:0/3271369381 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53500cede0 0x7f535015f570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5344009820 tx=0x7f5344009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c6a766891600f48 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534effd700 1 -- 172.21.15.32:0/3271369381 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480019f0 con 0x7f53500cede0 2023-10-14T12:19:11.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534effd700 1 -- 172.21.15.32:0/3271369381 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344005c30 con 0x7f53500cede0 2023-10-14T12:19:11.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.162+0000 7f534effd700 1 -- 172.21.15.32:0/3271369381 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344004030 con 0x7f53500cede0 2023-10-14T12:19:11.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 -- 172.21.15.32:0/3271369381 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53500cede0 msgr2=0x7f535015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 --2- 172.21.15.32:0/3271369381 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53500cede0 0x7f535015f570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5344009820 tx=0x7f5344009b30 comp rx=0 tx=0).stop 2023-10-14T12:19:11.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 -- 172.21.15.32:0/3271369381 shutdown_connections 2023-10-14T12:19:11.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 --2- 172.21.15.32:0/3271369381 >> v2:172.21.15.92:3300/0 conn(0x7f53500cd950 0x7f535015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 --2- 172.21.15.32:0/3271369381 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53500cede0 0x7f535015f570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 -- 172.21.15.32:0/3271369381 >> 172.21.15.32:0/3271369381 conn(0x7f535006dae0 msgr2=0x7f535006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:11.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 -- 172.21.15.32:0/3271369381 shutdown_connections 2023-10-14T12:19:11.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.163+0000 7f5356378700 1 -- 172.21.15.32:0/3271369381 wait complete. 2023-10-14T12:19:11.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.164+0000 7f5356378700 1 Processor -- start 2023-10-14T12:19:11.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.164+0000 7f5356378700 1 -- start start 2023-10-14T12:19:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5356378700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f535006a840 0x7f535015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5356378700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53500cd950 0x7f53500c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5356378700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 0x7f53500b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5356378700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500ae490 con 0x7f53500cede0 2023-10-14T12:19:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5356378700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500adb60 con 0x7f53500cd950 2023-10-14T12:19:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5356378700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500ade40 con 0x7f535006a840 2023-10-14T12:19:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5354915700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 0x7f53500b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5354915700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 0x7f53500b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38778/0 (socket says 172.21.15.32:38778) 2023-10-14T12:19:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.165+0000 7f5354915700 1 -- 172.21.15.32:0/1322505219 learned_addr learned my addr 172.21.15.32:0/1322505219 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:11.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f534ffff700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f535006a840 0x7f535015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f534f7fe700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53500cd950 0x7f53500c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5354915700 1 -- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f535006a840 msgr2=0x7f535015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5354915700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f535006a840 0x7f535015c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5354915700 1 -- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53500cd950 msgr2=0x7f53500c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5354915700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53500cd950 0x7f53500c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5354915700 1 -- 172.21.15.32:0/1322505219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400094a0 con 0x7f53500cede0 2023-10-14T12:19:11.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5354915700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 0x7f53500b5480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f534800cca0 tx=0x7f534800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800cea0 con 0x7f53500cede0 2023-10-14T12:19:11.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800ae00 con 0x7f53500cede0 2023-10-14T12:19:11.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5344009430 con 0x7f53500cede0 2023-10-14T12:19:11.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348007310 con 0x7f53500cede0 2023-10-14T12:19:11.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.166+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53500c75a0 con 0x7f53500cede0 2023-10-14T12:19:11.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.167+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53500ae600 con 0x7f53500cede0 2023-10-14T12:19:11.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.167+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5348007470 con 0x7f53500cede0 2023-10-14T12:19:11.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.168+0000 7f534cff9700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f533c06af00 0x7f533c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.168+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5348089280 con 0x7f53500cede0 2023-10-14T12:19:11.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.168+0000 7f534ffff700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f533c06af00 0x7f533c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.169+0000 7f534ffff700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f533c06af00 0x7f533c06d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53500b0660 tx=0x7f5340008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.173+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53480542b0 con 0x7f53500cede0 2023-10-14T12:19:11.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.376+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5350067d20 con 0x7f53500cede0 2023-10-14T12:19:11.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.377+0000 7f534cff9700 1 -- 172.21.15.32:0/1322505219 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f53480578d0 con 0x7f53500cede0 2023-10-14T12:19:11.379 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:11.379 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:11.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f533c06af00 msgr2=0x7f533c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f533c06af00 0x7f533c06d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53500b0660 tx=0x7f5340008040 comp rx=0 tx=0).stop 2023-10-14T12:19:11.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 msgr2=0x7f53500b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 0x7f53500b5480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f534800cca0 tx=0x7f534800a340 comp rx=0 tx=0).stop 2023-10-14T12:19:11.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 shutdown_connections 2023-10-14T12:19:11.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53500cede0 0x7f53500b5480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f535006a840 0x7f535015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f533c06af00 0x7f533c06d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 --2- 172.21.15.32:0/1322505219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53500cd950 0x7f53500c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 >> 172.21.15.32:0/1322505219 conn(0x7f535006dae0 msgr2=0x7f53500b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:11.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 shutdown_connections 2023-10-14T12:19:11.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.379+0000 7f5356378700 1 -- 172.21.15.32:0/1322505219 wait complete. 2023-10-14T12:19:11.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:11.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:11.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.523+0000 7f29d70eb700 1 Processor -- start 2023-10-14T12:19:11.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29d70eb700 1 -- start start 2023-10-14T12:19:11.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29d70eb700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29d00cf8a0 0x7f29d00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29d70eb700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d015ee90 con 0x7f29d015eab0 2023-10-14T12:19:11.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29d70eb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d0158370 con 0x7f29d00d1bc0 2023-10-14T12:19:11.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29d70eb700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d00d23b0 con 0x7f29d00cf8a0 2023-10-14T12:19:11.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29cffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29d00cf8a0 0x7f29d00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29d00cf8a0 0x7f29d00d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38788/0 (socket says 172.21.15.32:38788) 2023-10-14T12:19:11.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.524+0000 7f29d4e87700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f29d015eab0 0x7f29d00cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55810/0 (socket says 172.21.15.32:55810) 2023-10-14T12:19:11.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cffff700 1 -- 172.21.15.32:0/3098015703 learned_addr learned my addr 172.21.15.32:0/3098015703 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:11.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cffff700 1 -- 172.21.15.32:0/3098015703 >> v1:172.21.15.92:6789/0 conn(0x7f29d00d1bc0 legacy=0x7f29d00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cffff700 1 -- 172.21.15.32:0/3098015703 >> v1:172.21.15.32:6789/0 conn(0x7f29d015eab0 legacy=0x7f29d00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cffff700 1 -- 172.21.15.32:0/3098015703 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00cda20 con 0x7f29d00cf8a0 2023-10-14T12:19:11.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cf7fe700 1 -- 172.21.15.32:0/3098015703 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941055248 0 0) 0x7f29d015ee90 con 0x7f29d015eab0 2023-10-14T12:19:11.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cffff700 1 --2- 172.21.15.32:0/3098015703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00cf8a0 0x7f29d00d1680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0098f0 tx=0x7f29bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0f32ad0d568fd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cf7fe700 1 -- 172.21.15.32:0/3098015703 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00b8a0 con 0x7f29d00cf8a0 2023-10-14T12:19:11.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cf7fe700 1 -- 172.21.15.32:0/3098015703 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00ba00 con 0x7f29d00cf8a0 2023-10-14T12:19:11.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.525+0000 7f29cf7fe700 1 -- 172.21.15.32:0/3098015703 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bd90 con 0x7f29d00cf8a0 2023-10-14T12:19:11.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 -- 172.21.15.32:0/3098015703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00cf8a0 msgr2=0x7f29d00d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 --2- 172.21.15.32:0/3098015703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00cf8a0 0x7f29d00d1680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0098f0 tx=0x7f29bc009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:11.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 -- 172.21.15.32:0/3098015703 shutdown_connections 2023-10-14T12:19:11.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 --2- 172.21.15.32:0/3098015703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00cf8a0 0x7f29d00d1680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 -- 172.21.15.32:0/3098015703 >> 172.21.15.32:0/3098015703 conn(0x7f29d00665a0 msgr2=0x7f29d0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:11.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 -- 172.21.15.32:0/3098015703 shutdown_connections 2023-10-14T12:19:11.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.526+0000 7f29d70eb700 1 -- 172.21.15.32:0/3098015703 wait complete. 2023-10-14T12:19:11.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.527+0000 7f29d70eb700 1 Processor -- start 2023-10-14T12:19:11.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.527+0000 7f29d70eb700 1 -- start start 2023-10-14T12:19:11.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d00cf8a0 0x7f29d00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 0x7f29d00b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d015eab0 0x7f29d00b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d015f4b0 con 0x7f29d00d1bc0 2023-10-14T12:19:11.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00b6a00 con 0x7f29d015eab0 2023-10-14T12:19:11.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0150240 con 0x7f29d00cf8a0 2023-10-14T12:19:11.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 0x7f29d00b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 0x7f29d00b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38794/0 (socket says 172.21.15.32:38794) 2023-10-14T12:19:11.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 -- 172.21.15.32:0/2036947551 learned_addr learned my addr 172.21.15.32:0/2036947551 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:11.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d5688700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d015eab0 0x7f29d00b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d4e87700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d00cf8a0 0x7f29d00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 -- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d00cf8a0 msgr2=0x7f29d00c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d00cf8a0 0x7f29d00c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 -- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d015eab0 msgr2=0x7f29d00b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d015eab0 0x7f29d00b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 -- 172.21.15.32:0/2036947551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009550 con 0x7f29d00d1bc0 2023-10-14T12:19:11.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cffff700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 0x7f29d00b64c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f29d0158520 tx=0x7f29bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc01a900 con 0x7f29d00d1bc0 2023-10-14T12:19:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc01f070 con 0x7f29d00d1bc0 2023-10-14T12:19:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d00c9680 con 0x7f29d00d1bc0 2023-10-14T12:19:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc01ac60 con 0x7f29d00d1bc0 2023-10-14T12:19:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.529+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d00c9c40 con 0x7f29d00d1bc0 2023-10-14T12:19:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.530+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d015f680 con 0x7f29d00d1bc0 2023-10-14T12:19:11.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.531+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29bc01b430 con 0x7f29d00d1bc0 2023-10-14T12:19:11.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.531+0000 7f29cd7fa700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f29b406af00 0x7f29b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.531+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29bc021070 con 0x7f29d00d1bc0 2023-10-14T12:19:11.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.531+0000 7f29d4e87700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f29b406af00 0x7f29b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.532+0000 7f29d4e87700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f29b406af00 0x7f29b406d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29c4000f60 tx=0x7f29c4004a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.536+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29d015f680 con 0x7f29d00d1bc0 2023-10-14T12:19:11.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.734+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29d015f680 con 0x7f29d00d1bc0 2023-10-14T12:19:11.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.734+0000 7f29cd7fa700 1 -- 172.21.15.32:0/2036947551 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29bc015020 con 0x7f29d00d1bc0 2023-10-14T12:19:11.736 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:11.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f29b406af00 msgr2=0x7f29b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f29b406af00 0x7f29b406d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29c4000f60 tx=0x7f29c4004a50 comp rx=0 tx=0).stop 2023-10-14T12:19:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 msgr2=0x7f29d00b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 0x7f29d00b64c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f29d0158520 tx=0x7f29bc004750 comp rx=0 tx=0).stop 2023-10-14T12:19:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 shutdown_connections 2023-10-14T12:19:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f29b406af00 0x7f29b406d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d015eab0 0x7f29d00b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d00cf8a0 0x7f29d00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 --2- 172.21.15.32:0/2036947551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d00d1bc0 0x7f29d00b64c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 >> 172.21.15.32:0/2036947551 conn(0x7f29d00665a0 msgr2=0x7f29d00cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:11.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 shutdown_connections 2023-10-14T12:19:11.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.737+0000 7f29d70eb700 1 -- 172.21.15.32:0/2036947551 wait complete. 2023-10-14T12:19:11.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.878+0000 7f32b3f7f700 1 Processor -- start 2023-10-14T12:19:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.878+0000 7f32b3f7f700 1 -- start start 2023-10-14T12:19:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b3f7f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32ac06a840 0x7f32ac0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b3f7f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b3f7f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac06adb0 con 0x7f32ac15e030 2023-10-14T12:19:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b3f7f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0cbab0 con 0x7f32ac06a840 2023-10-14T12:19:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b3f7f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06b090 con 0x7f32ac06be50 2023-10-14T12:19:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b251c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b151a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32ac06a840 0x7f32ac0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b1d1b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f32ac15e030 0x7f32ac0cb3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54700/0 (socket says 172.21.15.32:54700) 2023-10-14T12:19:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b1d1b700 1 -- 172.21.15.32:0/417125709 learned_addr learned my addr 172.21.15.32:0/417125709 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b251c700 1 -- 172.21.15.32:0/417125709 >> v2:172.21.15.92:3300/0 conn(0x7f32ac06a840 msgr2=0x7f32ac0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b251c700 1 --2- 172.21.15.32:0/417125709 >> v2:172.21.15.92:3300/0 conn(0x7f32ac06a840 0x7f32ac0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b251c700 1 -- 172.21.15.32:0/417125709 >> v1:172.21.15.92:6789/0 conn(0x7f32ac15e030 legacy=0x7f32ac0cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b251c700 1 -- 172.21.15.32:0/417125709 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac06b370 con 0x7f32ac06be50 2023-10-14T12:19:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b151a700 1 --2- 172.21.15.32:0/417125709 >> v2:172.21.15.92:3300/0 conn(0x7f32ac06a840 0x7f32ac0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.879+0000 7f32b251c700 1 --2- 172.21.15.32:0/417125709 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac0ce0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ba1bf062183a481 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b0d19700 1 -- 172.21.15.32:0/417125709 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400e070 con 0x7f32ac06be50 2023-10-14T12:19:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b0d19700 1 -- 172.21.15.32:0/417125709 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400bb20 con 0x7f32ac06be50 2023-10-14T12:19:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b0d19700 1 -- 172.21.15.32:0/417125709 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4012430 con 0x7f32ac06be50 2023-10-14T12:19:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 -- 172.21.15.32:0/417125709 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 msgr2=0x7f32ac0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/417125709 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac0ce0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 -- 172.21.15.32:0/417125709 shutdown_connections 2023-10-14T12:19:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/417125709 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac0ce0b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/417125709 >> v2:172.21.15.92:3300/0 conn(0x7f32ac06a840 0x7f32ac0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 -- 172.21.15.32:0/417125709 >> 172.21.15.32:0/417125709 conn(0x7f32ac0cc6f0 msgr2=0x7f32ac0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 -- 172.21.15.32:0/417125709 shutdown_connections 2023-10-14T12:19:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.880+0000 7f32b3f7f700 1 -- 172.21.15.32:0/417125709 wait complete. 2023-10-14T12:19:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.881+0000 7f32b3f7f700 1 Processor -- start 2023-10-14T12:19:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 -- start start 2023-10-14T12:19:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ac06a840 0x7f32ac0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 0x7f32ac0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0c7ff0 con 0x7f32ac15e030 2023-10-14T12:19:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0c82d0 con 0x7f32ac06a840 2023-10-14T12:19:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b3f7f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0c85b0 con 0x7f32ac06be50 2023-10-14T12:19:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b251c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 0x7f32ac0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b251c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 0x7f32ac0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38810/0 (socket says 172.21.15.32:38810) 2023-10-14T12:19:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b251c700 1 -- 172.21.15.32:0/2124229310 learned_addr learned my addr 172.21.15.32:0/2124229310 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b151a700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.882+0000 7f32b1d1b700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ac06a840 0x7f32ac0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b251c700 1 -- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 msgr2=0x7f32ac160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b251c700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b251c700 1 -- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ac06a840 msgr2=0x7f32ac0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b251c700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ac06a840 0x7f32ac0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b251c700 1 -- 172.21.15.32:0/2124229310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c0094a0 con 0x7f32ac15e030 2023-10-14T12:19:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b251c700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 0x7f32ac0c53f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32a4014040 tx=0x7f32a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4012430 con 0x7f32ac15e030 2023-10-14T12:19:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a4009a70 con 0x7f32ac15e030 2023-10-14T12:19:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4020070 con 0x7f32ac15e030 2023-10-14T12:19:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4003ea0 con 0x7f32ac15e030 2023-10-14T12:19:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.883+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac15ef00 con 0x7f32ac15e030 2023-10-14T12:19:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.884+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac067d20 con 0x7f32ac15e030 2023-10-14T12:19:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.885+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32a4004040 con 0x7f32ac15e030 2023-10-14T12:19:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.885+0000 7f32a27fc700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f329006af00 0x7f329006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.885+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32a4022070 con 0x7f32ac15e030 2023-10-14T12:19:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.885+0000 7f32b1d1b700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f329006af00 0x7f329006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.886+0000 7f32b1d1b700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f329006af00 0x7f329006d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f32a8005910 tx=0x7f32a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:11.890+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32a40562e0 con 0x7f32ac15e030 2023-10-14T12:19:12.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.089+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32ac066a30 con 0x7f32ac15e030 2023-10-14T12:19:12.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.089+0000 7f32a27fc700 1 -- 172.21.15.32:0/2124229310 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32a4059900 con 0x7f32ac15e030 2023-10-14T12:19:12.091 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:12.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.091+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f329006af00 msgr2=0x7f329006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.091+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f329006af00 0x7f329006d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f32a8005910 tx=0x7f32a8009040 comp rx=0 tx=0).stop 2023-10-14T12:19:12.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.091+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 msgr2=0x7f32ac0c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.091+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 0x7f32ac0c53f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32a4014040 tx=0x7f32a4004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.091+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 shutdown_connections 2023-10-14T12:19:12.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32ac15e030 0x7f32ac0c53f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f329006af00 0x7f329006d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ac06a840 0x7f32ac0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 --2- 172.21.15.32:0/2124229310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ac06be50 0x7f32ac160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 >> 172.21.15.32:0/2124229310 conn(0x7f32ac0cc6f0 msgr2=0x7f32ac0ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:12.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 shutdown_connections 2023-10-14T12:19:12.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.092+0000 7f32b3f7f700 1 -- 172.21.15.32:0/2124229310 wait complete. 2023-10-14T12:19:12.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:12.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.232+0000 7f34d96e1700 1 Processor -- start 2023-10-14T12:19:12.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.232+0000 7f34d96e1700 1 -- start start 2023-10-14T12:19:12.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d96e1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f34d415e2f0 0x7f34d40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d96e1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34d406a840 0x7f34d406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d96e1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d406b1a0 con 0x7f34d40cd950 2023-10-14T12:19:12.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d96e1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d41619a0 con 0x7f34d406a840 2023-10-14T12:19:12.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d96e1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40b2d60 con 0x7f34d415e2f0 2023-10-14T12:19:12.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d37fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34d406a840 0x7f34d406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d37fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34d406a840 0x7f34d406ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38818/0 (socket says 172.21.15.32:38818) 2023-10-14T12:19:12.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d37fe700 1 -- 172.21.15.32:0/191249080 learned_addr learned my addr 172.21.15.32:0/191249080 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:12.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.233+0000 7f34d27fc700 1 --2- 172.21.15.32:0/191249080 >> v2:172.21.15.92:3300/0 conn(0x7f34d415e2f0 0x7f34d40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d37fe700 1 -- 172.21.15.32:0/191249080 >> v2:172.21.15.92:3300/0 conn(0x7f34d415e2f0 msgr2=0x7f34d40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:12.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d37fe700 1 --2- 172.21.15.32:0/191249080 >> v2:172.21.15.92:3300/0 conn(0x7f34d415e2f0 0x7f34d40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d37fe700 1 -- 172.21.15.32:0/191249080 >> v1:172.21.15.92:6789/0 conn(0x7f34d40cd950 legacy=0x7f34d415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d37fe700 1 -- 172.21.15.32:0/191249080 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40cdd30 con 0x7f34d406a840 2023-10-14T12:19:12.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d37fe700 1 --2- 172.21.15.32:0/191249080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d406a840 0x7f34d406ac60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34d406b690 tx=0x7f34cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ca94c34cb078ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d1ffb700 1 -- 172.21.15.32:0/191249080 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00e070 con 0x7f34d406a840 2023-10-14T12:19:12.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d1ffb700 1 -- 172.21.15.32:0/191249080 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00b910 con 0x7f34d406a840 2023-10-14T12:19:12.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d1ffb700 1 -- 172.21.15.32:0/191249080 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00bcc0 con 0x7f34d406a840 2023-10-14T12:19:12.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d96e1700 1 -- 172.21.15.32:0/191249080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d406a840 msgr2=0x7f34d406ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d96e1700 1 --2- 172.21.15.32:0/191249080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d406a840 0x7f34d406ac60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34d406b690 tx=0x7f34cc00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:12.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d96e1700 1 -- 172.21.15.32:0/191249080 shutdown_connections 2023-10-14T12:19:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d96e1700 1 --2- 172.21.15.32:0/191249080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d406a840 0x7f34d406ac60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d96e1700 1 --2- 172.21.15.32:0/191249080 >> v2:172.21.15.92:3300/0 conn(0x7f34d415e2f0 0x7f34d40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.234+0000 7f34d96e1700 1 -- 172.21.15.32:0/191249080 >> 172.21.15.32:0/191249080 conn(0x7f34d406dae0 msgr2=0x7f34d406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.235+0000 7f34d96e1700 1 -- 172.21.15.32:0/191249080 shutdown_connections 2023-10-14T12:19:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.235+0000 7f34d96e1700 1 -- 172.21.15.32:0/191249080 wait complete. 2023-10-14T12:19:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.236+0000 7f34d96e1700 1 Processor -- start 2023-10-14T12:19:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.236+0000 7f34d96e1700 1 -- start start 2023-10-14T12:19:12.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d96e1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d406a840 0x7f34d40b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d96e1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 0x7f34d40c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d96e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d415e2f0 0x7f34d40c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d96e1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c94f0 con 0x7f34d40cd950 2023-10-14T12:19:12.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d96e1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c7060 con 0x7f34d415e2f0 2023-10-14T12:19:12.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d96e1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40b4bb0 con 0x7f34d406a840 2023-10-14T12:19:12.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 0x7f34d40c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 0x7f34d40c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38822/0 (socket says 172.21.15.32:38822) 2023-10-14T12:19:12.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 -- 172.21.15.32:0/2436168108 learned_addr learned my addr 172.21.15.32:0/2436168108 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:12.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d37fe700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d415e2f0 0x7f34d40c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d2ffd700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d406a840 0x7f34d40b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 -- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d406a840 msgr2=0x7f34d40b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d406a840 0x7f34d40b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 -- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d415e2f0 msgr2=0x7f34d40c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d415e2f0 0x7f34d40c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 -- 172.21.15.32:0/2436168108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009b30 con 0x7f34d40cd950 2023-10-14T12:19:12.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.237+0000 7f34d27fc700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 0x7f34d40c8fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34c400e900 tx=0x7f34c400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.238+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4013680 con 0x7f34d40cd950 2023-10-14T12:19:12.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.238+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c40137e0 con 0x7f34d40cd950 2023-10-14T12:19:12.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.238+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40b4e70 con 0x7f34d40cd950 2023-10-14T12:19:12.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.238+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4013b50 con 0x7f34d40cd950 2023-10-14T12:19:12.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.238+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d40b5430 con 0x7f34d40cd950 2023-10-14T12:19:12.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.239+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4161050 con 0x7f34d40cd950 2023-10-14T12:19:12.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.239+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f34c4013cb0 con 0x7f34d40cd950 2023-10-14T12:19:12.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.239+0000 7f34bb7fe700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f34c006af30 0x7f34c006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.239+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34c4089820 con 0x7f34d40cd950 2023-10-14T12:19:12.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.240+0000 7f34d2ffd700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f34c006af30 0x7f34c006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.240+0000 7f34d2ffd700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f34c006af30 0x7f34c006d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f34c8007fd0 tx=0x7f34c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.244+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34c40548d0 con 0x7f34d40cd950 2023-10-14T12:19:12.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.447+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34d4067d20 con 0x7f34d40cd950 2023-10-14T12:19:12.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.448+0000 7f34bb7fe700 1 -- 172.21.15.32:0/2436168108 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34c4021020 con 0x7f34d40cd950 2023-10-14T12:19:12.449 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:12.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f34c006af30 msgr2=0x7f34c006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f34c006af30 0x7f34c006d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f34c8007fd0 tx=0x7f34c8009040 comp rx=0 tx=0).stop 2023-10-14T12:19:12.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 msgr2=0x7f34d40c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 0x7f34d40c8fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34c400e900 tx=0x7f34c400ec10 comp rx=0 tx=0).stop 2023-10-14T12:19:12.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 shutdown_connections 2023-10-14T12:19:12.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f34c006af30 0x7f34c006d3f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d415e2f0 0x7f34d40c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d406a840 0x7f34d40b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 --2- 172.21.15.32:0/2436168108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d40cd950 0x7f34d40c8fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 >> 172.21.15.32:0/2436168108 conn(0x7f34d406dae0 msgr2=0x7f34d40ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 shutdown_connections 2023-10-14T12:19:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.450+0000 7f34d96e1700 1 -- 172.21.15.32:0/2436168108 wait complete. 2023-10-14T12:19:12.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.588+0000 7ff76f7d0700 1 Processor -- start 2023-10-14T12:19:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.588+0000 7ff76f7d0700 1 -- start start 2023-10-14T12:19:12.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76f7d0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff76815eab0 0x7ff7680cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76f7d0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff7680d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76f7d0700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7680cfb30 con 0x7ff7680d1bc0 2023-10-14T12:19:12.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76f7d0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7680ccc20 con 0x7ff76815eab0 2023-10-14T12:19:12.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76f7d0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76815ee90 con 0x7ff7680cf6d0 2023-10-14T12:19:12.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76d56c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff76815eab0 0x7ff7680cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76dd6d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff7680d1bc0 0x7ff768161510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55856/0 (socket says 172.21.15.32:55856) 2023-10-14T12:19:12.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76dd6d700 1 -- 172.21.15.32:0/4129045804 learned_addr learned my addr 172.21.15.32:0/4129045804 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:12.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76cd6b700 1 --2- 172.21.15.32:0/4129045804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff7680d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76d56c700 1 -- 172.21.15.32:0/4129045804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 msgr2=0x7ff7680d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76d56c700 1 --2- 172.21.15.32:0/4129045804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff7680d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76d56c700 1 -- 172.21.15.32:0/4129045804 >> v1:172.21.15.32:6789/0 conn(0x7ff7680d1bc0 legacy=0x7ff768161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff76d56c700 1 -- 172.21.15.32:0/4129045804 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768158370 con 0x7ff76815eab0 2023-10-14T12:19:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.589+0000 7ff75ffff700 1 -- 172.21.15.32:0/4129045804 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457478013 0 0) 0x7ff7680cfb30 con 0x7ff7680d1bc0 2023-10-14T12:19:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76d56c700 1 --2- 172.21.15.32:0/4129045804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680cf190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff764009840 tx=0x7ff764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d68498e9e06f95 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff75ffff700 1 -- 172.21.15.32:0/4129045804 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764011830 con 0x7ff76815eab0 2023-10-14T12:19:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff75ffff700 1 -- 172.21.15.32:0/4129045804 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764011990 con 0x7ff76815eab0 2023-10-14T12:19:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff75ffff700 1 -- 172.21.15.32:0/4129045804 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764011d20 con 0x7ff76815eab0 2023-10-14T12:19:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 -- 172.21.15.32:0/4129045804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 msgr2=0x7ff7680cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/4129045804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680cf190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff764009840 tx=0x7ff764009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 -- 172.21.15.32:0/4129045804 shutdown_connections 2023-10-14T12:19:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/4129045804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680cf190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/4129045804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff7680d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 -- 172.21.15.32:0/4129045804 >> 172.21.15.32:0/4129045804 conn(0x7ff7680665a0 msgr2=0x7ff768066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 -- 172.21.15.32:0/4129045804 shutdown_connections 2023-10-14T12:19:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.590+0000 7ff76f7d0700 1 -- 172.21.15.32:0/4129045804 wait complete. 2023-10-14T12:19:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.591+0000 7ff76f7d0700 1 Processor -- start 2023-10-14T12:19:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 -- start start 2023-10-14T12:19:12.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff768157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7680d1bc0 0x7ff7680ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7681f4520 con 0x7ff76815eab0 2023-10-14T12:19:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff768158070 con 0x7ff7680d1bc0 2023-10-14T12:19:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76f7d0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680c87c0 con 0x7ff7680cf6d0 2023-10-14T12:19:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76dd6d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76dd6d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38838/0 (socket says 172.21.15.32:38838) 2023-10-14T12:19:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.592+0000 7ff76dd6d700 1 -- 172.21.15.32:0/2243320349 learned_addr learned my addr 172.21.15.32:0/2243320349 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76d56c700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff768157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76cd6b700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7680d1bc0 0x7ff7680ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76dd6d700 1 -- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 msgr2=0x7ff768157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76dd6d700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff768157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76dd6d700 1 -- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7680d1bc0 msgr2=0x7ff7680ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76dd6d700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7680d1bc0 0x7ff7680ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76dd6d700 1 -- 172.21.15.32:0/2243320349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640094a0 con 0x7ff76815eab0 2023-10-14T12:19:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76cd6b700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7680d1bc0 0x7ff7680ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76dd6d700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680caae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff76000cba0 tx=0x7ff76000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000ab80 con 0x7ff76815eab0 2023-10-14T12:19:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000ad00 con 0x7ff76815eab0 2023-10-14T12:19:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7680c8aa0 con 0x7ff76815eab0 2023-10-14T12:19:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760007310 con 0x7ff76815eab0 2023-10-14T12:19:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.593+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7680c9060 con 0x7ff76815eab0 2023-10-14T12:19:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.594+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff768073d20 con 0x7ff76815eab0 2023-10-14T12:19:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.594+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff760007470 con 0x7ff76815eab0 2023-10-14T12:19:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.595+0000 7ff75dffb700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74c06af00 0x7ff74c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.595+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff760089400 con 0x7ff76815eab0 2023-10-14T12:19:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.595+0000 7ff76d56c700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74c06af00 0x7ff74c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.595+0000 7ff76d56c700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74c06af00 0x7ff74c06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff7640090b0 tx=0x7ff764008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.599+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff760054540 con 0x7ff76815eab0 2023-10-14T12:19:12.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.802+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff768067d20 con 0x7ff76815eab0 2023-10-14T12:19:12.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.803+0000 7ff75dffb700 1 -- 172.21.15.32:0/2243320349 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7ff760057b60 con 0x7ff76815eab0 2023-10-14T12:19:12.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:12.805 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:12.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74c06af00 msgr2=0x7ff74c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74c06af00 0x7ff74c06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff7640090b0 tx=0x7ff764008030 comp rx=0 tx=0).stop 2023-10-14T12:19:12.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 msgr2=0x7ff7680caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680caae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff76000cba0 tx=0x7ff76000cf60 comp rx=0 tx=0).stop 2023-10-14T12:19:12.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 shutdown_connections 2023-10-14T12:19:12.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76815eab0 0x7ff7680caae0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7680cf6d0 0x7ff768157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74c06af00 0x7ff74c06d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 --2- 172.21.15.32:0/2243320349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7680d1bc0 0x7ff7680ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 >> 172.21.15.32:0/2243320349 conn(0x7ff7680665a0 msgr2=0x7ff7680c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:12.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 shutdown_connections 2023-10-14T12:19:12.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.805+0000 7ff76f7d0700 1 -- 172.21.15.32:0/2243320349 wait complete. 2023-10-14T12:19:12.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:12.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:12.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.946+0000 7ff79c5bf700 1 Processor -- start 2023-10-14T12:19:12.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.946+0000 7ff79c5bf700 1 -- start start 2023-10-14T12:19:12.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79c5bf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff79415e2f0 0x7ff7940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79c5bf700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff79406a840 0x7ff79406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79c5bf700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7940b2d60 con 0x7ff7940cd950 2023-10-14T12:19:12.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79c5bf700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7941619a0 con 0x7ff79406a840 2023-10-14T12:19:12.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79c5bf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79406b1f0 con 0x7ff79415e2f0 2023-10-14T12:19:12.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79ab5c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff79406a840 0x7ff79406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79ab5c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff79406a840 0x7ff79406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38846/0 (socket says 172.21.15.32:38846) 2023-10-14T12:19:12.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.947+0000 7ff79ab5c700 1 -- 172.21.15.32:0/2829907109 learned_addr learned my addr 172.21.15.32:0/2829907109 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:12.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff799b5a700 1 --2- 172.21.15.32:0/2829907109 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff79415e2f0 0x7ff7940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff79ab5c700 1 -- 172.21.15.32:0/2829907109 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff79415e2f0 msgr2=0x7ff7940cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:12.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff79ab5c700 1 --2- 172.21.15.32:0/2829907109 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff79415e2f0 0x7ff7940cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff79ab5c700 1 -- 172.21.15.32:0/2829907109 >> v1:172.21.15.92:6789/0 conn(0x7ff7940cd950 legacy=0x7ff79415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff79ab5c700 1 -- 172.21.15.32:0/2829907109 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940cdd30 con 0x7ff79406a840 2023-10-14T12:19:12.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff79ab5c700 1 --2- 172.21.15.32:0/2829907109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79406a840 0x7ff79406acb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009e50 tx=0x7ff78c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f38575f3b2b09a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff799359700 1 -- 172.21.15.32:0/2829907109 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00e070 con 0x7ff79406a840 2023-10-14T12:19:12.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff799359700 1 -- 172.21.15.32:0/2829907109 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00b9c0 con 0x7ff79406a840 2023-10-14T12:19:12.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.948+0000 7ff799359700 1 -- 172.21.15.32:0/2829907109 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00bd70 con 0x7ff79406a840 2023-10-14T12:19:12.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 -- 172.21.15.32:0/2829907109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79406a840 msgr2=0x7ff79406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/2829907109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79406a840 0x7ff79406acb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009e50 tx=0x7ff78c00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:12.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 -- 172.21.15.32:0/2829907109 shutdown_connections 2023-10-14T12:19:12.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/2829907109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79406a840 0x7ff79406acb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/2829907109 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff79415e2f0 0x7ff7940cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 -- 172.21.15.32:0/2829907109 >> 172.21.15.32:0/2829907109 conn(0x7ff79406dae0 msgr2=0x7ff79406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:12.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 -- 172.21.15.32:0/2829907109 shutdown_connections 2023-10-14T12:19:12.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.949+0000 7ff79c5bf700 1 -- 172.21.15.32:0/2829907109 wait complete. 2023-10-14T12:19:12.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.950+0000 7ff79c5bf700 1 Processor -- start 2023-10-14T12:19:12.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.950+0000 7ff79c5bf700 1 -- start start 2023-10-14T12:19:12.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79c5bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79406a840 0x7ff79415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79c5bf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7940cd950 0x7ff7940c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79c5bf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 0x7ff7940b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79c5bf700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c54c0 con 0x7ff79415e2f0 2023-10-14T12:19:12.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79c5bf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c57a0 con 0x7ff79406a840 2023-10-14T12:19:12.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79c5bf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c5a80 con 0x7ff7940cd950 2023-10-14T12:19:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 0x7ff7940b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 0x7ff7940b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38852/0 (socket says 172.21.15.32:38852) 2023-10-14T12:19:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 -- 172.21.15.32:0/1167973801 learned_addr learned my addr 172.21.15.32:0/1167973801 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff799b5a700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7940cd950 0x7ff7940c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79a35b700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79406a840 0x7ff79415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 -- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7940cd950 msgr2=0x7ff7940c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7940cd950 0x7ff7940c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 -- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79406a840 msgr2=0x7ff79415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:12.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79406a840 0x7ff79415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:12.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff79ab5c700 1 -- 172.21.15.32:0/1167973801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c009b30 con 0x7ff79415e2f0 2023-10-14T12:19:12.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.951+0000 7ff799b5a700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7940cd950 0x7ff7940c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:12.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.952+0000 7ff79ab5c700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 0x7ff7940b0930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff79406d4f0 tx=0x7ff78c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.952+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c004800 con 0x7ff79415e2f0 2023-10-14T12:19:12.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.952+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c004960 con 0x7ff79415e2f0 2023-10-14T12:19:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.952+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7940c5d60 con 0x7ff79415e2f0 2023-10-14T12:19:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.952+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c01c680 con 0x7ff79415e2f0 2023-10-14T12:19:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.952+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7940d0680 con 0x7ff79415e2f0 2023-10-14T12:19:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.953+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7940c6280 con 0x7ff79415e2f0 2023-10-14T12:19:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.953+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff78c01c7e0 con 0x7ff79415e2f0 2023-10-14T12:19:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.953+0000 7ff78affd700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.954+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff78c08b180 con 0x7ff79415e2f0 2023-10-14T12:19:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.954+0000 7ff79a35b700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.954+0000 7ff79a35b700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff77806af00 0x7ff77806d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff784007fd0 tx=0x7ff784009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:12.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:12.958+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7940c6280 con 0x7ff79415e2f0 2023-10-14T12:19:13.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.156+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7940c6280 con 0x7ff79415e2f0 2023-10-14T12:19:13.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.157+0000 7ff78affd700 1 -- 172.21.15.32:0/1167973801 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7940c6280 con 0x7ff79415e2f0 2023-10-14T12:19:13.159 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff77806af00 msgr2=0x7ff77806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff77806af00 0x7ff77806d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff784007fd0 tx=0x7ff784009040 comp rx=0 tx=0).stop 2023-10-14T12:19:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 msgr2=0x7ff7940b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 0x7ff7940b0930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff79406d4f0 tx=0x7ff78c004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 shutdown_connections 2023-10-14T12:19:13.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff79415e2f0 0x7ff7940b0930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79406a840 0x7ff79415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 --2- 172.21.15.32:0/1167973801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7940cd950 0x7ff7940c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 >> 172.21.15.32:0/1167973801 conn(0x7ff79406dae0 msgr2=0x7ff7940ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:13.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 shutdown_connections 2023-10-14T12:19:13.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.159+0000 7ff79c5bf700 1 -- 172.21.15.32:0/1167973801 wait complete. 2023-10-14T12:19:13.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:13.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.299+0000 7fb91cbe6700 1 Processor -- start 2023-10-14T12:19:13.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.300+0000 7fb91cbe6700 1 -- start start 2023-10-14T12:19:13.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.300+0000 7fb91cbe6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.300+0000 7fb91cbe6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb9180ce0b0 0x7fb91806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.300+0000 7fb91cbe6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91815bf30 con 0x7fb91815bb50 2023-10-14T12:19:13.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.300+0000 7fb91cbe6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180ce540 con 0x7fb9180ce0b0 2023-10-14T12:19:13.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.300+0000 7fb91cbe6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180b2d70 con 0x7fb91806ef20 2023-10-14T12:19:13.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb916d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb9180ce0b0 0x7fb91806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb916d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb9180ce0b0 0x7fb91806a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43128/0 (socket says 172.21.15.32:43128) 2023-10-14T12:19:13.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb916d9d700 1 -- 172.21.15.32:0/3627103283 learned_addr learned my addr 172.21.15.32:0/3627103283 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:13.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:44550/0 (socket says 172.21.15.32:44550) 2023-10-14T12:19:13.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb91659c700 1 --1- 172.21.15.32:0/3627103283 >> v1:172.21.15.92:6789/0 conn(0x7fb91815bb50 0x7fb91806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54756/0 (socket says 172.21.15.32:54756) 2023-10-14T12:19:13.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 -- 172.21.15.32:0/3627103283 >> v2:172.21.15.92:3300/0 conn(0x7fb9180ce0b0 msgr2=0x7fb91806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:13.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 --2- 172.21.15.32:0/3627103283 >> v2:172.21.15.92:3300/0 conn(0x7fb9180ce0b0 0x7fb91806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 -- 172.21.15.32:0/3627103283 >> v1:172.21.15.92:6789/0 conn(0x7fb91815bb50 legacy=0x7fb91806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 -- 172.21.15.32:0/3627103283 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91806d500 con 0x7fb91806ef20 2023-10-14T12:19:13.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.301+0000 7fb915d9b700 1 --2- 172.21.15.32:0/3627103283 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180cdb70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb908009840 tx=0x7fb908009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5311857dfa616c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:13.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91559a700 1 -- 172.21.15.32:0/3627103283 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908011830 con 0x7fb91806ef20 2023-10-14T12:19:13.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91559a700 1 -- 172.21.15.32:0/3627103283 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908011990 con 0x7fb91806ef20 2023-10-14T12:19:13.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91559a700 1 -- 172.21.15.32:0/3627103283 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908011d20 con 0x7fb91806ef20 2023-10-14T12:19:13.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3627103283 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 msgr2=0x7fb9180cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3627103283 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180cdb70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb908009840 tx=0x7fb908009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:13.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3627103283 shutdown_connections 2023-10-14T12:19:13.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3627103283 >> v2:172.21.15.92:3300/0 conn(0x7fb9180ce0b0 0x7fb91806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3627103283 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180cdb70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3627103283 >> 172.21.15.32:0/3627103283 conn(0x7fb9180cc6f0 msgr2=0x7fb9180ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:13.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3627103283 shutdown_connections 2023-10-14T12:19:13.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.302+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3627103283 wait complete. 2023-10-14T12:19:13.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.304+0000 7fb91cbe6700 1 Processor -- start 2023-10-14T12:19:13.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.304+0000 7fb91cbe6700 1 -- start start 2023-10-14T12:19:13.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.304+0000 7fb91cbe6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.304+0000 7fb91cbe6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9180ce0b0 0x7fb9180cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.304+0000 7fb91cbe6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91815bb50 0x7fb9180ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91cbe6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c7f60 con 0x7fb9180ce0b0 2023-10-14T12:19:13.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91cbe6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c8240 con 0x7fb91815bb50 2023-10-14T12:19:13.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91cbe6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c8520 con 0x7fb91806ef20 2023-10-14T12:19:13.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9180ce0b0 0x7fb9180cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:44554/0 (socket says 172.21.15.32:44554) 2023-10-14T12:19:13.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91659c700 1 -- 172.21.15.32:0/3690695296 learned_addr learned my addr 172.21.15.32:0/3690695296 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:13.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb916d9d700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91815bb50 0x7fb9180ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 -- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 msgr2=0x7fb9180c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 -- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91815bb50 msgr2=0x7fb9180ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91815bb50 0x7fb9180ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 -- 172.21.15.32:0/3690695296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9080094a0 con 0x7fb9180ce0b0 2023-10-14T12:19:13.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91659c700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:13.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb915d9b700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9180ce0b0 0x7fb9180cb850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb908016000 tx=0x7fb908004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:13.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080036a0 con 0x7fb9180ce0b0 2023-10-14T12:19:13.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90801f070 con 0x7fb9180ce0b0 2023-10-14T12:19:13.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908003a60 con 0x7fb9180ce0b0 2023-10-14T12:19:13.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9180c8800 con 0x7fb9180ce0b0 2023-10-14T12:19:13.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.305+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb918152a70 con 0x7fb9180ce0b0 2023-10-14T12:19:13.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.306+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9180c8d20 con 0x7fb9180ce0b0 2023-10-14T12:19:13.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.307+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb908003bc0 con 0x7fb9180ce0b0 2023-10-14T12:19:13.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.307+0000 7fb906ffd700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb8f806af00 0x7fb8f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.308+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb908021070 con 0x7fb9180ce0b0 2023-10-14T12:19:13.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.308+0000 7fb91659c700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb8f806af00 0x7fb8f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.308+0000 7fb91659c700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb8f806af00 0x7fb8f806d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb90c000f60 tx=0x7fb90c007f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:13.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.312+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9180c8d20 con 0x7fb9180ce0b0 2023-10-14T12:19:13.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.514+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9180c8d20 con 0x7fb9180ce0b0 2023-10-14T12:19:13.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.514+0000 7fb906ffd700 1 -- 172.21.15.32:0/3690695296 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9180c8d20 con 0x7fb9180ce0b0 2023-10-14T12:19:13.516 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:13.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb8f806af00 msgr2=0x7fb8f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb8f806af00 0x7fb8f806d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb90c000f60 tx=0x7fb90c007f90 comp rx=0 tx=0).stop 2023-10-14T12:19:13.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9180ce0b0 msgr2=0x7fb9180cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9180ce0b0 0x7fb9180cb850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb908016000 tx=0x7fb908004750 comp rx=0 tx=0).stop 2023-10-14T12:19:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 shutdown_connections 2023-10-14T12:19:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb8f806af00 0x7fb8f806d3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb91815bb50 0x7fb9180ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb91806ef20 0x7fb9180c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 --2- 172.21.15.32:0/3690695296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9180ce0b0 0x7fb9180cb850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 >> 172.21.15.32:0/3690695296 conn(0x7fb9180cc6f0 msgr2=0x7fb9180ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:13.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 shutdown_connections 2023-10-14T12:19:13.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.516+0000 7fb91cbe6700 1 -- 172.21.15.32:0/3690695296 wait complete. 2023-10-14T12:19:13.530 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:13.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.659+0000 7fd8841ef700 1 Processor -- start 2023-10-14T12:19:13.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.659+0000 7fd8841ef700 1 -- start start 2023-10-14T12:19:13.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd8841ef700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd87c0cd950 0x7fd87c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd8841ef700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0cf290 con 0x7fd87c06a840 2023-10-14T12:19:13.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd8841ef700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0b2d60 con 0x7fd87c0cede0 2023-10-14T12:19:13.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd8841ef700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c1619a0 con 0x7fd87c0cd950 2023-10-14T12:19:13.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd88278c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd87c06a840 0x7fd87c161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55898/0 (socket says 172.21.15.32:55898) 2023-10-14T12:19:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd88278c700 1 -- 172.21.15.32:0/3836512656 learned_addr learned my addr 172.21.15.32:0/3836512656 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd881f8b700 1 --2- 172.21.15.32:0/3836512656 >> v2:172.21.15.92:3300/0 conn(0x7fd87c0cd950 0x7fd87c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427009210 0 0) 0x7fd87c0cf290 con 0x7fd87c06a840 2023-10-14T12:19:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8680035b0 con 0x7fd87c06a840 2023-10-14T12:19:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847223490 0 0) 0x7fd87c0b2d60 con 0x7fd87c0cede0 2023-10-14T12:19:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c0cf290 con 0x7fd87c0cede0 2023-10-14T12:19:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd881f8b700 1 -- 172.21.15.32:0/3836512656 >> v1:172.21.15.92:6789/0 conn(0x7fd87c0cede0 legacy=0x7fd87c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.660+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1655561051 0 0) 0x7fd8680035b0 con 0x7fd87c06a840 2023-10-14T12:19:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd881f8b700 1 -- 172.21.15.32:0/3836512656 >> v1:172.21.15.32:6789/0 conn(0x7fd87c06a840 legacy=0x7fd87c161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd881f8b700 1 -- 172.21.15.32:0/3836512656 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0cdd30 con 0x7fd87c0cd950 2023-10-14T12:19:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd881f8b700 1 --2- 172.21.15.32:0/3836512656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cd950 0x7fd87c15e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd878009840 tx=0x7fd878009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7127fb39ab1ec76f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740019f0 con 0x7fd87c0cd950 2023-10-14T12:19:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878004030 con 0x7fd87c0cd950 2023-10-14T12:19:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd880f89700 1 -- 172.21.15.32:0/3836512656 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780043c0 con 0x7fd87c0cd950 2023-10-14T12:19:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd8841ef700 1 -- 172.21.15.32:0/3836512656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cd950 msgr2=0x7fd87c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd8841ef700 1 --2- 172.21.15.32:0/3836512656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cd950 0x7fd87c15e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd878009840 tx=0x7fd878009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd8841ef700 1 -- 172.21.15.32:0/3836512656 shutdown_connections 2023-10-14T12:19:13.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd8841ef700 1 --2- 172.21.15.32:0/3836512656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cd950 0x7fd87c15e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.661+0000 7fd8841ef700 1 -- 172.21.15.32:0/3836512656 >> 172.21.15.32:0/3836512656 conn(0x7fd87c06dae0 msgr2=0x7fd87c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:13.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.662+0000 7fd8841ef700 1 -- 172.21.15.32:0/3836512656 shutdown_connections 2023-10-14T12:19:13.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.662+0000 7fd8841ef700 1 -- 172.21.15.32:0/3836512656 wait complete. 2023-10-14T12:19:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.663+0000 7fd8841ef700 1 Processor -- start 2023-10-14T12:19:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.663+0000 7fd8841ef700 1 -- start start 2023-10-14T12:19:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.663+0000 7fd8841ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 0x7fd87c152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd87c0cd950 0x7fd87c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cede0 0x7fd87c1e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c152ed0 con 0x7fd87c06a840 2023-10-14T12:19:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0c7d40 con 0x7fd87c0cede0 2023-10-14T12:19:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0cb400 con 0x7fd87c0cd950 2023-10-14T12:19:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 0x7fd87c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 0x7fd87c152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38876/0 (socket says 172.21.15.32:38876) 2023-10-14T12:19:13.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 -- 172.21.15.32:0/591388469 learned_addr learned my addr 172.21.15.32:0/591388469 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:13.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd88278c700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cede0 0x7fd87c1e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd88178a700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd87c0cd950 0x7fd87c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 -- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd87c0cd950 msgr2=0x7fd87c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd87c0cd950 0x7fd87c0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 -- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cede0 msgr2=0x7fd87c1e7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cede0 0x7fd87c1e7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 -- 172.21.15.32:0/591388469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780094a0 con 0x7fd87c06a840 2023-10-14T12:19:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd88178a700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd87c0cd950 0x7fd87c0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:13.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd881f8b700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 0x7fd87c152990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd8780090b0 tx=0x7fd878004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:13.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878011830 con 0x7fd87c06a840 2023-10-14T12:19:13.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87801f070 con 0x7fd87c06a840 2023-10-14T12:19:13.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c0cb6e0 con 0x7fd87c06a840 2023-10-14T12:19:13.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878011bf0 con 0x7fd87c06a840 2023-10-14T12:19:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.664+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c0cbca0 con 0x7fd87c06a840 2023-10-14T12:19:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.665+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c067d20 con 0x7fd87c06a840 2023-10-14T12:19:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.666+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd878011d50 con 0x7fd87c06a840 2023-10-14T12:19:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.666+0000 7fd8727fc700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd86006af00 0x7fd86006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.666+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd878021070 con 0x7fd87c06a840 2023-10-14T12:19:13.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.666+0000 7fd88178a700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd86006af00 0x7fd86006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:13.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.667+0000 7fd88178a700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd86006af00 0x7fd86006d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0b62c0 tx=0x7fd86c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:13.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.671+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd878056010 con 0x7fd87c06a840 2023-10-14T12:19:13.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.873+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd87c0b2100 con 0x7fd87c06a840 2023-10-14T12:19:13.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.873+0000 7fd8727fc700 1 -- 172.21.15.32:0/591388469 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd878059630 con 0x7fd87c06a840 2023-10-14T12:19:13.875 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:13.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.875+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd86006af00 msgr2=0x7fd86006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.875+0000 7fd8841ef700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd86006af00 0x7fd86006d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0b62c0 tx=0x7fd86c009040 comp rx=0 tx=0).stop 2023-10-14T12:19:13.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 msgr2=0x7fd87c152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:13.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 0x7fd87c152990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd8780090b0 tx=0x7fd878004750 comp rx=0 tx=0).stop 2023-10-14T12:19:13.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 shutdown_connections 2023-10-14T12:19:13.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd86006af00 0x7fd86006d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd87c0cede0 0x7fd87c1e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd87c06a840 0x7fd87c152990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 --2- 172.21.15.32:0/591388469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd87c0cd950 0x7fd87c0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:13.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 >> 172.21.15.32:0/591388469 conn(0x7fd87c06dae0 msgr2=0x7fd87c0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:13.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 shutdown_connections 2023-10-14T12:19:13.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:13.876+0000 7fd8841ef700 1 -- 172.21.15.32:0/591388469 wait complete. 2023-10-14T12:19:13.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.012+0000 7f28177c5700 1 Processor -- start 2023-10-14T12:19:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.012+0000 7f28177c5700 1 -- start start 2023-10-14T12:19:14.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f28177c5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f281015f1f0 0x7f28100cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f28177c5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28100cfc60 0x7f28100cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f28177c5700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281015e7a0 con 0x7f281015ab10 2023-10-14T12:19:14.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f28177c5700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28100d00d0 con 0x7f281015f1f0 2023-10-14T12:19:14.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f28177c5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28100b29a0 con 0x7f28100cfc60 2023-10-14T12:19:14.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f2814d60700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f281015f1f0 0x7f28100cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f2815561700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f281015ab10 0x7f28100b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55908/0 (socket says 172.21.15.32:55908) 2023-10-14T12:19:14.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f2815561700 1 -- 172.21.15.32:0/4276207084 learned_addr learned my addr 172.21.15.32:0/4276207084 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:14.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.013+0000 7f2815d62700 1 --2- 172.21.15.32:0/4276207084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28100cfc60 0x7f28100cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2814d60700 1 -- 172.21.15.32:0/4276207084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28100cfc60 msgr2=0x7f28100cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2814d60700 1 --2- 172.21.15.32:0/4276207084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28100cfc60 0x7f28100cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2814d60700 1 -- 172.21.15.32:0/4276207084 >> v1:172.21.15.32:6789/0 conn(0x7f281015ab10 legacy=0x7f28100b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2814d60700 1 -- 172.21.15.32:0/4276207084 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100b2c80 con 0x7f281015f1f0 2023-10-14T12:19:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2807fff700 1 -- 172.21.15.32:0/4276207084 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593730377 0 0) 0x7f281015e7a0 con 0x7f281015ab10 2023-10-14T12:19:14.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2814d60700 1 --2- 172.21.15.32:0/4276207084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f281015f1f0 0x7f28100cf720 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f280c009820 tx=0x7f280c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ec181c8698e93f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2807fff700 1 -- 172.21.15.32:0/4276207084 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c005e30 con 0x7f281015f1f0 2023-10-14T12:19:14.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2807fff700 1 -- 172.21.15.32:0/4276207084 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c006030 con 0x7f281015f1f0 2023-10-14T12:19:14.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f2807fff700 1 -- 172.21.15.32:0/4276207084 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0063e0 con 0x7f281015f1f0 2023-10-14T12:19:14.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f28177c5700 1 -- 172.21.15.32:0/4276207084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f281015f1f0 msgr2=0x7f28100cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f28177c5700 1 --2- 172.21.15.32:0/4276207084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f281015f1f0 0x7f28100cf720 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f280c009820 tx=0x7f280c009b30 comp rx=0 tx=0).stop 2023-10-14T12:19:14.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f28177c5700 1 -- 172.21.15.32:0/4276207084 shutdown_connections 2023-10-14T12:19:14.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f28177c5700 1 --2- 172.21.15.32:0/4276207084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28100cfc60 0x7f28100cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f28177c5700 1 --2- 172.21.15.32:0/4276207084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f281015f1f0 0x7f28100cf720 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.014+0000 7f28177c5700 1 -- 172.21.15.32:0/4276207084 >> 172.21.15.32:0/4276207084 conn(0x7f281006dae0 msgr2=0x7f281006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:14.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.015+0000 7f28177c5700 1 -- 172.21.15.32:0/4276207084 shutdown_connections 2023-10-14T12:19:14.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.015+0000 7f28177c5700 1 -- 172.21.15.32:0/4276207084 wait complete. 2023-10-14T12:19:14.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.016+0000 7f28177c5700 1 Processor -- start 2023-10-14T12:19:14.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.016+0000 7f28177c5700 1 -- start start 2023-10-14T12:19:14.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 0x7f28101f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f281015ab10 0x7f2810145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281015f1f0 0x7f2810145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101f4580 con 0x7f28100cfc60 2023-10-14T12:19:14.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101440c0 con 0x7f281015f1f0 2023-10-14T12:19:14.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28101464c0 con 0x7f281015ab10 2023-10-14T12:19:14.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 0x7f28101f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 0x7f28101f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38890/0 (socket says 172.21.15.32:38890) 2023-10-14T12:19:14.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 -- 172.21.15.32:0/358296862 learned_addr learned my addr 172.21.15.32:0/358296862 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:14.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2814d60700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f281015ab10 0x7f2810145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815d62700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281015f1f0 0x7f2810145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 -- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f281015ab10 msgr2=0x7f2810145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f281015ab10 0x7f2810145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 -- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281015f1f0 msgr2=0x7f2810145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281015f1f0 0x7f2810145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 -- 172.21.15.32:0/358296862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c009430 con 0x7f28100cfc60 2023-10-14T12:19:14.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2814d60700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f281015ab10 0x7f2810145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:14.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815d62700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281015f1f0 0x7f2810145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:14.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2815561700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 0x7f28101f4040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f280000c550 tx=0x7f280000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800004c80 con 0x7f28100cfc60 2023-10-14T12:19:14.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800004e00 con 0x7f28100cfc60 2023-10-14T12:19:14.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28101467a0 con 0x7f28100cfc60 2023-10-14T12:19:14.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.017+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800007310 con 0x7f28100cfc60 2023-10-14T12:19:14.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.018+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2810146d60 con 0x7f28100cfc60 2023-10-14T12:19:14.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.018+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2810067d20 con 0x7f28100cfc60 2023-10-14T12:19:14.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.019+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2800007470 con 0x7f28100cfc60 2023-10-14T12:19:14.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.019+0000 7f2805ffb700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f27f406af00 0x7f27f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.019+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28000892b0 con 0x7f28100cfc60 2023-10-14T12:19:14.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.019+0000 7f2814d60700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f27f406af00 0x7f27f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.020+0000 7f2814d60700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f27f406af00 0x7f27f406d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28101554d0 tx=0x7f280c008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.024+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2800054360 con 0x7f28100cfc60 2023-10-14T12:19:14.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.227+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2810159d50 con 0x7f28100cfc60 2023-10-14T12:19:14.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.228+0000 7f2805ffb700 1 -- 172.21.15.32:0/358296862 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f2800057980 con 0x7f28100cfc60 2023-10-14T12:19:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:14.230 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:14.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f27f406af00 msgr2=0x7f27f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f27f406af00 0x7f27f406d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28101554d0 tx=0x7f280c008070 comp rx=0 tx=0).stop 2023-10-14T12:19:14.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 msgr2=0x7f28101f4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 0x7f28101f4040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f280000c550 tx=0x7f280000c910 comp rx=0 tx=0).stop 2023-10-14T12:19:14.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 shutdown_connections 2023-10-14T12:19:14.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f27f406af00 0x7f27f406d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281015f1f0 0x7f2810145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28100cfc60 0x7f28101f4040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 --2- 172.21.15.32:0/358296862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f281015ab10 0x7f2810145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 >> 172.21.15.32:0/358296862 conn(0x7f281006dae0 msgr2=0x7f28100d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:14.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 shutdown_connections 2023-10-14T12:19:14.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.230+0000 7f28177c5700 1 -- 172.21.15.32:0/358296862 wait complete. 2023-10-14T12:19:14.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:14.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:14.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.371+0000 7f2747e36700 1 Processor -- start 2023-10-14T12:19:14.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.371+0000 7f2747e36700 1 -- start start 2023-10-14T12:19:14.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.372+0000 7f2747e36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f274015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.372+0000 7f2747e36700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f27400b54f0 0x7f274015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.372+0000 7f2747e36700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27400b5c70 con 0x7f274006e750 2023-10-14T12:19:14.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.372+0000 7f2747e36700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400b5990 con 0x7f27400b54f0 2023-10-14T12:19:14.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.372+0000 7f2747e36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274015b2b0 con 0x7f274006eb30 2023-10-14T12:19:14.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.372+0000 7f27463d3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f27400b54f0 0x7f274015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f27400b54f0 0x7f274015ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38902/0 (socket says 172.21.15.32:38902) 2023-10-14T12:19:14.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 -- 172.21.15.32:0/3147388092 learned_addr learned my addr 172.21.15.32:0/3147388092 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:14.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27453d1700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f274015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 -- 172.21.15.32:0/3147388092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 msgr2=0x7f274015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:14.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f274015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 -- 172.21.15.32:0/3147388092 >> v1:172.21.15.92:6789/0 conn(0x7f274006e750 legacy=0x7f27400ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:14.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 -- 172.21.15.32:0/3147388092 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274015b590 con 0x7f27400b54f0 2023-10-14T12:19:14.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27453d1700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f274015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:14.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f27463d3700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27400b54f0 0x7f274015ec40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2738009e50 tx=0x7f273800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1b8451b2aaa7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f2744bd0700 1 -- 172.21.15.32:0/3147388092 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800e070 con 0x7f27400b54f0 2023-10-14T12:19:14.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f2744bd0700 1 -- 172.21.15.32:0/3147388092 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738003a20 con 0x7f27400b54f0 2023-10-14T12:19:14.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.373+0000 7f2744bd0700 1 -- 172.21.15.32:0/3147388092 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738003dd0 con 0x7f27400b54f0 2023-10-14T12:19:14.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 -- 172.21.15.32:0/3147388092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27400b54f0 msgr2=0x7f274015ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27400b54f0 0x7f274015ec40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2738009e50 tx=0x7f273800b330 comp rx=0 tx=0).stop 2023-10-14T12:19:14.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 -- 172.21.15.32:0/3147388092 shutdown_connections 2023-10-14T12:19:14.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27400b54f0 0x7f274015ec40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 --2- 172.21.15.32:0/3147388092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f274015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 -- 172.21.15.32:0/3147388092 >> 172.21.15.32:0/3147388092 conn(0x7f27400cc6f0 msgr2=0x7f27400ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:14.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 -- 172.21.15.32:0/3147388092 shutdown_connections 2023-10-14T12:19:14.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.374+0000 7f2747e36700 1 -- 172.21.15.32:0/3147388092 wait complete. 2023-10-14T12:19:14.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.375+0000 7f2747e36700 1 Processor -- start 2023-10-14T12:19:14.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.375+0000 7f2747e36700 1 -- start start 2023-10-14T12:19:14.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2747e36700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 0x7f274014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2747e36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f27401f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2747e36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27400b54f0 0x7f27401570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2747e36700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c9b60 con 0x7f274006e750 2023-10-14T12:19:14.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2747e36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c7d80 con 0x7f27400b54f0 2023-10-14T12:19:14.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2747e36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274014e300 con 0x7f274006eb30 2023-10-14T12:19:14.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 0x7f274014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 0x7f274014ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38904/0 (socket says 172.21.15.32:38904) 2023-10-14T12:19:14.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 -- 172.21.15.32:0/1610604955 learned_addr learned my addr 172.21.15.32:0/1610604955 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:14.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f27453d1700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f27401f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f27463d3700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27400b54f0 0x7f27401570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 -- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 msgr2=0x7f27401f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f27401f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 -- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27400b54f0 msgr2=0x7f27401570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27400b54f0 0x7f27401570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 -- 172.21.15.32:0/1610604955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009b30 con 0x7f274006e750 2023-10-14T12:19:14.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f2745bd2700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 0x7f274014ddc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f273000c4d0 tx=0x7f273000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730011790 con 0x7f274006e750 2023-10-14T12:19:14.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.376+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27300118f0 con 0x7f274006e750 2023-10-14T12:19:14.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.377+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27401f41b0 con 0x7f274006e750 2023-10-14T12:19:14.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.377+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730011ca0 con 0x7f274006e750 2023-10-14T12:19:14.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.377+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274015cd90 con 0x7f274006e750 2023-10-14T12:19:14.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.378+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2740067d20 con 0x7f274006e750 2023-10-14T12:19:14.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.378+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f273001c460 con 0x7f274006e750 2023-10-14T12:19:14.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.378+0000 7f27367fc700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f272406af00 0x7f272406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.378+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2730089230 con 0x7f274006e750 2023-10-14T12:19:14.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.379+0000 7f27453d1700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f272406af00 0x7f272406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.379+0000 7f27453d1700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f272406af00 0x7f272406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f274015dcb0 tx=0x7f273c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.383+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2730054370 con 0x7f274006e750 2023-10-14T12:19:14.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.584+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27400cf870 con 0x7f274006e750 2023-10-14T12:19:14.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.584+0000 7f27367fc700 1 -- 172.21.15.32:0/1610604955 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2730057990 con 0x7f274006e750 2023-10-14T12:19:14.586 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:14.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.586+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f272406af00 msgr2=0x7f272406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.586+0000 7f2747e36700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f272406af00 0x7f272406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f274015dcb0 tx=0x7f273c008040 comp rx=0 tx=0).stop 2023-10-14T12:19:14.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.586+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 msgr2=0x7f274014ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.586+0000 7f2747e36700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 0x7f274014ddc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f273000c4d0 tx=0x7f273000c7e0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 shutdown_connections 2023-10-14T12:19:14.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f272406af00 0x7f272406d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27400b54f0 0x7f27401570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f274006e750 0x7f274014ddc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 --2- 172.21.15.32:0/1610604955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f274006eb30 0x7f27401f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 >> 172.21.15.32:0/1610604955 conn(0x7f27400cc6f0 msgr2=0x7f274006b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 shutdown_connections 2023-10-14T12:19:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.587+0000 7f2747e36700 1 -- 172.21.15.32:0/1610604955 wait complete. 2023-10-14T12:19:14.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.727+0000 7f4029d02700 1 Processor -- start 2023-10-14T12:19:14.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.727+0000 7f4029d02700 1 -- start start 2023-10-14T12:19:14.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4029d02700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4029d02700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f402406a840 0x7f402406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4029d02700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240b2d60 con 0x7f40240cd950 2023-10-14T12:19:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4029d02700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40241619a0 con 0x7f402406a840 2023-10-14T12:19:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4029d02700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402406b1f0 con 0x7f402415e2f0 2023-10-14T12:19:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f402406a840 0x7f402406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f402406a840 0x7f402406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38916/0 (socket says 172.21.15.32:38916) 2023-10-14T12:19:14.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 -- 172.21.15.32:0/1932511947 learned_addr learned my addr 172.21.15.32:0/1932511947 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:14.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4022ffd700 1 --2- 172.21.15.32:0/1932511947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 -- 172.21.15.32:0/1932511947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 msgr2=0x7f40240cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:14.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 --2- 172.21.15.32:0/1932511947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 -- 172.21.15.32:0/1932511947 >> v1:172.21.15.92:6789/0 conn(0x7f40240cd950 legacy=0x7f402415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:14.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.728+0000 7f4023fff700 1 -- 172.21.15.32:0/1932511947 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240cdd30 con 0x7f402406a840 2023-10-14T12:19:14.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4023fff700 1 --2- 172.21.15.32:0/1932511947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402406a840 0x7f402406acb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f401c009e50 tx=0x7f401c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b0ecfce26c5f46 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f40227fc700 1 -- 172.21.15.32:0/1932511947 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00e070 con 0x7f402406a840 2023-10-14T12:19:14.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f40227fc700 1 -- 172.21.15.32:0/1932511947 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c003a20 con 0x7f402406a840 2023-10-14T12:19:14.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f40227fc700 1 -- 172.21.15.32:0/1932511947 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c003dd0 con 0x7f402406a840 2023-10-14T12:19:14.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 -- 172.21.15.32:0/1932511947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402406a840 msgr2=0x7f402406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 --2- 172.21.15.32:0/1932511947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402406a840 0x7f402406acb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f401c009e50 tx=0x7f401c00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:14.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 -- 172.21.15.32:0/1932511947 shutdown_connections 2023-10-14T12:19:14.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 --2- 172.21.15.32:0/1932511947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402406a840 0x7f402406acb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 --2- 172.21.15.32:0/1932511947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 -- 172.21.15.32:0/1932511947 >> 172.21.15.32:0/1932511947 conn(0x7f402406dae0 msgr2=0x7f402406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:14.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 -- 172.21.15.32:0/1932511947 shutdown_connections 2023-10-14T12:19:14.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.729+0000 7f4029d02700 1 -- 172.21.15.32:0/1932511947 wait complete. 2023-10-14T12:19:14.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.731+0000 7f4029d02700 1 Processor -- start 2023-10-14T12:19:14.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.731+0000 7f4029d02700 1 -- start start 2023-10-14T12:19:14.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4029d02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f402406a840 0x7f4024150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4029d02700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 0x7f40240c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4029d02700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4029d02700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024151460 con 0x7f40240cd950 2023-10-14T12:19:14.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4029d02700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240c4c70 con 0x7f402406a840 2023-10-14T12:19:14.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4029d02700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40241f71b0 con 0x7f402415e2f0 2023-10-14T12:19:14.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 0x7f40240c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 0x7f40240c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38920/0 (socket says 172.21.15.32:38920) 2023-10-14T12:19:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 -- 172.21.15.32:0/1819939418 learned_addr learned my addr 172.21.15.32:0/1819939418 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4023fff700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f40237fe700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f402406a840 0x7f4024150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 -- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 msgr2=0x7f40240cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 -- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f402406a840 msgr2=0x7f4024150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f402406a840 0x7f4024150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f4022ffd700 1 -- 172.21.15.32:0/1819939418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009b30 con 0x7f40240cd950 2023-10-14T12:19:14.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.732+0000 7f40237fe700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f402406a840 0x7f4024150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:14.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.733+0000 7f4022ffd700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 0x7f40240c4730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c7f0 tx=0x7f400c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.733+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c004220 con 0x7f40240cd950 2023-10-14T12:19:14.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.733+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c004380 con 0x7f40240cd950 2023-10-14T12:19:14.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.733+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40241f7490 con 0x7f40240cd950 2023-10-14T12:19:14.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.733+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0036a0 con 0x7f40240cd950 2023-10-14T12:19:14.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.733+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40241f7a50 con 0x7f40240cd950 2023-10-14T12:19:14.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.734+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40240c6110 con 0x7f40240cd950 2023-10-14T12:19:14.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.734+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f400c003800 con 0x7f40240cd950 2023-10-14T12:19:14.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.735+0000 7f401bfff700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f400406af00 0x7f400406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.735+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f400c088ea0 con 0x7f40240cd950 2023-10-14T12:19:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.735+0000 7f40237fe700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f400406af00 0x7f400406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.735+0000 7f40237fe700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f400406af00 0x7f400406d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4014003fc0 tx=0x7f4014009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.739+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f400c053ec0 con 0x7f40240cd950 2023-10-14T12:19:14.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.938+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4024067d20 con 0x7f40240cd950 2023-10-14T12:19:14.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.938+0000 7f401bfff700 1 -- 172.21.15.32:0/1819939418 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f400c0574e0 con 0x7f40240cd950 2023-10-14T12:19:14.940 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:14.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f400406af00 msgr2=0x7f400406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f400406af00 0x7f400406d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4014003fc0 tx=0x7f4014009040 comp rx=0 tx=0).stop 2023-10-14T12:19:14.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 msgr2=0x7f40240c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:14.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 0x7f40240c4730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c7f0 tx=0x7f400c00cb00 comp rx=0 tx=0).stop 2023-10-14T12:19:14.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 shutdown_connections 2023-10-14T12:19:14.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f402415e2f0 0x7f40240cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f400406af00 0x7f400406d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f402406a840 0x7f4024150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 --2- 172.21.15.32:0/1819939418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40240cd950 0x7f40240c4730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:14.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 >> 172.21.15.32:0/1819939418 conn(0x7f402406dae0 msgr2=0x7f40241606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:14.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 shutdown_connections 2023-10-14T12:19:14.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:14.940+0000 7f4029d02700 1 -- 172.21.15.32:0/1819939418 wait complete. 2023-10-14T12:19:14.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:15.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.080+0000 7f13f35d9700 1 Processor -- start 2023-10-14T12:19:15.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.080+0000 7f13f35d9700 1 -- start start 2023-10-14T12:19:15.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f35d9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f13ec15f1f0 0x7f13ec0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f35d9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f13ec0cfc60 0x7f13ec0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f35d9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec15e7a0 con 0x7f13ec15ab10 2023-10-14T12:19:15.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f35d9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec0d0090 con 0x7f13ec15f1f0 2023-10-14T12:19:15.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f35d9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec0b29a0 con 0x7f13ec0cfc60 2023-10-14T12:19:15.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f0b74700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f13ec15f1f0 0x7f13ec0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f1375700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f13ec15ab10 0x7f13ec0b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55950/0 (socket says 172.21.15.32:55950) 2023-10-14T12:19:15.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.081+0000 7f13f1375700 1 -- 172.21.15.32:0/2064919104 learned_addr learned my addr 172.21.15.32:0/2064919104 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:15.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f1b76700 1 --2- 172.21.15.32:0/2064919104 >> v2:172.21.15.92:3300/0 conn(0x7f13ec0cfc60 0x7f13ec0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f0b74700 1 -- 172.21.15.32:0/2064919104 >> v2:172.21.15.92:3300/0 conn(0x7f13ec0cfc60 msgr2=0x7f13ec0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:15.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f0b74700 1 --2- 172.21.15.32:0/2064919104 >> v2:172.21.15.92:3300/0 conn(0x7f13ec0cfc60 0x7f13ec0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f0b74700 1 -- 172.21.15.32:0/2064919104 >> v1:172.21.15.32:6789/0 conn(0x7f13ec15ab10 legacy=0x7f13ec0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f0b74700 1 -- 172.21.15.32:0/2064919104 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec0b2c80 con 0x7f13ec15f1f0 2023-10-14T12:19:15.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13e3fff700 1 -- 172.21.15.32:0/2064919104 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877606352 0 0) 0x7f13ec15e7a0 con 0x7f13ec15ab10 2023-10-14T12:19:15.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f0b74700 1 --2- 172.21.15.32:0/2064919104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec0cf720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0d03e0 tx=0x7f13e8009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1511ce4ab3b659f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13e3fff700 1 -- 172.21.15.32:0/2064919104 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8005e30 con 0x7f13ec15f1f0 2023-10-14T12:19:15.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13e3fff700 1 -- 172.21.15.32:0/2064919104 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e8006030 con 0x7f13ec15f1f0 2023-10-14T12:19:15.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13e3fff700 1 -- 172.21.15.32:0/2064919104 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e80063c0 con 0x7f13ec15f1f0 2023-10-14T12:19:15.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f35d9700 1 -- 172.21.15.32:0/2064919104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 msgr2=0x7f13ec0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.082+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2064919104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec0cf720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0d03e0 tx=0x7f13e8009b00 comp rx=0 tx=0).stop 2023-10-14T12:19:15.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.083+0000 7f13f35d9700 1 -- 172.21.15.32:0/2064919104 shutdown_connections 2023-10-14T12:19:15.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.083+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2064919104 >> v2:172.21.15.92:3300/0 conn(0x7f13ec0cfc60 0x7f13ec0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.083+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2064919104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec0cf720 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.083+0000 7f13f35d9700 1 -- 172.21.15.32:0/2064919104 >> 172.21.15.32:0/2064919104 conn(0x7f13ec06dae0 msgr2=0x7f13ec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:15.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.083+0000 7f13f35d9700 1 -- 172.21.15.32:0/2064919104 shutdown_connections 2023-10-14T12:19:15.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.083+0000 7f13f35d9700 1 -- 172.21.15.32:0/2064919104 wait complete. 2023-10-14T12:19:15.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.084+0000 7f13f35d9700 1 Processor -- start 2023-10-14T12:19:15.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.084+0000 7f13f35d9700 1 -- start start 2023-10-14T12:19:15.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13ec0cfc60 0x7f13ec0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13ec15ab10 0x7f13ec0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0cd560 con 0x7f13ec15f1f0 2023-10-14T12:19:15.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec15de20 con 0x7f13ec0cfc60 2023-10-14T12:19:15.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0cc950 con 0x7f13ec15ab10 2023-10-14T12:19:15.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec146a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38936/0 (socket says 172.21.15.32:38936) 2023-10-14T12:19:15.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 -- 172.21.15.32:0/2901180392 learned_addr learned my addr 172.21.15.32:0/2901180392 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:15.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1375700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13ec0cfc60 0x7f13ec0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f0b74700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13ec15ab10 0x7f13ec0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 -- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13ec15ab10 msgr2=0x7f13ec0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13ec15ab10 0x7f13ec0d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 -- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13ec0cfc60 msgr2=0x7f13ec0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13ec0cfc60 0x7f13ec0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 -- 172.21.15.32:0/2901180392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8009430 con 0x7f13ec15f1f0 2023-10-14T12:19:15.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f0b74700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13ec15ab10 0x7f13ec0d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:15.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1375700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13ec0cfc60 0x7f13ec0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:15.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f1b76700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec146a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f13e4007e60 tx=0x7f13e400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400ede0 con 0x7f13ec15f1f0 2023-10-14T12:19:15.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e4014420 con 0x7f13ec15f1f0 2023-10-14T12:19:15.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec0ccc30 con 0x7f13ec15f1f0 2023-10-14T12:19:15.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.085+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e40147d0 con 0x7f13ec15f1f0 2023-10-14T12:19:15.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.086+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec0cd1f0 con 0x7f13ec15f1f0 2023-10-14T12:19:15.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.086+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec0cd8f0 con 0x7f13ec15f1f0 2023-10-14T12:19:15.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.087+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f13e4014930 con 0x7f13ec15f1f0 2023-10-14T12:19:15.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.087+0000 7f13e1ffb700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13d006af00 0x7f13d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.087+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13e4089d30 con 0x7f13ec15f1f0 2023-10-14T12:19:15.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.087+0000 7f13f1375700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13d006af00 0x7f13d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.088+0000 7f13f1375700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13d006af00 0x7f13d006d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f13dc007fd0 tx=0x7f13dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.092+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13e4054de0 con 0x7f13ec15f1f0 2023-10-14T12:19:15.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.293+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13ec067d20 con 0x7f13ec15f1f0 2023-10-14T12:19:15.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.294+0000 7f13e1ffb700 1 -- 172.21.15.32:0/2901180392 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13e4058400 con 0x7f13ec15f1f0 2023-10-14T12:19:15.295 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13d006af00 msgr2=0x7f13d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13d006af00 0x7f13d006d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f13dc007fd0 tx=0x7f13dc009040 comp rx=0 tx=0).stop 2023-10-14T12:19:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 msgr2=0x7f13ec146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec146a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f13e4007e60 tx=0x7f13e400e3c0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 shutdown_connections 2023-10-14T12:19:15.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ec15f1f0 0x7f13ec146a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13d006af00 0x7f13d006d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13ec0cfc60 0x7f13ec0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 --2- 172.21.15.32:0/2901180392 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13ec15ab10 0x7f13ec0d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 >> 172.21.15.32:0/2901180392 conn(0x7f13ec06dae0 msgr2=0x7f13ec0b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:15.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 shutdown_connections 2023-10-14T12:19:15.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.296+0000 7f13f35d9700 1 -- 172.21.15.32:0/2901180392 wait complete. 2023-10-14T12:19:15.310 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:15.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.433+0000 7f71f4f34700 1 Processor -- start 2023-10-14T12:19:15.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.433+0000 7f71f4f34700 1 -- start start 2023-10-14T12:19:15.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71f4f34700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71f015bb50 0x7f71f006e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71f4f34700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71f4f34700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f015bf30 con 0x7f71f00ce0b0 2023-10-14T12:19:15.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71f4f34700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f006f1d0 con 0x7f71f015bb50 2023-10-14T12:19:15.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71f4f34700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00ce540 con 0x7f71f006ed50 2023-10-14T12:19:15.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71ee59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71f015bb50 0x7f71f006e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.434+0000 7f71eed9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f71f00ce0b0 0x7f71f015f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55968/0 (socket says 172.21.15.32:55968) 2023-10-14T12:19:15.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71eed9d700 1 -- 172.21.15.32:0/2390251668 learned_addr learned my addr 172.21.15.32:0/2390251668 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:15.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71edd9b700 1 --2- 172.21.15.32:0/2390251668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ee59c700 1 -- 172.21.15.32:0/2390251668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 msgr2=0x7f71f00cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:15.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ee59c700 1 --2- 172.21.15.32:0/2390251668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ee59c700 1 -- 172.21.15.32:0/2390251668 >> v1:172.21.15.32:6789/0 conn(0x7f71f00ce0b0 legacy=0x7f71f015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ed59a700 1 -- 172.21.15.32:0/2390251668 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176318978 0 0) 0x7f71f015bf30 con 0x7f71f00ce0b0 2023-10-14T12:19:15.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ee59c700 1 -- 172.21.15.32:0/2390251668 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f006d500 con 0x7f71f015bb50 2023-10-14T12:19:15.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ee59c700 1 --2- 172.21.15.32:0/2390251668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f006e810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009870 tx=0x7f71e0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b34f5ea974aed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ed59a700 1 -- 172.21.15.32:0/2390251668 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011830 con 0x7f71f015bb50 2023-10-14T12:19:15.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ed59a700 1 -- 172.21.15.32:0/2390251668 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0011990 con 0x7f71f015bb50 2023-10-14T12:19:15.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.435+0000 7f71ed59a700 1 -- 172.21.15.32:0/2390251668 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011d20 con 0x7f71f015bb50 2023-10-14T12:19:15.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 -- 172.21.15.32:0/2390251668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 msgr2=0x7f71f006e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2390251668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f006e810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009870 tx=0x7f71e0009b80 comp rx=0 tx=0).stop 2023-10-14T12:19:15.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 -- 172.21.15.32:0/2390251668 shutdown_connections 2023-10-14T12:19:15.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2390251668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f006e810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2390251668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 -- 172.21.15.32:0/2390251668 >> 172.21.15.32:0/2390251668 conn(0x7f71f00cc6f0 msgr2=0x7f71f00ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:15.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 -- 172.21.15.32:0/2390251668 shutdown_connections 2023-10-14T12:19:15.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.436+0000 7f71f4f34700 1 -- 172.21.15.32:0/2390251668 wait complete. 2023-10-14T12:19:15.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.437+0000 7f71f4f34700 1 Processor -- start 2023-10-14T12:19:15.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.437+0000 7f71f4f34700 1 -- start start 2023-10-14T12:19:15.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71f4f34700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71f4f34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71f00ce0b0 0x7f71f0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71f4f34700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f00c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71f4f34700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00c6580 con 0x7f71f015bb50 2023-10-14T12:19:15.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71f4f34700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0146090 con 0x7f71f00ce0b0 2023-10-14T12:19:15.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71f4f34700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0155480 con 0x7f71f006ed50 2023-10-14T12:19:15.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f00c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f00c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38950/0 (socket says 172.21.15.32:38950) 2023-10-14T12:19:15.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 -- 172.21.15.32:0/2189896175 learned_addr learned my addr 172.21.15.32:0/2189896175 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:15.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71ee59c700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71edd9b700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71f00ce0b0 0x7f71f0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 -- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 msgr2=0x7f71f00c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 -- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71f00ce0b0 msgr2=0x7f71f0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71f00ce0b0 0x7f71f0155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.438+0000 7f71eed9d700 1 -- 172.21.15.32:0/2189896175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00094a0 con 0x7f71f015bb50 2023-10-14T12:19:15.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.439+0000 7f71eed9d700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f00c9410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71e800ccd0 tx=0x7f71e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.439+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800ada0 con 0x7f71f015bb50 2023-10-14T12:19:15.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.439+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80070d0 con 0x7f71f015bb50 2023-10-14T12:19:15.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.439+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f01462e0 con 0x7f71f015bb50 2023-10-14T12:19:15.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.439+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007480 con 0x7f71f015bb50 2023-10-14T12:19:15.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.439+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f01468a0 con 0x7f71f015bb50 2023-10-14T12:19:15.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.440+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f00668b0 con 0x7f71f015bb50 2023-10-14T12:19:15.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.440+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71e80075e0 con 0x7f71f015bb50 2023-10-14T12:19:15.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.441+0000 7f71e6ffd700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f71d006af00 0x7f71d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.441+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e8089610 con 0x7f71f015bb50 2023-10-14T12:19:15.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.441+0000 7f71ee59c700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f71d006af00 0x7f71d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.441+0000 7f71ee59c700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f71d006af00 0x7f71d006d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009bc0 tx=0x7f71e001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.445+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71e8054630 con 0x7f71f015bb50 2023-10-14T12:19:15.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.648+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f00afa20 con 0x7f71f015bb50 2023-10-14T12:19:15.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.649+0000 7f71e6ffd700 1 -- 172.21.15.32:0/2189896175 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f71e8018090 con 0x7f71f015bb50 2023-10-14T12:19:15.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:15.651 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:15.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.651+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f71d006af00 msgr2=0x7f71d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.651+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f71d006af00 0x7f71d006d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009bc0 tx=0x7f71e001c040 comp rx=0 tx=0).stop 2023-10-14T12:19:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.651+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 msgr2=0x7f71f00c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.651+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f00c9410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71e800ccd0 tx=0x7f71e800a340 comp rx=0 tx=0).stop 2023-10-14T12:19:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 shutdown_connections 2023-10-14T12:19:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f015bb50 0x7f71f00c9410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71f006ed50 0x7f71f00c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f71d006af00 0x7f71d006d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 --2- 172.21.15.32:0/2189896175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71f00ce0b0 0x7f71f0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 >> 172.21.15.32:0/2189896175 conn(0x7f71f00cc6f0 msgr2=0x7f71f015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 shutdown_connections 2023-10-14T12:19:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.652+0000 7f71f4f34700 1 -- 172.21.15.32:0/2189896175 wait complete. 2023-10-14T12:19:15.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:15.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 Processor -- start 2023-10-14T12:19:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 -- start start 2023-10-14T12:19:15.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cd950 0x7f8fa815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8fa80cede0 0x7f8fa815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80cf260 con 0x7f8fa806a840 2023-10-14T12:19:15.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa81619a0 con 0x7f8fa80cede0 2023-10-14T12:19:15.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.793+0000 7f8faf12f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80b2d60 con 0x7f8fa80cd950 2023-10-14T12:19:15.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fa7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8fa80cede0 0x7f8fa815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8facecb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cd950 0x7f8fa815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fad6cc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8fa806a840 0x7f8fa8161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:54858/0 (socket says 172.21.15.32:54858) 2023-10-14T12:19:15.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fad6cc700 1 -- 172.21.15.32:0/3909437361 learned_addr learned my addr 172.21.15.32:0/3909437361 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:15.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fa7fff700 1 -- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cd950 msgr2=0x7f8fa815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:15.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fa7fff700 1 --2- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cd950 0x7f8fa815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fa7fff700 1 -- 172.21.15.32:0/3909437361 >> v1:172.21.15.92:6789/0 conn(0x7f8fa806a840 legacy=0x7f8fa8161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fa7fff700 1 -- 172.21.15.32:0/3909437361 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80cdd30 con 0x7f8fa80cede0 2023-10-14T12:19:15.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8facecb700 1 --2- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cd950 0x7f8fa815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:15.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.794+0000 7f8fa7fff700 1 --2- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa80cede0 0x7f8fa815f570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009820 tx=0x7f8f94009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d500f15e8dcc8bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8fa77fe700 1 -- 172.21.15.32:0/3909437361 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94005e30 con 0x7f8fa80cede0 2023-10-14T12:19:15.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8fa77fe700 1 -- 172.21.15.32:0/3909437361 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94006030 con 0x7f8fa80cede0 2023-10-14T12:19:15.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8fa77fe700 1 -- 172.21.15.32:0/3909437361 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940063c0 con 0x7f8fa80cede0 2023-10-14T12:19:15.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 -- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa80cede0 msgr2=0x7f8fa815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 --2- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa80cede0 0x7f8fa815f570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009820 tx=0x7f8f94009b30 comp rx=0 tx=0).stop 2023-10-14T12:19:15.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 -- 172.21.15.32:0/3909437361 shutdown_connections 2023-10-14T12:19:15.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 --2- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cd950 0x7f8fa815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 --2- 172.21.15.32:0/3909437361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa80cede0 0x7f8fa815f570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 -- 172.21.15.32:0/3909437361 >> 172.21.15.32:0/3909437361 conn(0x7f8fa806dae0 msgr2=0x7f8fa806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:15.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 -- 172.21.15.32:0/3909437361 shutdown_connections 2023-10-14T12:19:15.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.795+0000 7f8faf12f700 1 -- 172.21.15.32:0/3909437361 wait complete. 2023-10-14T12:19:15.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.796+0000 7f8faf12f700 1 Processor -- start 2023-10-14T12:19:15.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.796+0000 7f8faf12f700 1 -- start start 2023-10-14T12:19:15.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8faf12f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa806a840 0x7f8fa80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8faf12f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 0x7f8fa81f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8faf12f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cede0 0x7f8fa81f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8faf12f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa815ae90 con 0x7f8fa80cd950 2023-10-14T12:19:15.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8faf12f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8157a60 con 0x7f8fa806a840 2023-10-14T12:19:15.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8faf12f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80add10 con 0x7f8fa80cede0 2023-10-14T12:19:15.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.797+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 0x7f8fa81f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 0x7f8fa81f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38962/0 (socket says 172.21.15.32:38962) 2023-10-14T12:19:15.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 -- 172.21.15.32:0/1010322707 learned_addr learned my addr 172.21.15.32:0/1010322707 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:15.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8facecb700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa806a840 0x7f8fa80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fad6cc700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cede0 0x7f8fa81f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 -- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cede0 msgr2=0x7f8fa81f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cede0 0x7f8fa81f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 -- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa806a840 msgr2=0x7f8fa80b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:15.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa806a840 0x7f8fa80b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:15.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 -- 172.21.15.32:0/1010322707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0094a0 con 0x7f8fa80cd950 2023-10-14T12:19:15.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa7fff700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 0x7f8fa81f69a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000c00 tx=0x7f8f94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940061a0 con 0x7f8fa80cd950 2023-10-14T12:19:15.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94020070 con 0x7f8fa80cd950 2023-10-14T12:19:15.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f94009430 con 0x7f8fa80cd950 2023-10-14T12:19:15.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94006540 con 0x7f8fa80cd950 2023-10-14T12:19:15.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.798+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa815a560 con 0x7f8fa80cd950 2023-10-14T12:19:15.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.799+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa8067d20 con 0x7f8fa80cd950 2023-10-14T12:19:15.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.800+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f94022030 con 0x7f8fa80cd950 2023-10-14T12:19:15.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.800+0000 7f8fa57fa700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f8c06af00 0x7f8f8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:15.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.800+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f9408a9c0 con 0x7f8fa80cd950 2023-10-14T12:19:15.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.800+0000 7f8facecb700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f8c06af00 0x7f8f8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:15.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.801+0000 7f8facecb700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f8c06af00 0x7f8f8c06d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d70 tx=0x7f8f9c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:15.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:15.805+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f94055b00 con 0x7f8fa80cd950 2023-10-14T12:19:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.003+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fa80b2100 con 0x7f8fa80cd950 2023-10-14T12:19:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.004+0000 7f8fa57fa700 1 -- 172.21.15.32:0/1010322707 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f940243d0 con 0x7f8fa80cd950 2023-10-14T12:19:16.005 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f8c06af00 msgr2=0x7f8f8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f8c06af00 0x7f8f8c06d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d70 tx=0x7f8f9c009210 comp rx=0 tx=0).stop 2023-10-14T12:19:16.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 msgr2=0x7f8fa81f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 0x7f8fa81f69a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000c00 tx=0x7f8f94004750 comp rx=0 tx=0).stop 2023-10-14T12:19:16.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 shutdown_connections 2023-10-14T12:19:16.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fa80cede0 0x7f8fa81f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f8c06af00 0x7f8f8c06d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fa806a840 0x7f8fa80b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 --2- 172.21.15.32:0/1010322707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fa80cd950 0x7f8fa81f69a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 >> 172.21.15.32:0/1010322707 conn(0x7f8fa806dae0 msgr2=0x7f8fa815f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 shutdown_connections 2023-10-14T12:19:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.006+0000 7f8faf12f700 1 -- 172.21.15.32:0/1010322707 wait complete. 2023-10-14T12:19:16.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:16.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.146+0000 7fcda28e1700 1 Processor -- start 2023-10-14T12:19:16.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.146+0000 7fcda28e1700 1 -- start start 2023-10-14T12:19:16.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcda28e1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 0x7fcd9c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcda28e1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c0b2d60 con 0x7fcd9c15e2f0 2023-10-14T12:19:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcda28e1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c0cdd30 con 0x7fcd9c0cd950 2023-10-14T12:19:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcda28e1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1619a0 con 0x7fcd9c06af50 2023-10-14T12:19:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcd9b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcd9c15e2f0 0x7fcd9c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55992/0 (socket says 172.21.15.32:55992) 2023-10-14T12:19:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcd9b7fe700 1 -- 172.21.15.32:0/3618040687 learned_addr learned my addr 172.21.15.32:0/3618040687 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:16.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.147+0000 7fcda0e7e700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 0x7fcd9c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082099998 0 0) 0x7fcd9c0b2d60 con 0x7fcd9c15e2f0 2023-10-14T12:19:16.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd840035b0 con 0x7fcd9c15e2f0 2023-10-14T12:19:16.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953437337 0 0) 0x7fcd840035b0 con 0x7fcd9c15e2f0 2023-10-14T12:19:16.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 msgr2=0x7fcd9c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:16.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 0x7fcd9c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 >> v1:172.21.15.92:6789/0 conn(0x7fcd9c0cd950 legacy=0x7fcd9c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c15e920 con 0x7fcd9c15e2f0 2023-10-14T12:19:16.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7fcd900017f0 con 0x7fcd9c15e2f0 2023-10-14T12:19:16.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 >> v1:172.21.15.32:6789/0 conn(0x7fcd9c15e2f0 legacy=0x7fcd9c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd84003a30 0x7fcd84003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd840048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 0x7fcd84005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1619a0 con 0x7fcd840043e0 2023-10-14T12:19:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8400ba40 con 0x7fcd84003a30 2023-10-14T12:19:16.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8400bc00 con 0x7fcd9c06af50 2023-10-14T12:19:16.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd840048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9bfff700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd84003a30 0x7fcd84003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcda0e7e700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 0x7fcd84005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9b7fe700 1 -- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 msgr2=0x7fcd84005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c06af50 0x7fcd84005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9b7fe700 1 -- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd84003a30 msgr2=0x7fcd84003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd84003a30 0x7fcd84003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.148+0000 7fcd9b7fe700 1 -- 172.21.15.32:0/3618040687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840035b0 con 0x7fcd840043e0 2023-10-14T12:19:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd840048b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000c240 tx=0x7fcd84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4153eb88d3fe474 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000cde0 con 0x7fcd840043e0 2023-10-14T12:19:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90007ba0 con 0x7fcd840043e0 2023-10-14T12:19:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcd9affd700 1 -- 172.21.15.32:0/3618040687 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90007310 con 0x7fcd840043e0 2023-10-14T12:19:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda28e1700 1 -- 172.21.15.32:0/3618040687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 msgr2=0x7fcd840048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda28e1700 1 --2- 172.21.15.32:0/3618040687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd840048b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000c240 tx=0x7fcd84005880 comp rx=0 tx=0).stop 2023-10-14T12:19:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda0e7e700 1 -- 172.21.15.32:0/3618040687 reap_dead start 2023-10-14T12:19:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda28e1700 1 -- 172.21.15.32:0/3618040687 shutdown_connections 2023-10-14T12:19:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda28e1700 1 -- 172.21.15.32:0/3618040687 >> 172.21.15.32:0/3618040687 conn(0x7fcd9c06dae0 msgr2=0x7fcd9c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda28e1700 1 -- 172.21.15.32:0/3618040687 shutdown_connections 2023-10-14T12:19:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.149+0000 7fcda28e1700 1 -- 172.21.15.32:0/3618040687 wait complete. 2023-10-14T12:19:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 Processor -- start 2023-10-14T12:19:16.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 -- start start 2023-10-14T12:19:16.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd9c0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd9c0ad290 0x7fcd9c0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c0aeb40 0x7fcd9c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15c2f0 con 0x7fcd840043e0 2023-10-14T12:19:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ad710 con 0x7fcd9c0ad290 2023-10-14T12:19:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.151+0000 7fcda28e1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0c8c60 con 0x7fcd9c0aeb40 2023-10-14T12:19:16.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd9c0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd9c0b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38978/0 (socket says 172.21.15.32:38978) 2023-10-14T12:19:16.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 -- 172.21.15.32:0/2036051793 learned_addr learned my addr 172.21.15.32:0/2036051793 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:16.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd9c0ad290 0x7fcd9c0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcda0e7e700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c0aeb40 0x7fcd9c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 -- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c0aeb40 msgr2=0x7fcd9c0aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c0aeb40 0x7fcd9c0aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 -- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd9c0ad290 msgr2=0x7fcd9c0c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd9c0ad290 0x7fcd9c0c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 -- 172.21.15.32:0/2036051793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0c8f00 con 0x7fcd840043e0 2023-10-14T12:19:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcda0e7e700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c0aeb40 0x7fcd9c0aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd9bfff700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd9c0b5770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00f780 tx=0x7fcd8c00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0052e0 con 0x7fcd840043e0 2023-10-14T12:19:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c005460 con 0x7fcd840043e0 2023-10-14T12:19:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c0c91e0 con 0x7fcd840043e0 2023-10-14T12:19:16.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0038c0 con 0x7fcd840043e0 2023-10-14T12:19:16.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.152+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c0c97a0 con 0x7fcd840043e0 2023-10-14T12:19:16.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.153+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c067d20 con 0x7fcd840043e0 2023-10-14T12:19:16.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.154+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd8c003a20 con 0x7fcd840043e0 2023-10-14T12:19:16.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.154+0000 7fcd98ff9700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcd8806af00 0x7fcd8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.154+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd8c0893e0 con 0x7fcd840043e0 2023-10-14T12:19:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.154+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcd8806af00 0x7fcd8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.155+0000 7fcd9b7fe700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcd8806af00 0x7fcd8806d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0c3e30 tx=0x7fcd90007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.158+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd8c054490 con 0x7fcd840043e0 2023-10-14T12:19:16.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.364+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd9c15eee0 con 0x7fcd840043e0 2023-10-14T12:19:16.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.364+0000 7fcd98ff9700 1 -- 172.21.15.32:0/2036051793 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd8c057ab0 con 0x7fcd840043e0 2023-10-14T12:19:16.366 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:16.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcd8806af00 msgr2=0x7fcd8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcd8806af00 0x7fcd8806d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0c3e30 tx=0x7fcd90007000 comp rx=0 tx=0).stop 2023-10-14T12:19:16.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 msgr2=0x7fcd9c0b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd9c0b5770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00f780 tx=0x7fcd8c00fa90 comp rx=0 tx=0).stop 2023-10-14T12:19:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 shutdown_connections 2023-10-14T12:19:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd9c0aeb40 0x7fcd9c0aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd840043e0 0x7fcd9c0b5770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcd8806af00 0x7fcd8806d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 --2- 172.21.15.32:0/2036051793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd9c0ad290 0x7fcd9c0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 >> 172.21.15.32:0/2036051793 conn(0x7fcd9c06dae0 msgr2=0x7fcd9c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.366+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 shutdown_connections 2023-10-14T12:19:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.367+0000 7fcda28e1700 1 -- 172.21.15.32:0/2036051793 wait complete. 2023-10-14T12:19:16.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:16.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.508+0000 7f2624da8700 1 Processor -- start 2023-10-14T12:19:16.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.508+0000 7f2624da8700 1 -- start start 2023-10-14T12:19:16.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f2624da8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f262015e030 0x7f26200cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f2624da8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f26200ce280 0x7f262006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f2624da8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262006adb0 con 0x7f262006a840 2023-10-14T12:19:16.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f2624da8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262006b090 con 0x7f26200ce280 2023-10-14T12:19:16.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f2624da8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262006b370 con 0x7f262015e030 2023-10-14T12:19:16.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f261ed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f26200ce280 0x7f262006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f261e59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f262015e030 0x7f26200cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f261ed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f26200ce280 0x7f262006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43258/0 (socket says 172.21.15.32:43258) 2023-10-14T12:19:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.509+0000 7f261ed9d700 1 -- 172.21.15.32:0/2864735722 learned_addr learned my addr 172.21.15.32:0/2864735722 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261ed9d700 1 -- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f262015e030 msgr2=0x7f26200cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261ed9d700 1 --2- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f262015e030 0x7f26200cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261ed9d700 1 -- 172.21.15.32:0/2864735722 >> v1:172.21.15.92:6789/0 conn(0x7f262006a840 legacy=0x7f26200cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261ed9d700 1 -- 172.21.15.32:0/2864735722 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262006b650 con 0x7f26200ce280 2023-10-14T12:19:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261e59c700 1 --2- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f262015e030 0x7f26200cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261ed9d700 1 --2- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26200ce280 0x7f262006d3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2618009e50 tx=0x7f261800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8716fc89d02a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261d59a700 1 -- 172.21.15.32:0/2864735722 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800e070 con 0x7f26200ce280 2023-10-14T12:19:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261d59a700 1 -- 172.21.15.32:0/2864735722 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800b910 con 0x7f26200ce280 2023-10-14T12:19:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.510+0000 7f261d59a700 1 -- 172.21.15.32:0/2864735722 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800bcc0 con 0x7f26200ce280 2023-10-14T12:19:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 -- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26200ce280 msgr2=0x7f262006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 --2- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26200ce280 0x7f262006d3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2618009e50 tx=0x7f261800b330 comp rx=0 tx=0).stop 2023-10-14T12:19:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 -- 172.21.15.32:0/2864735722 shutdown_connections 2023-10-14T12:19:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 --2- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f262015e030 0x7f26200cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 --2- 172.21.15.32:0/2864735722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26200ce280 0x7f262006d3d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 -- 172.21.15.32:0/2864735722 >> 172.21.15.32:0/2864735722 conn(0x7f26200cc6f0 msgr2=0x7f26200ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 -- 172.21.15.32:0/2864735722 shutdown_connections 2023-10-14T12:19:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.511+0000 7f2624da8700 1 -- 172.21.15.32:0/2864735722 wait complete. 2023-10-14T12:19:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.512+0000 7f2624da8700 1 Processor -- start 2023-10-14T12:19:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.512+0000 7f2624da8700 1 -- start start 2023-10-14T12:19:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f2624da8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 0x7f2620161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f2624da8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26200ce280 0x7f262015e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f2624da8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f262015e030 0x7f2620160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f2624da8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262015ec60 con 0x7f262006a840 2023-10-14T12:19:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f2624da8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200c79e0 con 0x7f262015e030 2023-10-14T12:19:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f2624da8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200c7cc0 con 0x7f26200ce280 2023-10-14T12:19:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 0x7f2620161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 0x7f2620161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38992/0 (socket says 172.21.15.32:38992) 2023-10-14T12:19:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 -- 172.21.15.32:0/3536812429 learned_addr learned my addr 172.21.15.32:0/3536812429 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261ed9d700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f262015e030 0x7f2620160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261dd9b700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26200ce280 0x7f262015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 -- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26200ce280 msgr2=0x7f262015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26200ce280 0x7f262015e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 -- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f262015e030 msgr2=0x7f2620160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f262015e030 0x7f2620160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261e59c700 1 -- 172.21.15.32:0/3536812429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140094a0 con 0x7f262006a840 2023-10-14T12:19:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.513+0000 7f261ed9d700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f262015e030 0x7f2620160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.514+0000 7f261e59c700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 0x7f2620161100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f261400ebe0 tx=0x7f261400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.514+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400c850 con 0x7f262006a840 2023-10-14T12:19:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.514+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400c9b0 con 0x7f262006a840 2023-10-14T12:19:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.514+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2618009b30 con 0x7f262006a840 2023-10-14T12:19:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.514+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400cd40 con 0x7f262006a840 2023-10-14T12:19:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.514+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26200c8280 con 0x7f262006a840 2023-10-14T12:19:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.515+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26200c84a0 con 0x7f262006a840 2023-10-14T12:19:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.515+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2614013470 con 0x7f262006a840 2023-10-14T12:19:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.515+0000 7f260effd700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f260006af00 0x7f260006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.516+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26140896f0 con 0x7f262006a840 2023-10-14T12:19:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.516+0000 7f261dd9b700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f260006af00 0x7f260006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.516+0000 7f261dd9b700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f260006af00 0x7f260006d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2620161640 tx=0x7f2610009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.520+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2614054720 con 0x7f262006a840 2023-10-14T12:19:16.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.719+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2620067d20 con 0x7f262006a840 2023-10-14T12:19:16.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.719+0000 7f260effd700 1 -- 172.21.15.32:0/3536812429 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f261400cea0 con 0x7f262006a840 2023-10-14T12:19:16.721 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:16.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f260006af00 msgr2=0x7f260006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f260006af00 0x7f260006d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2620161640 tx=0x7f2610009040 comp rx=0 tx=0).stop 2023-10-14T12:19:16.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 msgr2=0x7f2620161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 0x7f2620161100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f261400ebe0 tx=0x7f261400eef0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 shutdown_connections 2023-10-14T12:19:16.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f260006af00 0x7f260006d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f262015e030 0x7f2620160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f262006a840 0x7f2620161100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 --2- 172.21.15.32:0/3536812429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26200ce280 0x7f262015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 >> 172.21.15.32:0/3536812429 conn(0x7f26200cc6f0 msgr2=0x7f26200cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:16.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 shutdown_connections 2023-10-14T12:19:16.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.721+0000 7f2624da8700 1 -- 172.21.15.32:0/3536812429 wait complete. 2023-10-14T12:19:16.827 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2023-10-14T12:19:16.828 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T12:19:16.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:16.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.954+0000 7fa06c1f1700 1 Processor -- start 2023-10-14T12:19:16.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.954+0000 7fa06c1f1700 1 -- start start 2023-10-14T12:19:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06c1f1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa06406e750 0x7fa0640ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06c1f1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa0640b54f0 0x7fa0640cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06c1f1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0640b5c70 con 0x7fa06406eb30 2023-10-14T12:19:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06c1f1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0640b5990 con 0x7fa0640b54f0 2023-10-14T12:19:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06c1f1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06415b2b0 con 0x7fa06406e750 2023-10-14T12:19:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa0640b54f0 0x7fa0640cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa0640b54f0 0x7fa0640cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39002/0 (socket says 172.21.15.32:39002) 2023-10-14T12:19:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 -- 172.21.15.32:0/91321860 learned_addr learned my addr 172.21.15.32:0/91321860 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa069f8d700 1 --2- 172.21.15.32:0/91321860 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa06406e750 0x7fa0640ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 -- 172.21.15.32:0/91321860 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa06406e750 msgr2=0x7fa0640ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 --2- 172.21.15.32:0/91321860 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa06406e750 0x7fa0640ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 -- 172.21.15.32:0/91321860 >> v1:172.21.15.92:6789/0 conn(0x7fa06406eb30 legacy=0x7fa06415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa068f8b700 1 -- 172.21.15.32:0/91321860 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655520155 0 0) 0x7fa0640b5c70 con 0x7fa06406eb30 2023-10-14T12:19:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 -- 172.21.15.32:0/91321860 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06415b590 con 0x7fa0640b54f0 2023-10-14T12:19:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.955+0000 7fa06a78e700 1 --2- 172.21.15.32:0/91321860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0640b54f0 0x7fa0640cf400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009e50 tx=0x7fa05c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295d94fcd84af437 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa068f8b700 1 -- 172.21.15.32:0/91321860 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00e070 con 0x7fa0640b54f0 2023-10-14T12:19:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa068f8b700 1 -- 172.21.15.32:0/91321860 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00b910 con 0x7fa0640b54f0 2023-10-14T12:19:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa068f8b700 1 -- 172.21.15.32:0/91321860 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00bcc0 con 0x7fa0640b54f0 2023-10-14T12:19:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 -- 172.21.15.32:0/91321860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0640b54f0 msgr2=0x7fa0640cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/91321860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0640b54f0 0x7fa0640cf400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009e50 tx=0x7fa05c00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 -- 172.21.15.32:0/91321860 shutdown_connections 2023-10-14T12:19:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/91321860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0640b54f0 0x7fa0640cf400 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/91321860 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa06406e750 0x7fa0640ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 -- 172.21.15.32:0/91321860 >> 172.21.15.32:0/91321860 conn(0x7fa0640cc6f0 msgr2=0x7fa0640ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 -- 172.21.15.32:0/91321860 shutdown_connections 2023-10-14T12:19:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.956+0000 7fa06c1f1700 1 -- 172.21.15.32:0/91321860 wait complete. 2023-10-14T12:19:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.957+0000 7fa06c1f1700 1 Processor -- start 2023-10-14T12:19:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.957+0000 7fa06c1f1700 1 -- start start 2023-10-14T12:19:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa06c1f1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 0x7fa0640c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa06c1f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa06406eb30 0x7fa064156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa06c1f1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa0640b54f0 0x7fa0640c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa06c1f1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640c80a0 con 0x7fa06406e750 2023-10-14T12:19:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa06c1f1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640c7dc0 con 0x7fa06406eb30 2023-10-14T12:19:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa06c1f1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06415be10 con 0x7fa0640b54f0 2023-10-14T12:19:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa069f8d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 0x7fa0640c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa069f8d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 0x7fa0640c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39004/0 (socket says 172.21.15.32:39004) 2023-10-14T12:19:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.958+0000 7fa069f8d700 1 -- 172.21.15.32:0/2013349834 learned_addr learned my addr 172.21.15.32:0/2013349834 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa06978c700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa06406eb30 0x7fa064156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa06a78e700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa0640b54f0 0x7fa0640c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa069f8d700 1 -- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa0640b54f0 msgr2=0x7fa0640c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa069f8d700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa0640b54f0 0x7fa0640c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa069f8d700 1 -- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa06406eb30 msgr2=0x7fa064156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa069f8d700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa06406eb30 0x7fa064156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa069f8d700 1 -- 172.21.15.32:0/2013349834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c009b30 con 0x7fa06406e750 2023-10-14T12:19:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa06978c700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa06406eb30 0x7fa064156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa069f8d700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 0x7fa0640c46e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa06000e9b0 tx=0x7fa06000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060009710 con 0x7fa06406e750 2023-10-14T12:19:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06000c850 con 0x7fa06406e750 2023-10-14T12:19:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06415c0f0 con 0x7fa06406e750 2023-10-14T12:19:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000cbc0 con 0x7fa06406e750 2023-10-14T12:19:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.959+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640c9a20 con 0x7fa06406e750 2023-10-14T12:19:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.960+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06415c610 con 0x7fa06406e750 2023-10-14T12:19:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.961+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa06000cd20 con 0x7fa06406e750 2023-10-14T12:19:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.961+0000 7fa05a7fc700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa04806af00 0x7fa04806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.961+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa060089690 con 0x7fa06406e750 2023-10-14T12:19:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.961+0000 7fa06978c700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa04806af00 0x7fa04806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.961+0000 7fa06978c700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa04806af00 0x7fa04806d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa06406dff0 tx=0x7fa054009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:16.965+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa06415c610 con 0x7fa06406e750 2023-10-14T12:19:17.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.167+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa06415c610 con 0x7fa06406e750 2023-10-14T12:19:17.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.168+0000 7fa05a7fc700 1 -- 172.21.15.32:0/2013349834 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fa060058260 con 0x7fa06406e750 2023-10-14T12:19:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:17.170 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:17.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa04806af00 msgr2=0x7fa04806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa04806af00 0x7fa04806d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa06406dff0 tx=0x7fa054009040 comp rx=0 tx=0).stop 2023-10-14T12:19:17.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 msgr2=0x7fa0640c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 0x7fa0640c46e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa06000e9b0 tx=0x7fa06000ed70 comp rx=0 tx=0).stop 2023-10-14T12:19:17.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 shutdown_connections 2023-10-14T12:19:17.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa0640b54f0 0x7fa0640c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa06406e750 0x7fa0640c46e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa04806af00 0x7fa04806d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 --2- 172.21.15.32:0/2013349834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa06406eb30 0x7fa064156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 >> 172.21.15.32:0/2013349834 conn(0x7fa0640cc6f0 msgr2=0x7fa0640b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 shutdown_connections 2023-10-14T12:19:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.171+0000 7fa06c1f1700 1 -- 172.21.15.32:0/2013349834 wait complete. 2023-10-14T12:19:17.184 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:17.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.316+0000 7fcbe0c24700 1 Processor -- start 2023-10-14T12:19:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.316+0000 7fcbe0c24700 1 -- start start 2023-10-14T12:19:17.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbe0c24700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc0cd950 0x7fcbdc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbe0c24700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcbdc06a840 0x7fcbdc06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbe0c24700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0cf260 con 0x7fcbdc0cede0 2023-10-14T12:19:17.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbe0c24700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc1619a0 con 0x7fcbdc06a840 2023-10-14T12:19:17.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbe0c24700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc06b1f0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbd9d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcbdc0cede0 0x7fcbdc15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56036/0 (socket says 172.21.15.32:56036) 2023-10-14T12:19:17.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbd9d9b700 1 -- 172.21.15.32:0/1055277657 learned_addr learned my addr 172.21.15.32:0/1055277657 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:17.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbdad9d700 1 --2- 172.21.15.32:0/1055277657 >> v2:172.21.15.92:3300/0 conn(0x7fcbdc06a840 0x7fcbdc06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbda59c700 1 --2- 172.21.15.32:0/1055277657 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc0cd950 0x7fcbdc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbd959a700 1 -- 172.21.15.32:0/1055277657 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854780627 0 0) 0x7fcbdc0cf260 con 0x7fcbdc0cede0 2023-10-14T12:19:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbd959a700 1 -- 172.21.15.32:0/1055277657 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc40035b0 con 0x7fcbdc0cede0 2023-10-14T12:19:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbda59c700 1 -- 172.21.15.32:0/1055277657 >> v2:172.21.15.92:3300/0 conn(0x7fcbdc06a840 msgr2=0x7fcbdc06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:17.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbda59c700 1 --2- 172.21.15.32:0/1055277657 >> v2:172.21.15.92:3300/0 conn(0x7fcbdc06a840 0x7fcbdc06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbda59c700 1 -- 172.21.15.32:0/1055277657 >> v1:172.21.15.32:6789/0 conn(0x7fcbdc0cede0 legacy=0x7fcbdc15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbda59c700 1 -- 172.21.15.32:0/1055277657 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0b2d60 con 0x7fcbdc0cd950 2023-10-14T12:19:17.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.317+0000 7fcbdad9d700 1 --2- 172.21.15.32:0/1055277657 >> v2:172.21.15.92:3300/0 conn(0x7fcbdc06a840 0x7fcbdc06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:17.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbda59c700 1 --2- 172.21.15.32:0/1055277657 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc0cd950 0x7fcbdc15e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009840 tx=0x7fcbcc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de7fc80b34512a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbd959a700 1 -- 172.21.15.32:0/1055277657 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc011830 con 0x7fcbdc0cd950 2023-10-14T12:19:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbd959a700 1 -- 172.21.15.32:0/1055277657 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc011990 con 0x7fcbdc0cd950 2023-10-14T12:19:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbd959a700 1 -- 172.21.15.32:0/1055277657 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc011d00 con 0x7fcbdc0cd950 2023-10-14T12:19:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 -- 172.21.15.32:0/1055277657 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc0cd950 msgr2=0x7fcbdc15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/1055277657 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc0cd950 0x7fcbdc15e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009840 tx=0x7fcbcc009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 -- 172.21.15.32:0/1055277657 shutdown_connections 2023-10-14T12:19:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/1055277657 >> v2:172.21.15.92:3300/0 conn(0x7fcbdc06a840 0x7fcbdc06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/1055277657 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc0cd950 0x7fcbdc15e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 -- 172.21.15.32:0/1055277657 >> 172.21.15.32:0/1055277657 conn(0x7fcbdc06dae0 msgr2=0x7fcbdc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 -- 172.21.15.32:0/1055277657 shutdown_connections 2023-10-14T12:19:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.318+0000 7fcbe0c24700 1 -- 172.21.15.32:0/1055277657 wait complete. 2023-10-14T12:19:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 Processor -- start 2023-10-14T12:19:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 -- start start 2023-10-14T12:19:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc06a840 0x7fcbdc1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 0x7fcbdc1e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbdc0cede0 0x7fcbdc155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b3190 con 0x7fcbdc0cd950 2023-10-14T12:19:17.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc153ee0 con 0x7fcbdc0cede0 2023-10-14T12:19:17.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.320+0000 7fcbe0c24700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc1e7530 con 0x7fcbdc06a840 2023-10-14T12:19:17.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 0x7fcbdc1e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 0x7fcbdc1e6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39018/0 (socket says 172.21.15.32:39018) 2023-10-14T12:19:17.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 -- 172.21.15.32:0/2254066568 learned_addr learned my addr 172.21.15.32:0/2254066568 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:17.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbda59c700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc06a840 0x7fcbdc1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbdad9d700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbdc0cede0 0x7fcbdc155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 -- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc06a840 msgr2=0x7fcbdc1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc06a840 0x7fcbdc1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 -- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbdc0cede0 msgr2=0x7fcbdc155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbdc0cede0 0x7fcbdc155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 -- 172.21.15.32:0/2254066568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4009a70 con 0x7fcbdc0cd950 2023-10-14T12:19:17.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbd9d9b700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 0x7fcbdc1e6a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000c700 tx=0x7fcbd000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:17.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00074e0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0007640 con 0x7fcbdc0cd950 2023-10-14T12:19:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0094a0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0005a70 con 0x7fcbdc0cd950 2023-10-14T12:19:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.321+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc1e7af0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.322+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc067d20 con 0x7fcbdc0cd950 2023-10-14T12:19:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.323+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbd0005bd0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.323+0000 7fcbcaffd700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.323+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbd0088a00 con 0x7fcbdc0cd950 2023-10-14T12:19:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.323+0000 7fcbda59c700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.324+0000 7fcbda59c700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc000c00 tx=0x7fcbcc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:17.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.328+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbd0053ab0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.530+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbdc06acb0 con 0x7fcbdc0cd950 2023-10-14T12:19:17.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.530+0000 7fcbcaffd700 1 -- 172.21.15.32:0/2254066568 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbd0017020 con 0x7fcbdc0cd950 2023-10-14T12:19:17.532 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:17.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcbbc06af00 msgr2=0x7fcbbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc000c00 tx=0x7fcbcc008030 comp rx=0 tx=0).stop 2023-10-14T12:19:17.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 msgr2=0x7fcbdc1e6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 0x7fcbdc1e6a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000c700 tx=0x7fcbd000ca10 comp rx=0 tx=0).stop 2023-10-14T12:19:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 shutdown_connections 2023-10-14T12:19:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbdc0cede0 0x7fcbdc155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbdc06a840 0x7fcbdc1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 --2- 172.21.15.32:0/2254066568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbdc0cd950 0x7fcbdc1e6a70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 >> 172.21.15.32:0/2254066568 conn(0x7fcbdc06dae0 msgr2=0x7fcbdc1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:17.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 shutdown_connections 2023-10-14T12:19:17.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.533+0000 7fcbe0c24700 1 -- 172.21.15.32:0/2254066568 wait complete. 2023-10-14T12:19:17.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:17.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.673+0000 7f9605431700 1 Processor -- start 2023-10-14T12:19:17.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.673+0000 7f9605431700 1 -- start start 2023-10-14T12:19:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f9605431700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f960015dbc0 0x7f960015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f9605431700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f9605431700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960015e4e0 con 0x7f96000d3fc0 2023-10-14T12:19:17.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f9605431700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000b7560 con 0x7f960015dbc0 2023-10-14T12:19:17.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f9605431700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96000b7840 con 0x7f96000b7050 2023-10-14T12:19:17.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f960015dbc0 0x7f960015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f960015dbc0 0x7f960015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39024/0 (socket says 172.21.15.32:39024) 2023-10-14T12:19:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 -- 172.21.15.32:0/1757925520 learned_addr learned my addr 172.21.15.32:0/1757925520 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95fe7fc700 1 --1- 172.21.15.32:0/1757925520 >> v1:172.21.15.32:6789/0 conn(0x7f96000d3fc0 0x7f96000d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56048/0 (socket says 172.21.15.32:56048) 2023-10-14T12:19:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 -- 172.21.15.32:0/1757925520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 msgr2=0x7f96000d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 --2- 172.21.15.32:0/1757925520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 -- 172.21.15.32:0/1757925520 >> v1:172.21.15.32:6789/0 conn(0x7f96000d3fc0 legacy=0x7f96000d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 -- 172.21.15.32:0/1757925520 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000b7b20 con 0x7f960015dbc0 2023-10-14T12:19:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95fdffb700 1 -- 172.21.15.32:0/1757925520 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600895004 0 0) 0x7f960015e4e0 con 0x7f96000d3fc0 2023-10-14T12:19:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.674+0000 7f95feffd700 1 --2- 172.21.15.32:0/1757925520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960015dfa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95f4006fd0 tx=0x7f95f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7529b67036a0e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f95fdffb700 1 -- 172.21.15.32:0/1757925520 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4005e30 con 0x7f960015dbc0 2023-10-14T12:19:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f95fdffb700 1 -- 172.21.15.32:0/1757925520 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4004030 con 0x7f960015dbc0 2023-10-14T12:19:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f95fdffb700 1 -- 172.21.15.32:0/1757925520 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40043e0 con 0x7f960015dbc0 2023-10-14T12:19:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 -- 172.21.15.32:0/1757925520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 msgr2=0x7f960015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 --2- 172.21.15.32:0/1757925520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960015dfa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95f4006fd0 tx=0x7f95f4009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 -- 172.21.15.32:0/1757925520 shutdown_connections 2023-10-14T12:19:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 --2- 172.21.15.32:0/1757925520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960015dfa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 --2- 172.21.15.32:0/1757925520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 -- 172.21.15.32:0/1757925520 >> 172.21.15.32:0/1757925520 conn(0x7f960009cb40 msgr2=0x7f96000d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 -- 172.21.15.32:0/1757925520 shutdown_connections 2023-10-14T12:19:17.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.675+0000 7f9605431700 1 -- 172.21.15.32:0/1757925520 wait complete. 2023-10-14T12:19:17.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.677+0000 7f9605431700 1 Processor -- start 2023-10-14T12:19:17.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.677+0000 7f9605431700 1 -- start start 2023-10-14T12:19:17.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f9605431700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f9605431700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96000d3fc0 0x7f960014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f9605431700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f9605431700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001e7030 con 0x7f960015dbc0 2023-10-14T12:19:17.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f9605431700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001e6d50 con 0x7f96000d3fc0 2023-10-14T12:19:17.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f9605431700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9600148a30 con 0x7f96000b7050 2023-10-14T12:19:17.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960014af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39032/0 (socket says 172.21.15.32:39032) 2023-10-14T12:19:17.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 -- 172.21.15.32:0/3056429053 learned_addr learned my addr 172.21.15.32:0/3056429053 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:17.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95feffd700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95fe7fc700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96000d3fc0 0x7f960014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 -- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 msgr2=0x7f96000a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 -- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96000d3fc0 msgr2=0x7f960014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96000d3fc0 0x7f960014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.678+0000 7f95ff7fe700 1 -- 172.21.15.32:0/3056429053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009500 con 0x7f960015dbc0 2023-10-14T12:19:17.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.679+0000 7f95ff7fe700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960014af60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95f800b970 tx=0x7f95f800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:17.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.679+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800c9b0 con 0x7f960015dbc0 2023-10-14T12:19:17.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.679+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f800cb30 con 0x7f960015dbc0 2023-10-14T12:19:17.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.679+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9600148d10 con 0x7f960015dbc0 2023-10-14T12:19:17.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.679+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8014440 con 0x7f960015dbc0 2023-10-14T12:19:17.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.679+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96000a1360 con 0x7f960015dbc0 2023-10-14T12:19:17.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.680+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600149230 con 0x7f960015dbc0 2023-10-14T12:19:17.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.680+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f95f801d3b0 con 0x7f960015dbc0 2023-10-14T12:19:17.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.681+0000 7f95e77fe700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95ec06af00 0x7f95ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:17.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.681+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95f8006e40 con 0x7f960015dbc0 2023-10-14T12:19:17.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.681+0000 7f95feffd700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95ec06af00 0x7f95ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:17.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.681+0000 7f95feffd700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95ec06af00 0x7f95ec06d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009c10 tx=0x7f95f4008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:17.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.685+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9600149230 con 0x7f960015dbc0 2023-10-14T12:19:17.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.882+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9600149230 con 0x7f960015dbc0 2023-10-14T12:19:17.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.883+0000 7f95e77fe700 1 -- 172.21.15.32:0/3056429053 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9600149230 con 0x7f960015dbc0 2023-10-14T12:19:17.884 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:17.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95ec06af00 msgr2=0x7f95ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95ec06af00 0x7f95ec06d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009c10 tx=0x7f95f4008070 comp rx=0 tx=0).stop 2023-10-14T12:19:17.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 msgr2=0x7f960014af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:17.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960014af60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95f800b970 tx=0x7f95f800bd30 comp rx=0 tx=0).stop 2023-10-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 shutdown_connections 2023-10-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f960015dbc0 0x7f960014af60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96000b7050 0x7f96000a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95ec06af00 0x7f95ec06d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 --2- 172.21.15.32:0/3056429053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96000d3fc0 0x7f960014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:17.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 >> 172.21.15.32:0/3056429053 conn(0x7f960009cb40 msgr2=0x7f96000cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:17.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 shutdown_connections 2023-10-14T12:19:17.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:17.885+0000 7f9605431700 1 -- 172.21.15.32:0/3056429053 wait complete. 2023-10-14T12:19:17.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:18.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.026+0000 7f3ed8de4700 1 Processor -- start 2023-10-14T12:19:18.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.026+0000 7f3ed8de4700 1 -- start start 2023-10-14T12:19:18.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed8de4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3ed40cdb70 0x7f3ed40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed8de4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ed406a8d0 0x7f3ed406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed8de4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed40ce490 con 0x7f3ed406e780 2023-10-14T12:19:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed8de4700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed406d500 con 0x7f3ed406a8d0 2023-10-14T12:19:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed8de4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed406d7e0 con 0x7f3ed40cdb70 2023-10-14T12:19:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ed406a8d0 0x7f3ed406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ed406a8d0 0x7f3ed406ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39040/0 (socket says 172.21.15.32:39040) 2023-10-14T12:19:18.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 -- 172.21.15.32:0/2237607305 learned_addr learned my addr 172.21.15.32:0/2237607305 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:18.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed259c700 1 --2- 172.21.15.32:0/2237607305 >> v2:172.21.15.92:3300/0 conn(0x7f3ed40cdb70 0x7f3ed40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 -- 172.21.15.32:0/2237607305 >> v2:172.21.15.92:3300/0 conn(0x7f3ed40cdb70 msgr2=0x7f3ed40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 --2- 172.21.15.32:0/2237607305 >> v2:172.21.15.92:3300/0 conn(0x7f3ed40cdb70 0x7f3ed40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 -- 172.21.15.32:0/2237607305 >> v1:172.21.15.92:6789/0 conn(0x7f3ed406e780 legacy=0x7f3ed415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 -- 172.21.15.32:0/2237607305 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed406dac0 con 0x7f3ed406a8d0 2023-10-14T12:19:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed2d9d700 1 --2- 172.21.15.32:0/2237607305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed406ad00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40ce9e0 tx=0x7f3ecc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c33eaf2b83eaf03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed159a700 1 -- 172.21.15.32:0/2237607305 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00e070 con 0x7f3ed406a8d0 2023-10-14T12:19:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.027+0000 7f3ed159a700 1 -- 172.21.15.32:0/2237607305 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc003a20 con 0x7f3ed406a8d0 2023-10-14T12:19:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed159a700 1 -- 172.21.15.32:0/2237607305 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc003dd0 con 0x7f3ed406a8d0 2023-10-14T12:19:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 -- 172.21.15.32:0/2237607305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 msgr2=0x7f3ed406ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/2237607305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed406ad00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40ce9e0 tx=0x7f3ecc00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 -- 172.21.15.32:0/2237607305 shutdown_connections 2023-10-14T12:19:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/2237607305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed406ad00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/2237607305 >> v2:172.21.15.92:3300/0 conn(0x7f3ed40cdb70 0x7f3ed40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 -- 172.21.15.32:0/2237607305 >> 172.21.15.32:0/2237607305 conn(0x7f3ed40cc6f0 msgr2=0x7f3ed40ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 -- 172.21.15.32:0/2237607305 shutdown_connections 2023-10-14T12:19:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.028+0000 7f3ed8de4700 1 -- 172.21.15.32:0/2237607305 wait complete. 2023-10-14T12:19:18.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.029+0000 7f3ed8de4700 1 Processor -- start 2023-10-14T12:19:18.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 -- start start 2023-10-14T12:19:18.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ed406e780 0x7f3ed41f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ed40cdb70 0x7f3ed41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4157080 con 0x7f3ed406a8d0 2023-10-14T12:19:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4157360 con 0x7f3ed40cdb70 2023-10-14T12:19:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed8de4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4157640 con 0x7f3ed406e780 2023-10-14T12:19:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed40c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39042/0 (socket says 172.21.15.32:39042) 2023-10-14T12:19:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.030+0000 7f3ed259c700 1 -- 172.21.15.32:0/277614536 learned_addr learned my addr 172.21.15.32:0/277614536 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed2d9d700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ed40cdb70 0x7f3ed41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed1d9b700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ed406e780 0x7f3ed41f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed259c700 1 -- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ed406e780 msgr2=0x7f3ed41f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed259c700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ed406e780 0x7f3ed41f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed259c700 1 -- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ed40cdb70 msgr2=0x7f3ed41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed259c700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ed40cdb70 0x7f3ed41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed259c700 1 -- 172.21.15.32:0/277614536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009b30 con 0x7f3ed406a8d0 2023-10-14T12:19:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed2d9d700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ed40cdb70 0x7f3ed41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed259c700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed40c8760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400e810 tx=0x7f3ec400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4013610 con 0x7f3ed406a8d0 2023-10-14T12:19:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4013770 con 0x7f3ed406a8d0 2023-10-14T12:19:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed4157920 con 0x7f3ed406a8d0 2023-10-14T12:19:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4013b20 con 0x7f3ed406a8d0 2023-10-14T12:19:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.031+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed41f1520 con 0x7f3ed406a8d0 2023-10-14T12:19:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.032+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed4067d20 con 0x7f3ed406a8d0 2023-10-14T12:19:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.033+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ec4013c80 con 0x7f3ed406a8d0 2023-10-14T12:19:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.033+0000 7f3ec2ffd700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3eb406af00 0x7f3eb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.033+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ec4089330 con 0x7f3ed406a8d0 2023-10-14T12:19:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.033+0000 7f3ed1d9b700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3eb406af00 0x7f3eb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.034+0000 7f3ed1d9b700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3eb406af00 0x7f3eb406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40af740 tx=0x7f3ec8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:18.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.037+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ec4054360 con 0x7f3ed406a8d0 2023-10-14T12:19:18.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.239+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ed4066870 con 0x7f3ed406a8d0 2023-10-14T12:19:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.239+0000 7f3ec2ffd700 1 -- 172.21.15.32:0/277614536 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ec4057980 con 0x7f3ed406a8d0 2023-10-14T12:19:18.241 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3eb406af00 msgr2=0x7f3eb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3eb406af00 0x7f3eb406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40af740 tx=0x7f3ec8009040 comp rx=0 tx=0).stop 2023-10-14T12:19:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 msgr2=0x7f3ed40c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed40c8760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400e810 tx=0x7f3ec400ebd0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 shutdown_connections 2023-10-14T12:19:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3eb406af00 0x7f3eb406d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ed40cdb70 0x7f3ed41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ed406a8d0 0x7f3ed40c8760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 --2- 172.21.15.32:0/277614536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ed406e780 0x7f3ed41f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.241+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 >> 172.21.15.32:0/277614536 conn(0x7f3ed40cc6f0 msgr2=0x7f3ed415c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.242+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 shutdown_connections 2023-10-14T12:19:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.242+0000 7f3ed8de4700 1 -- 172.21.15.32:0/277614536 wait complete. 2023-10-14T12:19:18.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-10-14T12:19:18.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.381+0000 7eff0ba80700 1 Processor -- start 2023-10-14T12:19:18.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.381+0000 7eff0ba80700 1 -- start start 2023-10-14T12:19:18.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0ba80700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff0415ab10 0x7eff0415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0ba80700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040cfe30 0x7eff040cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0ba80700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0415e7a0 con 0x7eff040b1f50 2023-10-14T12:19:18.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0ba80700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0415f730 con 0x7eff0415ab10 2023-10-14T12:19:18.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0ba80700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040b29a0 con 0x7eff040cfe30 2023-10-14T12:19:18.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff0415ab10 0x7eff0415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff0415ab10 0x7eff0415f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39050/0 (socket says 172.21.15.32:39050) 2023-10-14T12:19:18.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 -- 172.21.15.32:0/122116593 learned_addr learned my addr 172.21.15.32:0/122116593 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:18.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0a01d700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040cfe30 0x7eff040cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 -- 172.21.15.32:0/122116593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040cfe30 msgr2=0x7eff040cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:18.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040cfe30 0x7eff040cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 -- 172.21.15.32:0/122116593 >> v1:172.21.15.92:6789/0 conn(0x7eff040b1f50 legacy=0x7eff040cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:18.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0981c700 1 -- 172.21.15.32:0/122116593 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040b2c80 con 0x7eff0415ab10 2023-10-14T12:19:18.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.382+0000 7eff0a01d700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040cfe30 0x7eff040cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:18.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0981c700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff0415ab10 0x7eff0415f1f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff000098f0 tx=0x7eff00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1fa4ee288d2cec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:18.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0881a700 1 -- 172.21.15.32:0/122116593 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00004230 con 0x7eff0415ab10 2023-10-14T12:19:18.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0881a700 1 -- 172.21.15.32:0/122116593 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00004390 con 0x7eff0415ab10 2023-10-14T12:19:18.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0881a700 1 -- 172.21.15.32:0/122116593 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000036a0 con 0x7eff0415ab10 2023-10-14T12:19:18.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 -- 172.21.15.32:0/122116593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff0415ab10 msgr2=0x7eff0415f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff0415ab10 0x7eff0415f1f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff000098f0 tx=0x7eff00009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:18.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 -- 172.21.15.32:0/122116593 shutdown_connections 2023-10-14T12:19:18.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040cfe30 0x7eff040cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 --2- 172.21.15.32:0/122116593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff0415ab10 0x7eff0415f1f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 -- 172.21.15.32:0/122116593 >> 172.21.15.32:0/122116593 conn(0x7eff0406dae0 msgr2=0x7eff0406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:18.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 -- 172.21.15.32:0/122116593 shutdown_connections 2023-10-14T12:19:18.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.383+0000 7eff0ba80700 1 -- 172.21.15.32:0/122116593 wait complete. 2023-10-14T12:19:18.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 Processor -- start 2023-10-14T12:19:18.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 -- start start 2023-10-14T12:19:18.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040b1f50 0x7eff040aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 0x7eff040ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff0415ab10 0x7eff04156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040ad800 con 0x7eff040cfe30 2023-10-14T12:19:18.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04156c70 con 0x7eff0415ab10 2023-10-14T12:19:18.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0ba80700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415cfa0 con 0x7eff040b1f50 2023-10-14T12:19:18.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.385+0000 7eff0901b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 0x7eff040ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 0x7eff040ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39058/0 (socket says 172.21.15.32:39058) 2023-10-14T12:19:18.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 -- 172.21.15.32:0/2080529746 learned_addr learned my addr 172.21.15.32:0/2080529746 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:18.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0a01d700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff0415ab10 0x7eff04156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0981c700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040b1f50 0x7eff040aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 -- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040b1f50 msgr2=0x7eff040aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040b1f50 0x7eff040aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 -- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff0415ab10 msgr2=0x7eff04156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:18.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff0415ab10 0x7eff04156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 -- 172.21.15.32:0/2080529746 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009550 con 0x7eff040cfe30 2023-10-14T12:19:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0901b700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 0x7eff040ad2c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efef400b480 tx=0x7efef400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4004020 con 0x7eff040cfe30 2023-10-14T12:19:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4004180 con 0x7eff040cfe30 2023-10-14T12:19:18.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0415db20 con 0x7eff040cfe30 2023-10-14T12:19:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4004530 con 0x7eff040cfe30 2023-10-14T12:19:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.386+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0415d4d0 con 0x7eff040cfe30 2023-10-14T12:19:18.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.387+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff04067d20 con 0x7eff040cfe30 2023-10-14T12:19:18.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.388+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efef40036d0 con 0x7eff040cfe30 2023-10-14T12:19:18.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.388+0000 7efefa7fc700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efee806af00 0x7efee806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:18.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.388+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efef4088cf0 con 0x7eff040cfe30 2023-10-14T12:19:18.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.388+0000 7eff0981c700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efee806af00 0x7efee806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:18.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.389+0000 7eff0981c700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efee806af00 0x7efee806d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7eff00009130 tx=0x7eff00008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:18.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.392+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efef408d070 con 0x7eff040cfe30 2023-10-14T12:19:18.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:18.677+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7eff040afc10 con 0x7eff040cfe30 2023-10-14T12:19:19.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.281+0000 7efefa7fc700 1 -- 172.21.15.32:0/2080529746 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7efef4015030 con 0x7eff040cfe30 2023-10-14T12:19:19.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efee806af00 msgr2=0x7efee806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efee806af00 0x7efee806d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7eff00009130 tx=0x7eff00008030 comp rx=0 tx=0).stop 2023-10-14T12:19:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 msgr2=0x7eff040ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 0x7eff040ad2c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efef400b480 tx=0x7efef400b790 comp rx=0 tx=0).stop 2023-10-14T12:19:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 shutdown_connections 2023-10-14T12:19:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7efee806af00 0x7efee806d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff0415ab10 0x7eff04156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff040b1f50 0x7eff040aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 --2- 172.21.15.32:0/2080529746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff040cfe30 0x7eff040ad2c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 >> 172.21.15.32:0/2080529746 conn(0x7eff0406dae0 msgr2=0x7eff0406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:19.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 shutdown_connections 2023-10-14T12:19:19.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.284+0000 7eff0ba80700 1 -- 172.21.15.32:0/2080529746 wait complete. 2023-10-14T12:19:19.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T12:19:19.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.434+0000 7ff3dc173700 1 Processor -- start 2023-10-14T12:19:19.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.434+0000 7ff3dc173700 1 -- start start 2023-10-14T12:19:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3dc173700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3d40cd950 0x7ff3d415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3dc173700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff3d406a840 0x7ff3d406ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3dc173700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40cf290 con 0x7ff3d40cede0 2023-10-14T12:19:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3dc173700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d41619a0 con 0x7ff3d40cd950 2023-10-14T12:19:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3dc173700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d406b1b0 con 0x7ff3d406a840 2023-10-14T12:19:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d9f0f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3d40cd950 0x7ff3d415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d970e700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff3d40cede0 0x7ff3d415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56088/0 (socket says 172.21.15.32:56088) 2023-10-14T12:19:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d9f0f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3d40cd950 0x7ff3d415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39064/0 (socket says 172.21.15.32:39064) 2023-10-14T12:19:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d970e700 1 -- 172.21.15.32:0/1148333193 learned_addr learned my addr 172.21.15.32:0/1148333193 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3da710700 1 --2- 172.21.15.32:0/1148333193 >> v2:172.21.15.92:3300/0 conn(0x7ff3d406a840 0x7ff3d406ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d9f0f700 1 -- 172.21.15.32:0/1148333193 >> v2:172.21.15.92:3300/0 conn(0x7ff3d406a840 msgr2=0x7ff3d406ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d9f0f700 1 --2- 172.21.15.32:0/1148333193 >> v2:172.21.15.92:3300/0 conn(0x7ff3d406a840 0x7ff3d406ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d9f0f700 1 -- 172.21.15.32:0/1148333193 >> v1:172.21.15.32:6789/0 conn(0x7ff3d40cede0 legacy=0x7ff3d415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.435+0000 7ff3d9f0f700 1 -- 172.21.15.32:0/1148333193 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40b2d60 con 0x7ff3d40cd950 2023-10-14T12:19:19.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3d9f0f700 1 --2- 172.21.15.32:0/1148333193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d415e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff3d415e830 tx=0x7ff3c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f718a8e10ba0f22 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:19.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3d8f0d700 1 -- 172.21.15.32:0/1148333193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4011830 con 0x7ff3d40cd950 2023-10-14T12:19:19.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3d8f0d700 1 -- 172.21.15.32:0/1148333193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c4011990 con 0x7ff3d40cd950 2023-10-14T12:19:19.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3d8f0d700 1 -- 172.21.15.32:0/1148333193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4011d20 con 0x7ff3d40cd950 2023-10-14T12:19:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 -- 172.21.15.32:0/1148333193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 msgr2=0x7ff3d415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 --2- 172.21.15.32:0/1148333193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d415e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff3d415e830 tx=0x7ff3c4009b20 comp rx=0 tx=0).stop 2023-10-14T12:19:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 -- 172.21.15.32:0/1148333193 shutdown_connections 2023-10-14T12:19:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 --2- 172.21.15.32:0/1148333193 >> v2:172.21.15.92:3300/0 conn(0x7ff3d406a840 0x7ff3d406ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 --2- 172.21.15.32:0/1148333193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d415e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 -- 172.21.15.32:0/1148333193 >> 172.21.15.32:0/1148333193 conn(0x7ff3d406dae0 msgr2=0x7ff3d406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.436+0000 7ff3dc173700 1 -- 172.21.15.32:0/1148333193 shutdown_connections 2023-10-14T12:19:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.437+0000 7ff3dc173700 1 -- 172.21.15.32:0/1148333193 wait complete. 2023-10-14T12:19:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 Processor -- start 2023-10-14T12:19:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 -- start start 2023-10-14T12:19:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3d406a840 0x7ff3d40ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d40ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3d40cede0 0x7ff3d40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40b5d00 con 0x7ff3d40cd950 2023-10-14T12:19:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40af220 con 0x7ff3d406a840 2023-10-14T12:19:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.438+0000 7ff3dc173700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c9c50 con 0x7ff3d40cede0 2023-10-14T12:19:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d40ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d40ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39070/0 (socket says 172.21.15.32:39070) 2023-10-14T12:19:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 -- 172.21.15.32:0/3758921760 learned_addr learned my addr 172.21.15.32:0/3758921760 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d9f0f700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3d406a840 0x7ff3d40ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3da710700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3d40cede0 0x7ff3d40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 -- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3d40cede0 msgr2=0x7ff3d40aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3d40cede0 0x7ff3d40aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 -- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3d406a840 msgr2=0x7ff3d40ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3d406a840 0x7ff3d40ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 -- 172.21.15.32:0/3758921760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40094a0 con 0x7ff3d40cd950 2023-10-14T12:19:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3d970e700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d40ae7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000c4d0 tx=0x7ff3d000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00074e0 con 0x7ff3d40cd950 2023-10-14T12:19:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d0007640 con 0x7ff3d40cd950 2023-10-14T12:19:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40c9f30 con 0x7ff3d40cd950 2023-10-14T12:19:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0005a30 con 0x7ff3d40cd950 2023-10-14T12:19:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.439+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d40add40 con 0x7ff3d40cd950 2023-10-14T12:19:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.440+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d40ca450 con 0x7ff3d40cd950 2023-10-14T12:19:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.441+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3d0005b90 con 0x7ff3d40cd950 2023-10-14T12:19:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.441+0000 7ff3ca7fc700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3b806af00 0x7ff3b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.441+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3d0088820 con 0x7ff3d40cd950 2023-10-14T12:19:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.441+0000 7ff3d9f0f700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3b806af00 0x7ff3b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.442+0000 7ff3d9f0f700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3b806af00 0x7ff3b806d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40090b0 tx=0x7ff3c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.446+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3d0053980 con 0x7ff3d40cd950 2023-10-14T12:19:19.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.649+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff3d4067d20 con 0x7ff3d40cd950 2023-10-14T12:19:19.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.652+0000 7ff3ca7fc700 1 -- 172.21.15.32:0/3758921760 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3d0017020 con 0x7ff3d40cd950 2023-10-14T12:19:19.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3b806af00 msgr2=0x7ff3b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3b806af00 0x7ff3b806d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40090b0 tx=0x7ff3c4008030 comp rx=0 tx=0).stop 2023-10-14T12:19:19.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 msgr2=0x7ff3d40ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:19.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d40ae7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000c4d0 tx=0x7ff3d000c7e0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 shutdown_connections 2023-10-14T12:19:19.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3d40cede0 0x7ff3d40aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff3b806af00 0x7ff3b806d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3d406a840 0x7ff3d40ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 --2- 172.21.15.32:0/3758921760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3d40cd950 0x7ff3d40ae7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:19.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 >> 172.21.15.32:0/3758921760 conn(0x7ff3d406dae0 msgr2=0x7ff3d40ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:19.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 shutdown_connections 2023-10-14T12:19:19.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:19.654+0000 7ff3dc173700 1 -- 172.21.15.32:0/3758921760 wait complete. 2023-10-14T12:19:19.667 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T12:19:19.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T12:19:19.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T12:19:19.764 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T12:19:19.764 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:19.765 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:19.783 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:19.783 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:19.843 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:19.843 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:19.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:20.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.084+0000 7f93e02f2700 1 Processor -- start 2023-10-14T12:19:20.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.084+0000 7f93e02f2700 1 -- start start 2023-10-14T12:19:20.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93e02f2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f93d815bb50 0x7f93d806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93e02f2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93e02f2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d815bf30 con 0x7f93d806ed50 2023-10-14T12:19:20.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93e02f2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d806f1d0 con 0x7f93d815bb50 2023-10-14T12:19:20.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93e02f2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80b2d70 con 0x7f93d80ce280 2023-10-14T12:19:20.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f93d815bb50 0x7f93d806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f93d815bb50 0x7f93d806e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39076/0 (socket says 172.21.15.32:39076) 2023-10-14T12:19:20.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 -- 172.21.15.32:0/1750657696 learned_addr learned my addr 172.21.15.32:0/1750657696 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:20.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de88f700 1 --2- 172.21.15.32:0/1750657696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 -- 172.21.15.32:0/1750657696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 msgr2=0x7f93d806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:20.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 --2- 172.21.15.32:0/1750657696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 -- 172.21.15.32:0/1750657696 >> v1:172.21.15.92:6789/0 conn(0x7f93d806ed50 legacy=0x7f93d80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.085+0000 7f93de08e700 1 -- 172.21.15.32:0/1750657696 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d806d500 con 0x7f93d815bb50 2023-10-14T12:19:20.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93de08e700 1 --2- 172.21.15.32:0/1750657696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d806e810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93c80098f0 tx=0x7f93c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3b2a0e03a5156 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93dd08c700 1 -- 172.21.15.32:0/1750657696 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800b8a0 con 0x7f93d815bb50 2023-10-14T12:19:20.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93dd08c700 1 -- 172.21.15.32:0/1750657696 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c800ba00 con 0x7f93d815bb50 2023-10-14T12:19:20.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93dd08c700 1 -- 172.21.15.32:0/1750657696 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800bd90 con 0x7f93d815bb50 2023-10-14T12:19:20.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 -- 172.21.15.32:0/1750657696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 msgr2=0x7f93d806e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 --2- 172.21.15.32:0/1750657696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d806e810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93c80098f0 tx=0x7f93c8009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:20.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 -- 172.21.15.32:0/1750657696 shutdown_connections 2023-10-14T12:19:20.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 --2- 172.21.15.32:0/1750657696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 --2- 172.21.15.32:0/1750657696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d806e810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 -- 172.21.15.32:0/1750657696 >> 172.21.15.32:0/1750657696 conn(0x7f93d80cc6f0 msgr2=0x7f93d80ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:20.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.086+0000 7f93e02f2700 1 -- 172.21.15.32:0/1750657696 shutdown_connections 2023-10-14T12:19:20.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.087+0000 7f93e02f2700 1 -- 172.21.15.32:0/1750657696 wait complete. 2023-10-14T12:19:20.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.088+0000 7f93e02f2700 1 Processor -- start 2023-10-14T12:19:20.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.088+0000 7f93e02f2700 1 -- start start 2023-10-14T12:19:20.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.088+0000 7f93e02f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93d806ed50 0x7f93d81545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.088+0000 7f93e02f2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d8152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93e02f2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d80c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93e02f2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81534f0 con 0x7f93d815bb50 2023-10-14T12:19:20.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93e02f2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8152c50 con 0x7f93d806ed50 2023-10-14T12:19:20.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93e02f2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8152f30 con 0x7f93d80ce280 2023-10-14T12:19:20.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d80c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d80c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39086/0 (socket says 172.21.15.32:39086) 2023-10-14T12:19:20.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 -- 172.21.15.32:0/4140528626 learned_addr learned my addr 172.21.15.32:0/4140528626 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:20.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93dd88d700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d8152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de08e700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93d806ed50 0x7f93d81545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 -- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 msgr2=0x7f93d8152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d8152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 -- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93d806ed50 msgr2=0x7f93d81545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93d806ed50 0x7f93d81545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 -- 172.21.15.32:0/4140528626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8009550 con 0x7f93d815bb50 2023-10-14T12:19:20.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93dd88d700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d8152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:20.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93de88f700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d80c7440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007e40 tx=0x7f93d000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000ede0 con 0x7f93d815bb50 2023-10-14T12:19:20.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0014420 con 0x7f93d815bb50 2023-10-14T12:19:20.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8153210 con 0x7f93d815bb50 2023-10-14T12:19:20.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00147d0 con 0x7f93d815bb50 2023-10-14T12:19:20.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.089+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d80c7980 con 0x7f93d815bb50 2023-10-14T12:19:20.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.090+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8156870 con 0x7f93d815bb50 2023-10-14T12:19:20.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.091+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f93d0014930 con 0x7f93d815bb50 2023-10-14T12:19:20.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.091+0000 7f93ceffd700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f93bc06af00 0x7f93bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.091+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93d0089d30 con 0x7f93d815bb50 2023-10-14T12:19:20.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.091+0000 7f93de08e700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f93bc06af00 0x7f93bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.092+0000 7f93de08e700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f93bc06af00 0x7f93bc06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009c40 tx=0x7f93c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.096+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93d0054df0 con 0x7f93d815bb50 2023-10-14T12:19:20.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.298+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93d815f0c0 con 0x7f93d815bb50 2023-10-14T12:19:20.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.299+0000 7f93ceffd700 1 -- 172.21.15.32:0/4140528626 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f93d0058410 con 0x7f93d815bb50 2023-10-14T12:19:20.300 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:20.301 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:20.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f93bc06af00 msgr2=0x7f93bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f93bc06af00 0x7f93bc06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009c40 tx=0x7f93c8008030 comp rx=0 tx=0).stop 2023-10-14T12:19:20.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 msgr2=0x7f93d80c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d80c7440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007e40 tx=0x7f93d000e3c0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 shutdown_connections 2023-10-14T12:19:20.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93d815bb50 0x7f93d80c7440 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f93bc06af00 0x7f93bc06d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93d806ed50 0x7f93d81545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 --2- 172.21.15.32:0/4140528626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93d80ce280 0x7f93d8152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 >> 172.21.15.32:0/4140528626 conn(0x7f93d80cc6f0 msgr2=0x7f93d80b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 shutdown_connections 2023-10-14T12:19:20.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.301+0000 7f93e02f2700 1 -- 172.21.15.32:0/4140528626 wait complete. 2023-10-14T12:19:20.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:20.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:20.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.443+0000 7f8b4c8b8700 1 Processor -- start 2023-10-14T12:19:20.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.444+0000 7f8b4c8b8700 1 -- start start 2023-10-14T12:19:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4c8b8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b4815ab10 0x7f8b4815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4c8b8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b480cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4c8b8700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4815e7a0 con 0x7f8b480b1f50 2023-10-14T12:19:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4c8b8700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4815f730 con 0x7f8b4815ab10 2023-10-14T12:19:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4c8b8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480b29a0 con 0x7f8b480cfe30 2023-10-14T12:19:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b4815ab10 0x7f8b4815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b4815ab10 0x7f8b4815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39090/0 (socket says 172.21.15.32:39090) 2023-10-14T12:19:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b45d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8b480b1f50 0x7f8b480cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56116/0 (socket says 172.21.15.32:56116) 2023-10-14T12:19:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 -- 172.21.15.32:0/3876608370 learned_addr learned my addr 172.21.15.32:0/3876608370 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:20.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/3876608370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b480cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 -- 172.21.15.32:0/3876608370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 msgr2=0x7f8b480cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:20.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 --2- 172.21.15.32:0/3876608370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b480cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 -- 172.21.15.32:0/3876608370 >> v1:172.21.15.32:6789/0 conn(0x7f8b480b1f50 legacy=0x7f8b480cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4659c700 1 -- 172.21.15.32:0/3876608370 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480b2c80 con 0x7f8b4815ab10 2023-10-14T12:19:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.445+0000 7f8b4559a700 1 -- 172.21.15.32:0/3876608370 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890671862 0 0) 0x7f8b4815e7a0 con 0x7f8b480b1f50 2023-10-14T12:19:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4659c700 1 --2- 172.21.15.32:0/3876608370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b4815f1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800bb90 tx=0x7f8b3800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fe58f14b0abda1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4559a700 1 -- 172.21.15.32:0/3876608370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800dd30 con 0x7f8b4815ab10 2023-10-14T12:19:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4559a700 1 -- 172.21.15.32:0/3876608370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800de90 con 0x7f8b4815ab10 2023-10-14T12:19:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4559a700 1 -- 172.21.15.32:0/3876608370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38010690 con 0x7f8b4815ab10 2023-10-14T12:19:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/3876608370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 msgr2=0x7f8b4815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/3876608370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b4815f1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800bb90 tx=0x7f8b3800bea0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/3876608370 shutdown_connections 2023-10-14T12:19:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/3876608370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b4815f1f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/3876608370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b480cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/3876608370 >> 172.21.15.32:0/3876608370 conn(0x7f8b4806dae0 msgr2=0x7f8b4806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/3876608370 shutdown_connections 2023-10-14T12:19:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.446+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/3876608370 wait complete. 2023-10-14T12:19:20.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.448+0000 7f8b4c8b8700 1 Processor -- start 2023-10-14T12:19:20.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.448+0000 7f8b4c8b8700 1 -- start start 2023-10-14T12:19:20.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4c8b8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b480b1f50 0x7f8b48144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4c8b8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b481474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4c8b8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b480c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4c8b8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4815caf0 con 0x7f8b4815ab10 2023-10-14T12:19:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4c8b8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481f33d0 con 0x7f8b480b1f50 2023-10-14T12:19:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4c8b8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481f2850 con 0x7f8b480cfe30 2023-10-14T12:19:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b46d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b480c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b46d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b480c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39100/0 (socket says 172.21.15.32:39100) 2023-10-14T12:19:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b46d9d700 1 -- 172.21.15.32:0/1398446342 learned_addr learned my addr 172.21.15.32:0/1398446342 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b45d9b700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b481474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.449+0000 7f8b4659c700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b480b1f50 0x7f8b48144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b46d9d700 1 -- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 msgr2=0x7f8b481474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b481474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b46d9d700 1 -- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b480b1f50 msgr2=0x7f8b48144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b480b1f50 0x7f8b48144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b46d9d700 1 -- 172.21.15.32:0/1398446342 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3800b7f0 con 0x7f8b4815ab10 2023-10-14T12:19:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b480c6a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000efc0 tx=0x7f8b4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000cc90 con 0x7f8b4815ab10 2023-10-14T12:19:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000f040 con 0x7f8b4815ab10 2023-10-14T12:19:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b481f2b30 con 0x7f8b4815ab10 2023-10-14T12:19:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40014480 con 0x7f8b4815ab10 2023-10-14T12:19:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.450+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b481f30f0 con 0x7f8b4815ab10 2023-10-14T12:19:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.451+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4815cc60 con 0x7f8b4815ab10 2023-10-14T12:19:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.451+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8b40014600 con 0x7f8b4815ab10 2023-10-14T12:19:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.452+0000 7f8b3effd700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8b2806af00 0x7f8b2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.452+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b40089e00 con 0x7f8b4815ab10 2023-10-14T12:19:20.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.452+0000 7f8b4659c700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8b2806af00 0x7f8b2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.453+0000 7f8b4659c700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8b2806af00 0x7f8b2806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000c00 tx=0x7f8b38013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.456+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b4815cc60 con 0x7f8b4815ab10 2023-10-14T12:19:20.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.654+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b4815cc30 con 0x7f8b4815ab10 2023-10-14T12:19:20.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.654+0000 7f8b3effd700 1 -- 172.21.15.32:0/1398446342 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b40018020 con 0x7f8b4815ab10 2023-10-14T12:19:20.656 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8b2806af00 msgr2=0x7f8b2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8b2806af00 0x7f8b2806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b38000c00 tx=0x7f8b38013000 comp rx=0 tx=0).stop 2023-10-14T12:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 msgr2=0x7f8b480c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b480c6a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000efc0 tx=0x7f8b4000c3a0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 shutdown_connections 2023-10-14T12:19:20.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b4815ab10 0x7f8b480c6a10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8b2806af00 0x7f8b2806d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b480b1f50 0x7f8b48144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 --2- 172.21.15.32:0/1398446342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b480cfe30 0x7f8b481474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 >> 172.21.15.32:0/1398446342 conn(0x7f8b4806dae0 msgr2=0x7f8b480b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:20.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 shutdown_connections 2023-10-14T12:19:20.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.656+0000 7f8b4c8b8700 1 -- 172.21.15.32:0/1398446342 wait complete. 2023-10-14T12:19:20.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:20.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.796+0000 7f0727f7e700 1 Processor -- start 2023-10-14T12:19:20.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.796+0000 7f0727f7e700 1 -- start start 2023-10-14T12:19:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.797+0000 7f0727f7e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07200cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.797+0000 7f0727f7e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07200b3530 con 0x7f07200b28b0 2023-10-14T12:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0727f7e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07200cd180 con 0x7f072006af50 2023-10-14T12:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0727f7e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200cde00 con 0x7f072015f130 2023-10-14T12:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725519700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f07200b28b0 0x7f072006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56128/0 (socket says 172.21.15.32:56128) 2023-10-14T12:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725519700 1 -- 172.21.15.32:0/880559856 learned_addr learned my addr 172.21.15.32:0/880559856 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725d1a700 1 --2- 172.21.15.32:0/880559856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07200cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853243018 0 0) 0x7f07200b3530 con 0x7f07200b28b0 2023-10-14T12:19:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f070c0035b0 con 0x7f07200b28b0 2023-10-14T12:19:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237597417 0 0) 0x7f07200cd180 con 0x7f072006af50 2023-10-14T12:19:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07200b3530 con 0x7f072006af50 2023-10-14T12:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875320242 0 0) 0x7f070c0035b0 con 0x7f07200b28b0 2023-10-14T12:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725d1a700 1 -- 172.21.15.32:0/880559856 >> v1:172.21.15.92:6789/0 conn(0x7f072006af50 legacy=0x7f07200b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725d1a700 1 -- 172.21.15.32:0/880559856 >> v1:172.21.15.32:6789/0 conn(0x7f07200b28b0 legacy=0x7f072006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725d1a700 1 -- 172.21.15.32:0/880559856 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200cd460 con 0x7f072015f130 2023-10-14T12:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.798+0000 7f0725d1a700 1 --2- 172.21.15.32:0/880559856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07200cede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0710009870 tx=0x7f0710009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e2bee9e53da93d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c001770 con 0x7f072015f130 2023-10-14T12:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0710004030 con 0x7f072015f130 2023-10-14T12:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0724d18700 1 -- 172.21.15.32:0/880559856 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07100043a0 con 0x7f072015f130 2023-10-14T12:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 -- 172.21.15.32:0/880559856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 msgr2=0x7f07200cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 --2- 172.21.15.32:0/880559856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07200cede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0710009870 tx=0x7f0710009b80 comp rx=0 tx=0).stop 2023-10-14T12:19:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 -- 172.21.15.32:0/880559856 shutdown_connections 2023-10-14T12:19:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 --2- 172.21.15.32:0/880559856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07200cede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 -- 172.21.15.32:0/880559856 >> 172.21.15.32:0/880559856 conn(0x7f072006dae0 msgr2=0x7f072006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 -- 172.21.15.32:0/880559856 shutdown_connections 2023-10-14T12:19:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.799+0000 7f0727f7e700 1 -- 172.21.15.32:0/880559856 wait complete. 2023-10-14T12:19:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.801+0000 7f0727f7e700 1 Processor -- start 2023-10-14T12:19:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.801+0000 7f0727f7e700 1 -- start start 2023-10-14T12:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0727f7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072006af50 0x7f07201f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0727f7e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 0x7f0720156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0727f7e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07201f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0727f7e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07201440c0 con 0x7f07200b28b0 2023-10-14T12:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0727f7e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720157d60 con 0x7f072006af50 2023-10-14T12:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0727f7e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07201f10d0 con 0x7f072015f130 2023-10-14T12:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 0x7f0720156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 0x7f0720156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39112/0 (socket says 172.21.15.32:39112) 2023-10-14T12:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 -- 172.21.15.32:0/2991946213 learned_addr learned my addr 172.21.15.32:0/2991946213 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725d1a700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072006af50 0x7f07201f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f072651b700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07201f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 -- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 msgr2=0x7f07201f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07201f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 -- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072006af50 msgr2=0x7f07201f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072006af50 0x7f07201f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 -- 172.21.15.32:0/2991946213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100094a0 con 0x7f07200b28b0 2023-10-14T12:19:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f0725519700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 0x7f0720156e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c520 tx=0x7f071c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.802+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0074e0 con 0x7f07200b28b0 2023-10-14T12:19:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.803+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c007640 con 0x7f07200b28b0 2023-10-14T12:19:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.803+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07201577a0 con 0x7f07200b28b0 2023-10-14T12:19:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.803+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c005a70 con 0x7f07200b28b0 2023-10-14T12:19:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.803+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07200c7ed0 con 0x7f07200b28b0 2023-10-14T12:19:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.804+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0720067d20 con 0x7f07200b28b0 2023-10-14T12:19:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.804+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f071c005bd0 con 0x7f07200b28b0 2023-10-14T12:19:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.804+0000 7f07167fc700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f070406af00 0x7f070406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.805+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f071c088990 con 0x7f07200b28b0 2023-10-14T12:19:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.805+0000 7f0725d1a700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f070406af00 0x7f070406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.805+0000 7f0725d1a700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f070406af00 0x7f070406d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07100097c0 tx=0x7f0710008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:20.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:20.809+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f071c053ad0 con 0x7f07200b28b0 2023-10-14T12:19:21.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.007+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07200b1b10 con 0x7f07200b28b0 2023-10-14T12:19:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.007+0000 7f07167fc700 1 -- 172.21.15.32:0/2991946213 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f071c017020 con 0x7f07200b28b0 2023-10-14T12:19:21.009 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:21.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f070406af00 msgr2=0x7f070406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f070406af00 0x7f070406d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07100097c0 tx=0x7f0710008030 comp rx=0 tx=0).stop 2023-10-14T12:19:21.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 msgr2=0x7f0720156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 0x7f0720156e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c520 tx=0x7f071c00c830 comp rx=0 tx=0).stop 2023-10-14T12:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 shutdown_connections 2023-10-14T12:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f072015f130 0x7f07201f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f070406af00 0x7f070406d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072006af50 0x7f07201f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 --2- 172.21.15.32:0/2991946213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07200b28b0 0x7f0720156e00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 >> 172.21.15.32:0/2991946213 conn(0x7f072006dae0 msgr2=0x7f072006a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:21.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 shutdown_connections 2023-10-14T12:19:21.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.009+0000 7f0727f7e700 1 -- 172.21.15.32:0/2991946213 wait complete. 2023-10-14T12:19:21.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:21.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.150+0000 7f0d7ee6a700 1 Processor -- start 2023-10-14T12:19:21.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.150+0000 7f0d7ee6a700 1 -- start start 2023-10-14T12:19:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7ee6a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cd950 0x7f0d7815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7ee6a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d780cede0 0x7f0d7815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7ee6a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d7806a840 0x7f0d7806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7ee6a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d781619a0 con 0x7f0d780cede0 2023-10-14T12:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7ee6a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7806b1f0 con 0x7f0d7806a840 2023-10-14T12:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7ee6a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780cf260 con 0x7f0d780cd950 2023-10-14T12:19:21.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d77fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d780cede0 0x7f0d7815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d77fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d780cede0 0x7f0d7815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39118/0 (socket says 172.21.15.32:39118) 2023-10-14T12:19:21.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d77fff700 1 -- 172.21.15.32:0/4117154482 learned_addr learned my addr 172.21.15.32:0/4117154482 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:21.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7cc06700 1 --2- 172.21.15.32:0/4117154482 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cd950 0x7f0d7815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.151+0000 7f0d7d407700 1 --2- 172.21.15.32:0/4117154482 >> v2:172.21.15.92:3300/0 conn(0x7f0d7806a840 0x7f0d7806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d77fff700 1 -- 172.21.15.32:0/4117154482 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cd950 msgr2=0x7f0d7815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d77fff700 1 --2- 172.21.15.32:0/4117154482 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cd950 0x7f0d7815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d77fff700 1 -- 172.21.15.32:0/4117154482 >> v2:172.21.15.92:3300/0 conn(0x7f0d7806a840 msgr2=0x7f0d7806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d77fff700 1 --2- 172.21.15.32:0/4117154482 >> v2:172.21.15.92:3300/0 conn(0x7f0d7806a840 0x7f0d7806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d77fff700 1 -- 172.21.15.32:0/4117154482 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780b2d60 con 0x7f0d780cede0 2023-10-14T12:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7d407700 1 --2- 172.21.15.32:0/4117154482 >> v2:172.21.15.92:3300/0 conn(0x7f0d7806a840 0x7f0d7806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d77fff700 1 --2- 172.21.15.32:0/4117154482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cede0 0x7f0d7815f570 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d7806ebc0 tx=0x7f0d60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6927020d5b54f2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d777fe700 1 -- 172.21.15.32:0/4117154482 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60005e30 con 0x7f0d780cede0 2023-10-14T12:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d777fe700 1 -- 172.21.15.32:0/4117154482 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60004030 con 0x7f0d780cede0 2023-10-14T12:19:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d777fe700 1 -- 172.21.15.32:0/4117154482 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600043e0 con 0x7f0d780cede0 2023-10-14T12:19:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/4117154482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cede0 msgr2=0x7f0d7815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/4117154482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cede0 0x7f0d7815f570 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d7806ebc0 tx=0x7f0d60009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/4117154482 shutdown_connections 2023-10-14T12:19:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/4117154482 >> v2:172.21.15.92:3300/0 conn(0x7f0d7806a840 0x7f0d7806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/4117154482 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cd950 0x7f0d7815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/4117154482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cede0 0x7f0d7815f570 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.152+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/4117154482 >> 172.21.15.32:0/4117154482 conn(0x7f0d7806dae0 msgr2=0x7f0d7806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.153+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/4117154482 shutdown_connections 2023-10-14T12:19:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.153+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/4117154482 wait complete. 2023-10-14T12:19:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.154+0000 7f0d7ee6a700 1 Processor -- start 2023-10-14T12:19:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.154+0000 7f0d7ee6a700 1 -- start start 2023-10-14T12:19:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7806a840 0x7f0d781f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 0x7f0d781532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cede0 0x7f0d780ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781542e0 con 0x7f0d780cd950 2023-10-14T12:19:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781f7c50 con 0x7f0d7806a840 2023-10-14T12:19:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780c5d30 con 0x7f0d780cede0 2023-10-14T12:19:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 0x7f0d781532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 0x7f0d781532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39126/0 (socket says 172.21.15.32:39126) 2023-10-14T12:19:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 -- 172.21.15.32:0/3359212676 learned_addr learned my addr 172.21.15.32:0/3359212676 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7cc06700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7806a840 0x7f0d781f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7d407700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cede0 0x7f0d780ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 -- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cede0 msgr2=0x7f0d780ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cede0 0x7f0d780ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 -- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7806a840 msgr2=0x7f0d781f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7806a840 0x7f0d781f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 -- 172.21.15.32:0/3359212676 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60009500 con 0x7f0d780cd950 2023-10-14T12:19:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d77fff700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 0x7f0d781532e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009130 tx=0x7f0d60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60003c70 con 0x7f0d780cd950 2023-10-14T12:19:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60003dd0 con 0x7f0d780cd950 2023-10-14T12:19:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780c6010 con 0x7f0d780cd950 2023-10-14T12:19:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.155+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60011660 con 0x7f0d780cd950 2023-10-14T12:19:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.156+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d78154810 con 0x7f0d780cd950 2023-10-14T12:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.156+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d78067d20 con 0x7f0d780cd950 2023-10-14T12:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.157+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d600117c0 con 0x7f0d780cd950 2023-10-14T12:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.157+0000 7f0d757fa700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d5806af00 0x7f0d5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.157+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d6008a650 con 0x7f0d780cd950 2023-10-14T12:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.157+0000 7f0d7cc06700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d5806af00 0x7f0d5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.158+0000 7f0d7cc06700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d5806af00 0x7f0d5806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d70003c10 tx=0x7f0d700098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.162+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d60055790 con 0x7f0d780cd950 2023-10-14T12:19:21.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.360+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d780b5f70 con 0x7f0d780cd950 2023-10-14T12:19:21.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.360+0000 7f0d757fa700 1 -- 172.21.15.32:0/3359212676 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d60016020 con 0x7f0d780cd950 2023-10-14T12:19:21.362 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:21.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.362+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d5806af00 msgr2=0x7f0d5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.362+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d5806af00 0x7f0d5806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d70003c10 tx=0x7f0d700098d0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.362+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 msgr2=0x7f0d781532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.362+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 0x7f0d781532e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009130 tx=0x7f0d60004750 comp rx=0 tx=0).stop 2023-10-14T12:19:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 shutdown_connections 2023-10-14T12:19:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d780cede0 0x7f0d780ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d5806af00 0x7f0d5806d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7806a840 0x7f0d781f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 --2- 172.21.15.32:0/3359212676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d780cd950 0x7f0d781532e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 >> 172.21.15.32:0/3359212676 conn(0x7f0d7806dae0 msgr2=0x7f0d780b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 shutdown_connections 2023-10-14T12:19:21.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.363+0000 7f0d7ee6a700 1 -- 172.21.15.32:0/3359212676 wait complete. 2023-10-14T12:19:21.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:19:21.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.501+0000 7f8fb2006700 1 Processor -- start 2023-10-14T12:19:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.501+0000 7f8fb2006700 1 -- start start 2023-10-14T12:19:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.501+0000 7f8fb2006700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fac15e0c0 0x7f8fac0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.501+0000 7f8fb2006700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac06cb70 con 0x7f8fac0cfc00 2023-10-14T12:19:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.501+0000 7f8fb2006700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac06ce50 con 0x7f8fac15dce0 2023-10-14T12:19:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.501+0000 7f8fb2006700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac0cbc40 con 0x7f8fac15e0c0 2023-10-14T12:19:21.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fac15e0c0 0x7f8fac0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fac15e0c0 0x7f8fac0b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39132/0 (socket says 172.21.15.32:39132) 2023-10-14T12:19:21.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 -- 172.21.15.32:0/2968563189 learned_addr learned my addr 172.21.15.32:0/2968563189 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:21.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8fabfff700 1 --1- 172.21.15.32:0/2968563189 >> v1:172.21.15.32:6789/0 conn(0x7f8fac0cfc00 0x7f8fac0cc090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56156/0 (socket says 172.21.15.32:56156) 2023-10-14T12:19:21.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 -- 172.21.15.32:0/2968563189 >> v1:172.21.15.92:6789/0 conn(0x7f8fac15dce0 legacy=0x7f8fac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:21.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 -- 172.21.15.32:0/2968563189 >> v1:172.21.15.32:6789/0 conn(0x7f8fac0cfc00 legacy=0x7f8fac0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 -- 172.21.15.32:0/2968563189 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac06d130 con 0x7f8fac15e0c0 2023-10-14T12:19:21.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faaffd700 1 --2- 172.21.15.32:0/2968563189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac15e0c0 0x7f8fac0b03c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00098f0 tx=0x7f8fa0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c77ac70d7df772 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:21.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faa7fc700 1 -- 172.21.15.32:0/2968563189 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0004230 con 0x7f8fac15e0c0 2023-10-14T12:19:21.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faa7fc700 1 -- 172.21.15.32:0/2968563189 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0004390 con 0x7f8fac15e0c0 2023-10-14T12:19:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.502+0000 7f8faa7fc700 1 -- 172.21.15.32:0/2968563189 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00036a0 con 0x7f8fac15e0c0 2023-10-14T12:19:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 -- 172.21.15.32:0/2968563189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac15e0c0 msgr2=0x7f8fac0b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 --2- 172.21.15.32:0/2968563189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac15e0c0 0x7f8fac0b03c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00098f0 tx=0x7f8fa0009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 -- 172.21.15.32:0/2968563189 shutdown_connections 2023-10-14T12:19:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 --2- 172.21.15.32:0/2968563189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac15e0c0 0x7f8fac0b03c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 -- 172.21.15.32:0/2968563189 >> 172.21.15.32:0/2968563189 conn(0x7f8fac0d15f0 msgr2=0x7f8fac0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:21.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 -- 172.21.15.32:0/2968563189 shutdown_connections 2023-10-14T12:19:21.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.503+0000 7f8fb2006700 1 -- 172.21.15.32:0/2968563189 wait complete. 2023-10-14T12:19:21.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.504+0000 7f8fb2006700 1 Processor -- start 2023-10-14T12:19:21.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.504+0000 7f8fb2006700 1 -- start start 2023-10-14T12:19:21.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fb2006700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 0x7f8fac0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fb2006700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fac15dce0 0x7f8fac15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fb2006700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fac15e0c0 0x7f8fac0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fb2006700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac15b3f0 con 0x7f8fac0cfc00 2023-10-14T12:19:21.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fb2006700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0c6d50 con 0x7f8fac15dce0 2023-10-14T12:19:21.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fb2006700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0c7030 con 0x7f8fac15e0c0 2023-10-14T12:19:21.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 0x7f8fac0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 0x7f8fac0b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39134/0 (socket says 172.21.15.32:39134) 2023-10-14T12:19:21.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 -- 172.21.15.32:0/1843054293 learned_addr learned my addr 172.21.15.32:0/1843054293 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:21.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8faaffd700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fac15dce0 0x7f8fac15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fabfff700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fac15e0c0 0x7f8fac0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 -- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fac15e0c0 msgr2=0x7f8fac0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fac15e0c0 0x7f8fac0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 -- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fac15dce0 msgr2=0x7f8fac15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fac15dce0 0x7f8fac15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8fab7fe700 1 -- 172.21.15.32:0/1843054293 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009550 con 0x7f8fac0cfc00 2023-10-14T12:19:21.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.505+0000 7f8faaffd700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fac15dce0 0x7f8fac15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:21.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.506+0000 7f8fab7fe700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 0x7f8fac0b5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c4d0 tx=0x7f8f9c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:21.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.506+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011790 con 0x7f8fac0cfc00 2023-10-14T12:19:21.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.506+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0118f0 con 0x7f8fac0cfc00 2023-10-14T12:19:21.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.506+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0c7310 con 0x7f8fac0cfc00 2023-10-14T12:19:21.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.506+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011ca0 con 0x7f8fac0cfc00 2023-10-14T12:19:21.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.506+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac0c78d0 con 0x7f8fac0cfc00 2023-10-14T12:19:21.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.507+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac067d20 con 0x7f8fac0cfc00 2023-10-14T12:19:21.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.507+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f9c01c460 con 0x7f8fac0cfc00 2023-10-14T12:19:21.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.508+0000 7f8f93fff700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f9806af00 0x7f8f9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:21.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.508+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f9c089550 con 0x7f8fac0cfc00 2023-10-14T12:19:21.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.508+0000 7f8faaffd700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f9806af00 0x7f8f9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:21.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.508+0000 7f8faaffd700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f9806af00 0x7f8f9806d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009130 tx=0x7f8fa0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:21.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.512+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f9c054560 con 0x7f8fac0cfc00 2023-10-14T12:19:21.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.729+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8fac0d1340 con 0x7f8fac0cfc00 2023-10-14T12:19:21.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.729+0000 7f8f93fff700 1 -- 172.21.15.32:0/1843054293 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f9c057b80 con 0x7f8fac0cfc00 2023-10-14T12:19:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f9806af00 msgr2=0x7f8f9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f9806af00 0x7f8f9806d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009130 tx=0x7f8fa0008030 comp rx=0 tx=0).stop 2023-10-14T12:19:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 msgr2=0x7f8fac0b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 0x7f8fac0b5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c4d0 tx=0x7f8f9c00c890 comp rx=0 tx=0).stop 2023-10-14T12:19:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 shutdown_connections 2023-10-14T12:19:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8fac15e0c0 0x7f8fac0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fac0cfc00 0x7f8fac0b5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8f9806af00 0x7f8f9806d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 --2- 172.21.15.32:0/1843054293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8fac15dce0 0x7f8fac15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 >> 172.21.15.32:0/1843054293 conn(0x7f8fac0d15f0 msgr2=0x7f8fac0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 shutdown_connections 2023-10-14T12:19:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:21.731+0000 7f8fb2006700 1 -- 172.21.15.32:0/1843054293 wait complete. 2023-10-14T12:19:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-14T12:19:21.745 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T12:19:21.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:21.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T12:19:21.791 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:19:21.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:21.792 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T12:19:21.818 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:21.818 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:21.840 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:21.840 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:21.901 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:21.901 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:21.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.086+0000 7f170b8f5700 1 Processor -- start 2023-10-14T12:19:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.086+0000 7f170b8f5700 1 -- start start 2023-10-14T12:19:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f170b8f5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f170415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f170b8f5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17040cede0 0x7f170415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f170b8f5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f170406a840 0x7f170406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f170b8f5700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17041619a0 con 0x7f17040cede0 2023-10-14T12:19:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f170b8f5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170406b1f0 con 0x7f170406a840 2023-10-14T12:19:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f170b8f5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040cf260 con 0x7f17040cd950 2023-10-14T12:19:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f1708e90700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17040cede0 0x7f170415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f1708e90700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17040cede0 0x7f170415f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39142/0 (socket says 172.21.15.32:39142) 2023-10-14T12:19:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.087+0000 7f1708e90700 1 -- 172.21.15.32:0/2122215615 learned_addr learned my addr 172.21.15.32:0/2122215615 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f1708e90700 1 -- 172.21.15.32:0/2122215615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 msgr2=0x7f170415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f1708e90700 1 --2- 172.21.15.32:0/2122215615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f170415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f1708e90700 1 -- 172.21.15.32:0/2122215615 >> v2:172.21.15.92:3300/0 conn(0x7f170406a840 msgr2=0x7f170406acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f1708e90700 1 --2- 172.21.15.32:0/2122215615 >> v2:172.21.15.92:3300/0 conn(0x7f170406a840 0x7f170406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f1708e90700 1 -- 172.21.15.32:0/2122215615 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040b2d60 con 0x7f17040cede0 2023-10-14T12:19:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f1708e90700 1 --2- 172.21.15.32:0/2122215615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f170415f570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f170406ebc0 tx=0x7f1700009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8561b90a8ff230e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f16fbfff700 1 -- 172.21.15.32:0/2122215615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700005e30 con 0x7f17040cede0 2023-10-14T12:19:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f16fbfff700 1 -- 172.21.15.32:0/2122215615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700004030 con 0x7f17040cede0 2023-10-14T12:19:22.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f16fbfff700 1 -- 172.21.15.32:0/2122215615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000043e0 con 0x7f17040cede0 2023-10-14T12:19:22.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.088+0000 7f170b8f5700 1 -- 172.21.15.32:0/2122215615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 msgr2=0x7f170415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 --2- 172.21.15.32:0/2122215615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f170415f570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f170406ebc0 tx=0x7f1700009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 -- 172.21.15.32:0/2122215615 shutdown_connections 2023-10-14T12:19:22.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 --2- 172.21.15.32:0/2122215615 >> v2:172.21.15.92:3300/0 conn(0x7f170406a840 0x7f170406acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 --2- 172.21.15.32:0/2122215615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f170415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 --2- 172.21.15.32:0/2122215615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f170415f570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 -- 172.21.15.32:0/2122215615 >> 172.21.15.32:0/2122215615 conn(0x7f170406dae0 msgr2=0x7f170406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 -- 172.21.15.32:0/2122215615 shutdown_connections 2023-10-14T12:19:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.089+0000 7f170b8f5700 1 -- 172.21.15.32:0/2122215615 wait complete. 2023-10-14T12:19:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.090+0000 7f170b8f5700 1 Processor -- start 2023-10-14T12:19:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.090+0000 7f170b8f5700 1 -- start start 2023-10-14T12:19:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170406a840 0x7f17040b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f17041f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f1704152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17041f3560 con 0x7f17040cede0 2023-10-14T12:19:22.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17041f7b40 con 0x7f170406a840 2023-10-14T12:19:22.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1704152c90 con 0x7f17040cd950 2023-10-14T12:19:22.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f1704152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f1704152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39152/0 (socket says 172.21.15.32:39152) 2023-10-14T12:19:22.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 -- 172.21.15.32:0/4259216792 learned_addr learned my addr 172.21.15.32:0/4259216792 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:22.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1708e90700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f17041f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709691700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170406a840 0x7f17040b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 -- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 msgr2=0x7f17041f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f17041f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 -- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170406a840 msgr2=0x7f17040b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170406a840 0x7f17040b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 -- 172.21.15.32:0/4259216792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700009500 con 0x7f17040cede0 2023-10-14T12:19:22.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f1709e92700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f1704152750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b970 tx=0x7f16fc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00c9b0 con 0x7f17040cede0 2023-10-14T12:19:22.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc00cb30 con 0x7f17040cede0 2023-10-14T12:19:22.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc014440 con 0x7f17040cede0 2023-10-14T12:19:22.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.091+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17040b5200 con 0x7f17040cede0 2023-10-14T12:19:22.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.092+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040b57c0 con 0x7f17040cede0 2023-10-14T12:19:22.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.092+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17040c4090 con 0x7f17040cede0 2023-10-14T12:19:22.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.093+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16fc01d3b0 con 0x7f17040cede0 2023-10-14T12:19:22.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.093+0000 7f16f9ffb700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16e806af00 0x7f16e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.093+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16fc006e40 con 0x7f17040cede0 2023-10-14T12:19:22.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.093+0000 7f1709691700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16e806af00 0x7f16e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.094+0000 7f1709691700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16e806af00 0x7f16e806d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16f4006fd0 tx=0x7f16f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.098+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17040c4090 con 0x7f17040cede0 2023-10-14T12:19:22.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.299+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17040c4090 con 0x7f17040cede0 2023-10-14T12:19:22.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.300+0000 7f16f9ffb700 1 -- 172.21.15.32:0/4259216792 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f17040c4090 con 0x7f17040cede0 2023-10-14T12:19:22.302 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:22.302 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:22.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16e806af00 msgr2=0x7f16e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16e806af00 0x7f16e806d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16f4006fd0 tx=0x7f16f4008040 comp rx=0 tx=0).stop 2023-10-14T12:19:22.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 msgr2=0x7f1704152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f1704152750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b970 tx=0x7f16fc00bd30 comp rx=0 tx=0).stop 2023-10-14T12:19:22.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 shutdown_connections 2023-10-14T12:19:22.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17040cede0 0x7f1704152750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16e806af00 0x7f16e806d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f170406a840 0x7f17040b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 --2- 172.21.15.32:0/4259216792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17040cd950 0x7f17041f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.302+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 >> 172.21.15.32:0/4259216792 conn(0x7f170406dae0 msgr2=0x7f17040cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:22.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.303+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 shutdown_connections 2023-10-14T12:19:22.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.303+0000 7f170b8f5700 1 -- 172.21.15.32:0/4259216792 wait complete. 2023-10-14T12:19:22.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:22.317 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:22.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.444+0000 7f3b6038f700 1 Processor -- start 2023-10-14T12:19:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.444+0000 7f3b6038f700 1 -- start start 2023-10-14T12:19:22.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b6038f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b5806c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b6038f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b580ce570 0x7f3b5815d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b6038f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580d0d00 con 0x7f3b580b2c60 2023-10-14T12:19:22.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b6038f700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580d2450 con 0x7f3b580ce570 2023-10-14T12:19:22.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b6038f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580cfc60 con 0x7f3b580b2880 2023-10-14T12:19:22.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b5e92c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b580ce570 0x7f3b5815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b5d92a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3b580b2c60 0x7f3b580cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56180/0 (socket says 172.21.15.32:56180) 2023-10-14T12:19:22.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b5d92a700 1 -- 172.21.15.32:0/912920939 learned_addr learned my addr 172.21.15.32:0/912920939 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:22.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.445+0000 7f3b5e12b700 1 --2- 172.21.15.32:0/912920939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b5806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5e92c700 1 -- 172.21.15.32:0/912920939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 msgr2=0x7f3b5806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:22.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5e92c700 1 --2- 172.21.15.32:0/912920939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b5806c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5e92c700 1 -- 172.21.15.32:0/912920939 >> v1:172.21.15.32:6789/0 conn(0x7f3b580b2c60 legacy=0x7f3b580cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5d129700 1 -- 172.21.15.32:0/912920939 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496419686 0 0) 0x7f3b580d0d00 con 0x7f3b580b2c60 2023-10-14T12:19:22.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5e92c700 1 -- 172.21.15.32:0/912920939 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580cff40 con 0x7f3b580ce570 2023-10-14T12:19:22.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5e92c700 1 --2- 172.21.15.32:0/912920939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5815d250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009d90 tx=0x7f3b5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb745bd75aa6ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5d129700 1 -- 172.21.15.32:0/912920939 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000e070 con 0x7f3b580ce570 2023-10-14T12:19:22.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5d129700 1 -- 172.21.15.32:0/912920939 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000bbd0 con 0x7f3b580ce570 2023-10-14T12:19:22.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b5d129700 1 -- 172.21.15.32:0/912920939 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50012430 con 0x7f3b580ce570 2023-10-14T12:19:22.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b6038f700 1 -- 172.21.15.32:0/912920939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 msgr2=0x7f3b5815d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.446+0000 7f3b6038f700 1 --2- 172.21.15.32:0/912920939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5815d250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009d90 tx=0x7f3b5000b330 comp rx=0 tx=0).stop 2023-10-14T12:19:22.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.447+0000 7f3b6038f700 1 -- 172.21.15.32:0/912920939 shutdown_connections 2023-10-14T12:19:22.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.447+0000 7f3b6038f700 1 --2- 172.21.15.32:0/912920939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5815d250 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.447+0000 7f3b6038f700 1 --2- 172.21.15.32:0/912920939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b5806c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.447+0000 7f3b6038f700 1 -- 172.21.15.32:0/912920939 >> 172.21.15.32:0/912920939 conn(0x7f3b580d15e0 msgr2=0x7f3b580d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:22.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.447+0000 7f3b6038f700 1 -- 172.21.15.32:0/912920939 shutdown_connections 2023-10-14T12:19:22.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.447+0000 7f3b6038f700 1 -- 172.21.15.32:0/912920939 wait complete. 2023-10-14T12:19:22.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.448+0000 7f3b6038f700 1 Processor -- start 2023-10-14T12:19:22.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.448+0000 7f3b6038f700 1 -- start start 2023-10-14T12:19:22.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b6038f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b580b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b6038f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580b2c60 0x7f3b581e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b6038f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5809c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b6038f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580ae8d0 con 0x7f3b580ce570 2023-10-14T12:19:22.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b6038f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580b1000 con 0x7f3b580b2c60 2023-10-14T12:19:22.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b6038f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580b12e0 con 0x7f3b580b2880 2023-10-14T12:19:22.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5809c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5809c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39166/0 (socket says 172.21.15.32:39166) 2023-10-14T12:19:22.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 -- 172.21.15.32:0/920879842 learned_addr learned my addr 172.21.15.32:0/920879842 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:22.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e12b700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b580b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5d92a700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580b2c60 0x7f3b581e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 -- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 msgr2=0x7f3b580b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b580b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 -- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580b2c60 msgr2=0x7f3b581e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580b2c60 0x7f3b581e2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 -- 172.21.15.32:0/920879842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009a70 con 0x7f3b580ce570 2023-10-14T12:19:22.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b5e92c700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5809c660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b50014040 tx=0x7f3b50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50012430 con 0x7f3b580ce570 2023-10-14T12:19:22.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.449+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50020070 con 0x7f3b580ce570 2023-10-14T12:19:22.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.450+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580ae210 con 0x7f3b580ce570 2023-10-14T12:19:22.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.450+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50004280 con 0x7f3b580ce570 2023-10-14T12:19:22.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.450+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b580b0c20 con 0x7f3b580ce570 2023-10-14T12:19:22.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.451+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b580aea10 con 0x7f3b580ce570 2023-10-14T12:19:22.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.451+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b500043e0 con 0x7f3b580ce570 2023-10-14T12:19:22.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.452+0000 7f3b4effd700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b3c06af00 0x7f3b3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.452+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b50022070 con 0x7f3b580ce570 2023-10-14T12:19:22.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.452+0000 7f3b5e12b700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b3c06af00 0x7f3b3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.452+0000 7f3b5e12b700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b3c06af00 0x7f3b3c06d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b48006fd0 tx=0x7f3b48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.456+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b580aea10 con 0x7f3b580ce570 2023-10-14T12:19:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.659+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b580aea10 con 0x7f3b580ce570 2023-10-14T12:19:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.659+0000 7f3b4effd700 1 -- 172.21.15.32:0/920879842 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b580aea10 con 0x7f3b580ce570 2023-10-14T12:19:22.661 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b3c06af00 msgr2=0x7f3b3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b3c06af00 0x7f3b3c06d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b48006fd0 tx=0x7f3b48008040 comp rx=0 tx=0).stop 2023-10-14T12:19:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 msgr2=0x7f3b5809c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5809c660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b50014040 tx=0x7f3b50004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 shutdown_connections 2023-10-14T12:19:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b580ce570 0x7f3b5809c660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b580b2880 0x7f3b580b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3b3c06af00 0x7f3b3c06d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 --2- 172.21.15.32:0/920879842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580b2c60 0x7f3b581e2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 >> 172.21.15.32:0/920879842 conn(0x7f3b580d15e0 msgr2=0x7f3b581e4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 shutdown_connections 2023-10-14T12:19:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.662+0000 7f3b6038f700 1 -- 172.21.15.32:0/920879842 wait complete. 2023-10-14T12:19:22.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:22.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 Processor -- start 2023-10-14T12:19:22.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 -- start start 2023-10-14T12:19:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4f40d3fc0 0x7fb4f415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f40b7050 0x7fb4f40d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f415e4e0 con 0x7fb4f415dbc0 2023-10-14T12:19:22.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40b7560 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.803+0000 7fb4f93df700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b7840 con 0x7fb4f40b7050 2023-10-14T12:19:22.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4f40d3fc0 0x7fb4f415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4f40d3fc0 0x7fb4f415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39172/0 (socket says 172.21.15.32:39172) 2023-10-14T12:19:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 -- 172.21.15.32:0/2259572851 learned_addr learned my addr 172.21.15.32:0/2259572851 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f37fe700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f40b7050 0x7fb4f40d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 -- 172.21.15.32:0/2259572851 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f40b7050 msgr2=0x7fb4f40d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f40b7050 0x7fb4f40d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 -- 172.21.15.32:0/2259572851 >> v1:172.21.15.92:6789/0 conn(0x7fb4f415dbc0 legacy=0x7fb4f40d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 -- 172.21.15.32:0/2259572851 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40b7b20 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f37fe700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f40b7050 0x7fb4f40d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f27fc700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415dfa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80098f0 tx=0x7fb4e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fefcf0e9246fa29 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f1ffb700 1 -- 172.21.15.32:0/2259572851 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800b8a0 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f1ffb700 1 -- 172.21.15.32:0/2259572851 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800ba00 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.804+0000 7fb4f1ffb700 1 -- 172.21.15.32:0/2259572851 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800bd90 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 -- 172.21.15.32:0/2259572851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 msgr2=0x7fb4f415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415dfa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80098f0 tx=0x7fb4e8009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:22.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 -- 172.21.15.32:0/2259572851 shutdown_connections 2023-10-14T12:19:22.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f40b7050 0x7fb4f40d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 --2- 172.21.15.32:0/2259572851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415dfa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 -- 172.21.15.32:0/2259572851 >> 172.21.15.32:0/2259572851 conn(0x7fb4f409cb40 msgr2=0x7fb4f40d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:22.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 -- 172.21.15.32:0/2259572851 shutdown_connections 2023-10-14T12:19:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.805+0000 7fb4f93df700 1 -- 172.21.15.32:0/2259572851 wait complete. 2023-10-14T12:19:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.806+0000 7fb4f93df700 1 Processor -- start 2023-10-14T12:19:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.806+0000 7fb4f93df700 1 -- start start 2023-10-14T12:19:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f93df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4f40b7050 0x7fb4f40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f93df700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f93df700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f415dbc0 0x7fb4f406c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f93df700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415bf50 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f93df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415c230 con 0x7fb4f40b7050 2023-10-14T12:19:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f93df700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415c510 con 0x7fb4f415dbc0 2023-10-14T12:19:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39178/0 (socket says 172.21.15.32:39178) 2023-10-14T12:19:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 -- 172.21.15.32:0/3798737458 learned_addr learned my addr 172.21.15.32:0/3798737458 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f2ffd700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4f40b7050 0x7fb4f40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f37fe700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f415dbc0 0x7fb4f406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 -- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f415dbc0 msgr2=0x7fb4f406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f415dbc0 0x7fb4f406c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 -- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4f40b7050 msgr2=0x7fb4f40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4f40b7050 0x7fb4f40c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.807+0000 7fb4f27fc700 1 -- 172.21.15.32:0/3798737458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8009550 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.808+0000 7fb4f27fc700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415b4d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8000c00 tx=0x7fb4e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.808+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8004380 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.808+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e801f070 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.808+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f415c7f0 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.808+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80036a0 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.808+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40cd940 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.809+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f415cd10 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.809+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb4e8021030 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.810+0000 7fb4db7fe700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb4e006af00 0x7fb4e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.810+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e808a900 con 0x7fb4f40d3fc0 2023-10-14T12:19:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.810+0000 7fb4f2ffd700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb4e006af00 0x7fb4e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.810+0000 7fb4f2ffd700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb4e006af00 0x7fb4e006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4000fb0 tx=0x7fb4e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:22.814+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4f415cd10 con 0x7fb4f40d3fc0 2023-10-14T12:19:23.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.013+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4f415cd10 con 0x7fb4f40d3fc0 2023-10-14T12:19:23.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.014+0000 7fb4db7fe700 1 -- 172.21.15.32:0/3798737458 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f415cd10 con 0x7fb4f40d3fc0 2023-10-14T12:19:23.015 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:23.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb4e006af00 msgr2=0x7fb4e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb4e006af00 0x7fb4e006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4000fb0 tx=0x7fb4e4009040 comp rx=0 tx=0).stop 2023-10-14T12:19:23.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 msgr2=0x7fb4f415b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415b4d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8000c00 tx=0x7fb4e8004750 comp rx=0 tx=0).stop 2023-10-14T12:19:23.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 shutdown_connections 2023-10-14T12:19:23.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4f415dbc0 0x7fb4f406c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb4e006af00 0x7fb4e006d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4f40b7050 0x7fb4f40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 --2- 172.21.15.32:0/3798737458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4f40d3fc0 0x7fb4f415b4d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 >> 172.21.15.32:0/3798737458 conn(0x7fb4f409cb40 msgr2=0x7fb4f40ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:23.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 shutdown_connections 2023-10-14T12:19:23.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.016+0000 7fb4f93df700 1 -- 172.21.15.32:0/3798737458 wait complete. 2023-10-14T12:19:23.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:23.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.156+0000 7f0c05aeb700 1 Processor -- start 2023-10-14T12:19:23.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.156+0000 7f0c05aeb700 1 -- start start 2023-10-14T12:19:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0c05aeb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c000cd950 0x7f0c0015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0c05aeb700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c000cf290 con 0x7f0c000cede0 2023-10-14T12:19:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0c05aeb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c000b2d60 con 0x7f0c0006a840 2023-10-14T12:19:23.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0c05aeb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c001619a0 con 0x7f0c000cd950 2023-10-14T12:19:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0bfeffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0c000cede0 0x7f0c0015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56208/0 (socket says 172.21.15.32:56208) 2023-10-14T12:19:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0bfeffd700 1 -- 172.21.15.32:0/2820370917 learned_addr learned my addr 172.21.15.32:0/2820370917 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.157+0000 7f0bff7fe700 1 --2- 172.21.15.32:0/2820370917 >> v2:172.21.15.92:3300/0 conn(0x7f0c000cd950 0x7f0c0015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bfe7fc700 1 -- 172.21.15.32:0/2820370917 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707377640 0 0) 0x7f0c000cf290 con 0x7f0c000cede0 2023-10-14T12:19:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bfe7fc700 1 -- 172.21.15.32:0/2820370917 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bec0035b0 con 0x7f0c000cede0 2023-10-14T12:19:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bff7fe700 1 -- 172.21.15.32:0/2820370917 >> v1:172.21.15.92:6789/0 conn(0x7f0c0006a840 legacy=0x7f0c00161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bff7fe700 1 -- 172.21.15.32:0/2820370917 >> v1:172.21.15.32:6789/0 conn(0x7f0c000cede0 legacy=0x7f0c0015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bfe7fc700 1 -- 172.21.15.32:0/2820370917 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 292557388 0 0) 0x7f0bec0035b0 con 0x7f0c000cede0 2023-10-14T12:19:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bff7fe700 1 -- 172.21.15.32:0/2820370917 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000cdd30 con 0x7f0c000cd950 2023-10-14T12:19:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bff7fe700 1 --2- 172.21.15.32:0/2820370917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cd950 0x7f0c0015e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009840 tx=0x7f0bf0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=215967fe640faeed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bfe7fc700 1 -- 172.21.15.32:0/2820370917 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80017f0 con 0x7f0c000cd950 2023-10-14T12:19:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bfe7fc700 1 -- 172.21.15.32:0/2820370917 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf0004030 con 0x7f0c000cd950 2023-10-14T12:19:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.158+0000 7f0bfe7fc700 1 -- 172.21.15.32:0/2820370917 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00043a0 con 0x7f0c000cd950 2023-10-14T12:19:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2820370917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cd950 msgr2=0x7f0c0015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2820370917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cd950 0x7f0c0015e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009840 tx=0x7f0bf0009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2820370917 shutdown_connections 2023-10-14T12:19:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2820370917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cd950 0x7f0c0015e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2820370917 >> 172.21.15.32:0/2820370917 conn(0x7f0c0006dae0 msgr2=0x7f0c0006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2820370917 shutdown_connections 2023-10-14T12:19:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.159+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2820370917 wait complete. 2023-10-14T12:19:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.160+0000 7f0c05aeb700 1 Processor -- start 2023-10-14T12:19:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 -- start start 2023-10-14T12:19:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c0006a840 0x7f0c00153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 0x7f0c000c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cede0 0x7f0c000c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c5bf0 con 0x7f0c000cd950 2023-10-14T12:19:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c8f60 con 0x7f0c000cede0 2023-10-14T12:19:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.161+0000 7f0c05aeb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c9240 con 0x7f0c0006a840 2023-10-14T12:19:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 0x7f0c000c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 0x7f0c000c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39190/0 (socket says 172.21.15.32:39190) 2023-10-14T12:19:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 -- 172.21.15.32:0/2491186390 learned_addr learned my addr 172.21.15.32:0/2491186390 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bff7fe700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c0006a840 0x7f0c00153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfffff700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cede0 0x7f0c000c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 -- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c0006a840 msgr2=0x7f0c00153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c0006a840 0x7f0c00153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 -- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cede0 msgr2=0x7f0c000c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cede0 0x7f0c000c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 -- 172.21.15.32:0/2491186390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00094a0 con 0x7f0c000cd950 2023-10-14T12:19:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bfeffd700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 0x7f0c000c85f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0be800c6d0 tx=0x7f0be800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80074e0 con 0x7f0c000cd950 2023-10-14T12:19:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8007640 con 0x7f0c000cd950 2023-10-14T12:19:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8005a70 con 0x7f0c000cd950 2023-10-14T12:19:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c000c5880 con 0x7f0c000cd950 2023-10-14T12:19:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.162+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c000c8b30 con 0x7f0c000cd950 2023-10-14T12:19:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.163+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c00067d20 con 0x7f0c000cd950 2023-10-14T12:19:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.164+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0be8005bd0 con 0x7f0c000cd950 2023-10-14T12:19:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.164+0000 7f0bf7fff700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0be006af00 0x7f0be006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.164+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0be80889c0 con 0x7f0c000cd950 2023-10-14T12:19:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.164+0000 7f0bff7fe700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0be006af00 0x7f0be006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.165+0000 7f0bff7fe700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0be006af00 0x7f0be006d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00090b0 tx=0x7f0bf0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.169+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0be8053b00 con 0x7f0c000cd950 2023-10-14T12:19:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.369+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c000b2630 con 0x7f0c000cd950 2023-10-14T12:19:23.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.369+0000 7f0bf7fff700 1 -- 172.21.15.32:0/2491186390 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0be8017020 con 0x7f0c000cd950 2023-10-14T12:19:23.372 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:23.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0be006af00 msgr2=0x7f0be006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0be006af00 0x7f0be006d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00090b0 tx=0x7f0bf0008030 comp rx=0 tx=0).stop 2023-10-14T12:19:23.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 msgr2=0x7f0c000c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 0x7f0c000c85f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0be800c6d0 tx=0x7f0be800c9e0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 shutdown_connections 2023-10-14T12:19:23.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0be006af00 0x7f0be006d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c000cede0 0x7f0c000c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c0006a840 0x7f0c00153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 --2- 172.21.15.32:0/2491186390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000cd950 0x7f0c000c85f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 >> 172.21.15.32:0/2491186390 conn(0x7f0c0006dae0 msgr2=0x7f0c000ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 shutdown_connections 2023-10-14T12:19:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.371+0000 7f0c05aeb700 1 -- 172.21.15.32:0/2491186390 wait complete. 2023-10-14T12:19:23.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:19:23.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.509+0000 7fd2d1088700 1 Processor -- start 2023-10-14T12:19:23.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.510+0000 7fd2d1088700 1 -- start start 2023-10-14T12:19:23.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.510+0000 7fd2d1088700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc15b8b0 0x7fd2cc0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.510+0000 7fd2d1088700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 0x7fd2cc0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.510+0000 7fd2d1088700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc072a10 con 0x7fd2cc0ce3b0 2023-10-14T12:19:23.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.510+0000 7fd2d1088700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0ced70 con 0x7fd2cc0b4640 2023-10-14T12:19:23.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.510+0000 7fd2d1088700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0b2230 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cb59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 0x7fd2cc0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cad9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc15b8b0 0x7fd2cc0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2ca59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd2cc0ce3b0 0x7fd2cc0ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:55096/0 (socket says 172.21.15.32:55096) 2023-10-14T12:19:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cb59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 0x7fd2cc0ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43468/0 (socket says 172.21.15.32:43468) 2023-10-14T12:19:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2ca59c700 1 -- 172.21.15.32:0/915012936 learned_addr learned my addr 172.21.15.32:0/915012936 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cad9d700 1 -- 172.21.15.32:0/915012936 >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 msgr2=0x7fd2cc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cad9d700 1 --2- 172.21.15.32:0/915012936 >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 0x7fd2cc0ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cad9d700 1 -- 172.21.15.32:0/915012936 >> v1:172.21.15.92:6789/0 conn(0x7fd2cc0ce3b0 legacy=0x7fd2cc0ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cad9d700 1 -- 172.21.15.32:0/915012936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0b2e90 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cb59e700 1 --2- 172.21.15.32:0/915012936 >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 0x7fd2cc0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2cad9d700 1 --2- 172.21.15.32:0/915012936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc15b8b0 0x7fd2cc0b2950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009840 tx=0x7fd2bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c43f67072c12caa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.511+0000 7fd2c9d9b700 1 -- 172.21.15.32:0/915012936 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc011830 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2c9d9b700 1 -- 172.21.15.32:0/915012936 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc011990 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2c9d9b700 1 -- 172.21.15.32:0/915012936 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc011d20 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 -- 172.21.15.32:0/915012936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc15b8b0 msgr2=0x7fd2cc0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 --2- 172.21.15.32:0/915012936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc15b8b0 0x7fd2cc0b2950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009840 tx=0x7fd2bc009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 -- 172.21.15.32:0/915012936 shutdown_connections 2023-10-14T12:19:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 --2- 172.21.15.32:0/915012936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc15b8b0 0x7fd2cc0b2950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 --2- 172.21.15.32:0/915012936 >> v2:172.21.15.92:3300/0 conn(0x7fd2cc0b4640 0x7fd2cc0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 -- 172.21.15.32:0/915012936 >> 172.21.15.32:0/915012936 conn(0x7fd2cc06dac0 msgr2=0x7fd2cc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:23.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 -- 172.21.15.32:0/915012936 shutdown_connections 2023-10-14T12:19:23.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.512+0000 7fd2d1088700 1 -- 172.21.15.32:0/915012936 wait complete. 2023-10-14T12:19:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.514+0000 7fd2d1088700 1 Processor -- start 2023-10-14T12:19:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.514+0000 7fd2d1088700 1 -- start start 2023-10-14T12:19:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2d1088700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc0b4640 0x7fd2cc0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2d1088700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2cc0ce3b0 0x7fd2cc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2d1088700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 0x7fd2cc15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2d1088700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc15e410 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2d1088700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc158b30 con 0x7fd2cc0ce3b0 2023-10-14T12:19:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2d1088700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0c8050 con 0x7fd2cc0b4640 2023-10-14T12:19:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cb59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 0x7fd2cc15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cb59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 0x7fd2cc15dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39206/0 (socket says 172.21.15.32:39206) 2023-10-14T12:19:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cb59e700 1 -- 172.21.15.32:0/111856744 learned_addr learned my addr 172.21.15.32:0/111856744 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cad9d700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc0b4640 0x7fd2cc0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2ca59c700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2cc0ce3b0 0x7fd2cc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cb59e700 1 -- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc0b4640 msgr2=0x7fd2cc0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cb59e700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc0b4640 0x7fd2cc0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.515+0000 7fd2cb59e700 1 -- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2cc0ce3b0 msgr2=0x7fd2cc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2cb59e700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2cc0ce3b0 0x7fd2cc1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2cb59e700 1 -- 172.21.15.32:0/111856744 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4009a70 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2ca59c700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2cc0ce3b0 0x7fd2cc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2cb59e700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 0x7fd2cc15dae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400efc0 tx=0x7fd2c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400cb40 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400f040 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc0094a0 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4003a20 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.516+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc0c7a00 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.517+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc0c81c0 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.517+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd2c4014480 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.518+0000 7fd2c37fe700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd2ac06af00 0x7fd2ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.518+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2c4089f30 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.518+0000 7fd2cad9d700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd2ac06af00 0x7fd2ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.519+0000 7fd2cad9d700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd2ac06af00 0x7fd2ac06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc000c00 tx=0x7fd2bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.522+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2c4054fe0 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.738+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2cc067d20 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.738+0000 7fd2c37fe700 1 -- 172.21.15.32:0/111856744 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2c4009cd0 con 0x7fd2cc15b8b0 2023-10-14T12:19:23.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd2ac06af00 msgr2=0x7fd2ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd2ac06af00 0x7fd2ac06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc000c00 tx=0x7fd2bc008030 comp rx=0 tx=0).stop 2023-10-14T12:19:23.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 msgr2=0x7fd2cc15dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:23.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 0x7fd2cc15dae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400efc0 tx=0x7fd2c400c3a0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 shutdown_connections 2023-10-14T12:19:23.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2cc15b8b0 0x7fd2cc15dae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2cc0b4640 0x7fd2cc0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd2ac06af00 0x7fd2ac06d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 --2- 172.21.15.32:0/111856744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2cc0ce3b0 0x7fd2cc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:23.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 >> 172.21.15.32:0/111856744 conn(0x7fd2cc06dac0 msgr2=0x7fd2cc15a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:23.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 shutdown_connections 2023-10-14T12:19:23.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:23.741+0000 7fd2d1088700 1 -- 172.21.15.32:0/111856744 wait complete. 2023-10-14T12:19:23.745 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-14T12:19:23.754 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T12:19:23.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:23.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T12:19:23.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:19:23.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:23.802 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T12:19:23.831 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:23.831 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:23.850 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:23.851 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:23.908 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:23.909 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:23.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:24.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.131+0000 7f83a01de700 1 Processor -- start 2023-10-14T12:19:24.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.131+0000 7f83a01de700 1 -- start start 2023-10-14T12:19:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f83a01de700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f839815a580 0x7f83980727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f83a01de700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f839806c9b0 0x7f839806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f83a01de700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8398071aa0 con 0x7f839815e1c0 2023-10-14T12:19:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f83a01de700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806d370 con 0x7f839806c9b0 2023-10-14T12:19:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f83a01de700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839815f140 con 0x7f839815a580 2023-10-14T12:19:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839e77b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f839815e1c0 0x7f839815e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56238/0 (socket says 172.21.15.32:56238) 2023-10-14T12:19:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839d779700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f839806c9b0 0x7f839806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839e77b700 1 -- 172.21.15.32:0/423770578 learned_addr learned my addr 172.21.15.32:0/423770578 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839df7a700 1 --2- 172.21.15.32:0/423770578 >> v2:172.21.15.92:3300/0 conn(0x7f839815a580 0x7f83980727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839d779700 1 -- 172.21.15.32:0/423770578 >> v2:172.21.15.92:3300/0 conn(0x7f839815a580 msgr2=0x7f83980727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839d779700 1 --2- 172.21.15.32:0/423770578 >> v2:172.21.15.92:3300/0 conn(0x7f839815a580 0x7f83980727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839d779700 1 -- 172.21.15.32:0/423770578 >> v1:172.21.15.32:6789/0 conn(0x7f839815e1c0 legacy=0x7f839815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839cf78700 1 -- 172.21.15.32:0/423770578 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96112540 0 0) 0x7f8398071aa0 con 0x7f839815e1c0 2023-10-14T12:19:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839d779700 1 -- 172.21.15.32:0/423770578 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839815ee60 con 0x7f839806c9b0 2023-10-14T12:19:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.132+0000 7f839d779700 1 --2- 172.21.15.32:0/423770578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839806c9b0 0x7f839806ce30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f839806ec10 tx=0x7f8388009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dd824a89b63161 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f839cf78700 1 -- 172.21.15.32:0/423770578 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011830 con 0x7f839806c9b0 2023-10-14T12:19:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f839cf78700 1 -- 172.21.15.32:0/423770578 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388011990 con 0x7f839806c9b0 2023-10-14T12:19:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f839cf78700 1 -- 172.21.15.32:0/423770578 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011d20 con 0x7f839806c9b0 2023-10-14T12:19:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 -- 172.21.15.32:0/423770578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839806c9b0 msgr2=0x7f839806ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 --2- 172.21.15.32:0/423770578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839806c9b0 0x7f839806ce30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f839806ec10 tx=0x7f8388009b20 comp rx=0 tx=0).stop 2023-10-14T12:19:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 -- 172.21.15.32:0/423770578 shutdown_connections 2023-10-14T12:19:24.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 --2- 172.21.15.32:0/423770578 >> v2:172.21.15.92:3300/0 conn(0x7f839815a580 0x7f83980727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 --2- 172.21.15.32:0/423770578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839806c9b0 0x7f839806ce30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 -- 172.21.15.32:0/423770578 >> 172.21.15.32:0/423770578 conn(0x7f839806afb0 msgr2=0x7f83980cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:24.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 -- 172.21.15.32:0/423770578 shutdown_connections 2023-10-14T12:19:24.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.133+0000 7f83a01de700 1 -- 172.21.15.32:0/423770578 wait complete. 2023-10-14T12:19:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.134+0000 7f83a01de700 1 Processor -- start 2023-10-14T12:19:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 -- start start 2023-10-14T12:19:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f839806c9b0 0x7f839815cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 0x7f83981545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839815e1c0 0x7f83980c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398151b40 con 0x7f839815a580 2023-10-14T12:19:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398151440 con 0x7f839815e1c0 2023-10-14T12:19:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f83a01de700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398151940 con 0x7f839806c9b0 2023-10-14T12:19:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f839d779700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 0x7f83981545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f839d779700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 0x7f83981545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39218/0 (socket says 172.21.15.32:39218) 2023-10-14T12:19:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.135+0000 7f839d779700 1 -- 172.21.15.32:0/3468733312 learned_addr learned my addr 172.21.15.32:0/3468733312 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839df7a700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f839806c9b0 0x7f839815cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839e77b700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839815e1c0 0x7f83980c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839d779700 1 -- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f839806c9b0 msgr2=0x7f839815cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839d779700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f839806c9b0 0x7f839815cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839d779700 1 -- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839815e1c0 msgr2=0x7f83980c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839d779700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839815e1c0 0x7f83980c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839d779700 1 -- 172.21.15.32:0/3468733312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880094a0 con 0x7f839815a580 2023-10-14T12:19:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f839d779700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 0x7f83981545b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83880090b0 tx=0x7f8388004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880038a0 con 0x7f839815a580 2023-10-14T12:19:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838801f070 con 0x7f839815a580 2023-10-14T12:19:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398154dc0 con 0x7f839815a580 2023-10-14T12:19:24.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388003c20 con 0x7f839815a580 2023-10-14T12:19:24.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.136+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8398155380 con 0x7f839815a580 2023-10-14T12:19:24.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.137+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398151c80 con 0x7f839815a580 2023-10-14T12:19:24.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.138+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f838801a430 con 0x7f839815a580 2023-10-14T12:19:24.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.138+0000 7f838e7fc700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f837c06af00 0x7f837c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.138+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8388021070 con 0x7f839815a580 2023-10-14T12:19:24.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.138+0000 7f839df7a700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f837c06af00 0x7f837c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.139+0000 7f839df7a700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f837c06af00 0x7f837c06d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8394009930 tx=0x7f8394008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.143+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8398151c80 con 0x7f839815a580 2023-10-14T12:19:24.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.344+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8398151c80 con 0x7f839815a580 2023-10-14T12:19:24.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.346+0000 7f838e7fc700 1 -- 172.21.15.32:0/3468733312 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f8398151c80 con 0x7f839815a580 2023-10-14T12:19:24.347 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:24.347 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:24.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f837c06af00 msgr2=0x7f837c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f837c06af00 0x7f837c06d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8394009930 tx=0x7f8394008040 comp rx=0 tx=0).stop 2023-10-14T12:19:24.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 msgr2=0x7f83981545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 0x7f83981545b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83880090b0 tx=0x7f8388004750 comp rx=0 tx=0).stop 2023-10-14T12:19:24.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 shutdown_connections 2023-10-14T12:19:24.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f837c06af00 0x7f837c06d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839815e1c0 0x7f83980c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f839806c9b0 0x7f839815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 --2- 172.21.15.32:0/3468733312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839815a580 0x7f83981545b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 >> 172.21.15.32:0/3468733312 conn(0x7f839806afb0 msgr2=0x7f83980ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:24.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 shutdown_connections 2023-10-14T12:19:24.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.348+0000 7f83a01de700 1 -- 172.21.15.32:0/3468733312 wait complete. 2023-10-14T12:19:24.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:24.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:24.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 Processor -- start 2023-10-14T12:19:24.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 -- start start 2023-10-14T12:19:24.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcab80cd950 0x7fcab815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcab806a840 0x7fcab806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab81619a0 con 0x7fcab806a840 2023-10-14T12:19:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab806b1f0 con 0x7fcab80cd950 2023-10-14T12:19:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.490+0000 7fcabebde700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80cf260 con 0x7fcab80cede0 2023-10-14T12:19:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcab806a840 0x7fcab806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcab806a840 0x7fcab806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39228/0 (socket says 172.21.15.32:39228) 2023-10-14T12:19:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 -- 172.21.15.32:0/994954449 learned_addr learned my addr 172.21.15.32:0/994954449 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabc97a700 1 --2- 172.21.15.32:0/994954449 >> v2:172.21.15.92:3300/0 conn(0x7fcab80cd950 0x7fcab815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcab7fff700 1 --2- 172.21.15.32:0/994954449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 -- 172.21.15.32:0/994954449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 msgr2=0x7fcab815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 --2- 172.21.15.32:0/994954449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 -- 172.21.15.32:0/994954449 >> v2:172.21.15.92:3300/0 conn(0x7fcab80cd950 msgr2=0x7fcab815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 --2- 172.21.15.32:0/994954449 >> v2:172.21.15.92:3300/0 conn(0x7fcab80cd950 0x7fcab815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 -- 172.21.15.32:0/994954449 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80b2d60 con 0x7fcab806a840 2023-10-14T12:19:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabc97a700 1 --2- 172.21.15.32:0/994954449 >> v2:172.21.15.92:3300/0 conn(0x7fcab80cd950 0x7fcab815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcabd17b700 1 --2- 172.21.15.32:0/994954449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab806acb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcab80d0430 tx=0x7fcab000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328446cc4a77d3bb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcab77fe700 1 -- 172.21.15.32:0/994954449 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab000e070 con 0x7fcab806a840 2023-10-14T12:19:24.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcab77fe700 1 -- 172.21.15.32:0/994954449 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab000b9c0 con 0x7fcab806a840 2023-10-14T12:19:24.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.491+0000 7fcab77fe700 1 -- 172.21.15.32:0/994954449 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab000bd70 con 0x7fcab806a840 2023-10-14T12:19:24.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 -- 172.21.15.32:0/994954449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 msgr2=0x7fcab806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 --2- 172.21.15.32:0/994954449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab806acb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcab80d0430 tx=0x7fcab000b330 comp rx=0 tx=0).stop 2023-10-14T12:19:24.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 -- 172.21.15.32:0/994954449 shutdown_connections 2023-10-14T12:19:24.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 --2- 172.21.15.32:0/994954449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab806acb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 --2- 172.21.15.32:0/994954449 >> v2:172.21.15.92:3300/0 conn(0x7fcab80cd950 0x7fcab815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 --2- 172.21.15.32:0/994954449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 -- 172.21.15.32:0/994954449 >> 172.21.15.32:0/994954449 conn(0x7fcab806dae0 msgr2=0x7fcab806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:24.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 -- 172.21.15.32:0/994954449 shutdown_connections 2023-10-14T12:19:24.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.492+0000 7fcabebde700 1 -- 172.21.15.32:0/994954449 wait complete. 2023-10-14T12:19:24.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.493+0000 7fcabebde700 1 Processor -- start 2023-10-14T12:19:24.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.493+0000 7fcabebde700 1 -- start start 2023-10-14T12:19:24.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabebde700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabebde700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcab80cd950 0x7fcab80b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabebde700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabebde700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80b5020 con 0x7fcab806a840 2023-10-14T12:19:24.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabebde700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80c5320 con 0x7fcab80cd950 2023-10-14T12:19:24.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabebde700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80c5600 con 0x7fcab80cede0 2023-10-14T12:19:24.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab80b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39230/0 (socket says 172.21.15.32:39230) 2023-10-14T12:19:24.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 -- 172.21.15.32:0/966310818 learned_addr learned my addr 172.21.15.32:0/966310818 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:24.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabd17b700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcab7fff700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcab80cd950 0x7fcab80b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 -- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 msgr2=0x7fcab80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 -- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcab80cd950 msgr2=0x7fcab80b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcab80cd950 0x7fcab80b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 -- 172.21.15.32:0/966310818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0009b30 con 0x7fcab806a840 2023-10-14T12:19:24.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcab7fff700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcab80cd950 0x7fcab80b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:24.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabd17b700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:24.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.494+0000 7fcabc97a700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab80b4ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00d800 tx=0x7fcaac00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.495+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac004030 con 0x7fcab806a840 2023-10-14T12:19:24.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.495+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac004190 con 0x7fcab806a840 2023-10-14T12:19:24.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.495+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab80c58e0 con 0x7fcab806a840 2023-10-14T12:19:24.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.495+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac004520 con 0x7fcab806a840 2023-10-14T12:19:24.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.495+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab80c5ea0 con 0x7fcab806a840 2023-10-14T12:19:24.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.496+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab8067d20 con 0x7fcab806a840 2023-10-14T12:19:24.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.496+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcaac0036a0 con 0x7fcab806a840 2023-10-14T12:19:24.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.497+0000 7fcab57fa700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca9c06af00 0x7fca9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.497+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaac089ae0 con 0x7fcab806a840 2023-10-14T12:19:24.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.497+0000 7fcab7fff700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca9c06af00 0x7fca9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.497+0000 7fcab7fff700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca9c06af00 0x7fca9c06d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcab806b1c0 tx=0x7fcaa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.501+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaac054c20 con 0x7fcab806a840 2023-10-14T12:19:24.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.699+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcab80b2100 con 0x7fcab806a840 2023-10-14T12:19:24.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.700+0000 7fcab57fa700 1 -- 172.21.15.32:0/966310818 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcaac058240 con 0x7fcab806a840 2023-10-14T12:19:24.702 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:24.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca9c06af00 msgr2=0x7fca9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca9c06af00 0x7fca9c06d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcab806b1c0 tx=0x7fcaa4008040 comp rx=0 tx=0).stop 2023-10-14T12:19:24.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 msgr2=0x7fcab80b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab80b4ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00d800 tx=0x7fcaac00dbc0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 shutdown_connections 2023-10-14T12:19:24.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcab80cede0 0x7fcab80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcab806a840 0x7fcab80b4ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fca9c06af00 0x7fca9c06d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 --2- 172.21.15.32:0/966310818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcab80cd950 0x7fcab80b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 >> 172.21.15.32:0/966310818 conn(0x7fcab806dae0 msgr2=0x7fcab80b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:24.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 shutdown_connections 2023-10-14T12:19:24.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.702+0000 7fcabebde700 1 -- 172.21.15.32:0/966310818 wait complete. 2023-10-14T12:19:24.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:24.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.842+0000 7f7f26413700 1 Processor -- start 2023-10-14T12:19:24.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.842+0000 7f7f26413700 1 -- start start 2023-10-14T12:19:24.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f26413700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f200d0c70 0x7f7f200cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f26413700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200d23e0 con 0x7f7f200c5110 2023-10-14T12:19:24.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f26413700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200cf190 con 0x7f7f2015b740 2023-10-14T12:19:24.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f26413700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2015bb20 con 0x7f7f200d0c70 2023-10-14T12:19:24.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f200d0c70 0x7f7f200cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f249b0700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7f200c5110 0x7f7f200cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56266/0 (socket says 172.21.15.32:56266) 2023-10-14T12:19:24.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f249b0700 1 -- 172.21.15.32:0/1993425318 learned_addr learned my addr 172.21.15.32:0/1993425318 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:24.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/1993425318 >> v1:172.21.15.92:6789/0 conn(0x7f7f2015b740 legacy=0x7f7f200d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:24.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/1993425318 >> v1:172.21.15.32:6789/0 conn(0x7f7f200c5110 legacy=0x7f7f200cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/1993425318 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200cbd40 con 0x7f7f200d0c70 2023-10-14T12:19:24.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1effd700 1 -- 172.21.15.32:0/1993425318 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886569921 0 0) 0x7f7f18001490 con 0x7f7f200c5110 2023-10-14T12:19:24.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1f7fe700 1 --2- 172.21.15.32:0/1993425318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f200cdfd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009840 tx=0x7f7f10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f32411a1bf050b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.843+0000 7f7f1effd700 1 -- 172.21.15.32:0/1993425318 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10004230 con 0x7f7f200d0c70 2023-10-14T12:19:24.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f1effd700 1 -- 172.21.15.32:0/1993425318 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10004390 con 0x7f7f200d0c70 2023-10-14T12:19:24.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f1effd700 1 -- 172.21.15.32:0/1993425318 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100036a0 con 0x7f7f200d0c70 2023-10-14T12:19:24.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 -- 172.21.15.32:0/1993425318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 msgr2=0x7f7f200cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 --2- 172.21.15.32:0/1993425318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f200cdfd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009840 tx=0x7f7f10009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:24.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 -- 172.21.15.32:0/1993425318 shutdown_connections 2023-10-14T12:19:24.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 --2- 172.21.15.32:0/1993425318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f200cdfd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 -- 172.21.15.32:0/1993425318 >> 172.21.15.32:0/1993425318 conn(0x7f7f200665a0 msgr2=0x7f7f20066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:24.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 -- 172.21.15.32:0/1993425318 shutdown_connections 2023-10-14T12:19:24.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.844+0000 7f7f26413700 1 -- 172.21.15.32:0/1993425318 wait complete. 2023-10-14T12:19:24.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.845+0000 7f7f26413700 1 Processor -- start 2023-10-14T12:19:24.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.845+0000 7f7f26413700 1 -- start start 2023-10-14T12:19:24.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f26413700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f200c5110 0x7f7f2015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f26413700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f2015f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f26413700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f2015b740 0x7f7f20158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f26413700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b3f80 con 0x7f7f200d0c70 2023-10-14T12:19:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f26413700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b4260 con 0x7f7f2015b740 2023-10-14T12:19:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f26413700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b4540 con 0x7f7f200c5110 2023-10-14T12:19:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f1f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f2015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f1f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f2015f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39246/0 (socket says 172.21.15.32:39246) 2023-10-14T12:19:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.846+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/2936615228 learned_addr learned my addr 172.21.15.32:0/2936615228 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f200c5110 msgr2=0x7f7f2015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f249b0700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f2015b740 0x7f7f20158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1ffff700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f200c5110 0x7f7f2015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1f7fe700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f200c5110 0x7f7f2015d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f2015b740 msgr2=0x7f7f20158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1f7fe700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f2015b740 0x7f7f20158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1f7fe700 1 -- 172.21.15.32:0/2936615228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100094a0 con 0x7f7f200d0c70 2023-10-14T12:19:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f249b0700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f2015b740 0x7f7f20158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1ffff700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f200c5110 0x7f7f2015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1f7fe700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f2015f030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f100090b0 tx=0x7f7f10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011830 con 0x7f7f200d0c70 2023-10-14T12:19:24.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1001e070 con 0x7f7f200d0c70 2023-10-14T12:19:24.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f200b4820 con 0x7f7f200d0c70 2023-10-14T12:19:24.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011bb0 con 0x7f7f200d0c70 2023-10-14T12:19:24.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.847+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f200b4de0 con 0x7f7f200d0c70 2023-10-14T12:19:24.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.848+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f200b4fd0 con 0x7f7f200d0c70 2023-10-14T12:19:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.848+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7f10011d10 con 0x7f7f200d0c70 2023-10-14T12:19:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.849+0000 7f7f1cff9700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f0006af00 0x7f7f0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.849+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f1008a8b0 con 0x7f7f200d0c70 2023-10-14T12:19:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.849+0000 7f7f1ffff700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f0006af00 0x7f7f0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.849+0000 7f7f1ffff700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f0006af00 0x7f7f0006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f08006fd0 tx=0x7f7f08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:24.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:24.853+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f100559f0 con 0x7f7f200d0c70 2023-10-14T12:19:24.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:19:24.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:19:25.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.052+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f20067d20 con 0x7f7f200d0c70 2023-10-14T12:19:25.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.053+0000 7f7f1cff9700 1 -- 172.21.15.32:0/2936615228 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f100200a0 con 0x7f7f200d0c70 2023-10-14T12:19:25.054 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:25.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f0006af00 msgr2=0x7f7f0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f0006af00 0x7f7f0006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f08006fd0 tx=0x7f7f08008040 comp rx=0 tx=0).stop 2023-10-14T12:19:25.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 msgr2=0x7f7f2015f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f2015f030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f100090b0 tx=0x7f7f10004750 comp rx=0 tx=0).stop 2023-10-14T12:19:25.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 shutdown_connections 2023-10-14T12:19:25.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7f0006af00 0x7f7f0006d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f2015b740 0x7f7f20158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f200c5110 0x7f7f2015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 --2- 172.21.15.32:0/2936615228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f200d0c70 0x7f7f2015f030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 >> 172.21.15.32:0/2936615228 conn(0x7f7f200665a0 msgr2=0x7f7f200ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:25.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 shutdown_connections 2023-10-14T12:19:25.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.055+0000 7f7f26413700 1 -- 172.21.15.32:0/2936615228 wait complete. 2023-10-14T12:19:25.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:25.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.195+0000 7f14142f6700 1 Processor -- start 2023-10-14T12:19:25.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.195+0000 7f14142f6700 1 -- start start 2023-10-14T12:19:25.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f14142f6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c0b28b0 0x7f140c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f14142f6700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0b3530 con 0x7f140c15f130 2023-10-14T12:19:25.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f14142f6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0cd180 con 0x7f140c06af50 2023-10-14T12:19:25.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f14142f6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0cde00 con 0x7f140c0b28b0 2023-10-14T12:19:25.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f1412092700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f140c15f130 0x7f140c06a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56276/0 (socket says 172.21.15.32:56276) 2023-10-14T12:19:25.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f1412092700 1 -- 172.21.15.32:0/3325314386 learned_addr learned my addr 172.21.15.32:0/3325314386 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:25.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.196+0000 7f1412893700 1 --2- 172.21.15.32:0/3325314386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c0b28b0 0x7f140c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325394712 0 0) 0x7f140c0b3530 con 0x7f140c15f130 2023-10-14T12:19:25.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f80035b0 con 0x7f140c15f130 2023-10-14T12:19:25.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962545210 0 0) 0x7f140c0cd180 con 0x7f140c06af50 2023-10-14T12:19:25.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c0b3530 con 0x7f140c06af50 2023-10-14T12:19:25.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1412893700 1 -- 172.21.15.32:0/3325314386 >> v1:172.21.15.92:6789/0 conn(0x7f140c06af50 legacy=0x7f140c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1412893700 1 -- 172.21.15.32:0/3325314386 >> v1:172.21.15.32:6789/0 conn(0x7f140c15f130 legacy=0x7f140c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1412893700 1 -- 172.21.15.32:0/3325314386 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0cd460 con 0x7f140c0b28b0 2023-10-14T12:19:25.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1412893700 1 --2- 172.21.15.32:0/3325314386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c0b28b0 0x7f140c0cede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1404009dc0 tx=0x7f140400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c16029261ae144f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:25.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400e070 con 0x7f140c0b28b0 2023-10-14T12:19:25.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400bb20 con 0x7f140c0b28b0 2023-10-14T12:19:25.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.197+0000 7f1411090700 1 -- 172.21.15.32:0/3325314386 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400be90 con 0x7f140c0b28b0 2023-10-14T12:19:25.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 -- 172.21.15.32:0/3325314386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c0b28b0 msgr2=0x7f140c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 --2- 172.21.15.32:0/3325314386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c0b28b0 0x7f140c0cede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1404009dc0 tx=0x7f140400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:25.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 -- 172.21.15.32:0/3325314386 shutdown_connections 2023-10-14T12:19:25.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 --2- 172.21.15.32:0/3325314386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c0b28b0 0x7f140c0cede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 -- 172.21.15.32:0/3325314386 >> 172.21.15.32:0/3325314386 conn(0x7f140c06dae0 msgr2=0x7f140c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:25.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 -- 172.21.15.32:0/3325314386 shutdown_connections 2023-10-14T12:19:25.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.198+0000 7f14142f6700 1 -- 172.21.15.32:0/3325314386 wait complete. 2023-10-14T12:19:25.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.199+0000 7f14142f6700 1 Processor -- start 2023-10-14T12:19:25.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 -- start start 2023-10-14T12:19:25.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c06af50 0x7f140c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0b28b0 0x7f140c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 0x7f140c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15d360 con 0x7f140c15f130 2023-10-14T12:19:25.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15c140 con 0x7f140c0b28b0 2023-10-14T12:19:25.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.200+0000 7f14142f6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15cce0 con 0x7f140c06af50 2023-10-14T12:19:25.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 0x7f140c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 0x7f140c15b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39262/0 (socket says 172.21.15.32:39262) 2023-10-14T12:19:25.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 -- 172.21.15.32:0/3793515103 learned_addr learned my addr 172.21.15.32:0/3793515103 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:25.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412092700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c06af50 0x7f140c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1411891700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0b28b0 0x7f140c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 -- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c06af50 msgr2=0x7f140c0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c06af50 0x7f140c0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 -- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0b28b0 msgr2=0x7f140c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0b28b0 0x7f140c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 -- 172.21.15.32:0/3793515103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009a70 con 0x7f140c15f130 2023-10-14T12:19:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412092700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c06af50 0x7f140c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1412893700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 0x7f140c15b510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1404014040 tx=0x7f1404004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040098f0 con 0x7f140c15f130 2023-10-14T12:19:25.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404020070 con 0x7f140c15f130 2023-10-14T12:19:25.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0c4350 con 0x7f140c15f130 2023-10-14T12:19:25.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404027680 con 0x7f140c15f130 2023-10-14T12:19:25.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.201+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c15cf80 con 0x7f140c15f130 2023-10-14T12:19:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.202+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c15d4a0 con 0x7f140c15f130 2023-10-14T12:19:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.203+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1404012430 con 0x7f140c15f130 2023-10-14T12:19:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.203+0000 7f1402ffd700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13f006af00 0x7f13f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.203+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1404022070 con 0x7f140c15f130 2023-10-14T12:19:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.203+0000 7f1412092700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13f006af00 0x7f13f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.204+0000 7f1412092700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13f006af00 0x7f13f006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13fc000f60 tx=0x7f13fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.208+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f140c15d4a0 con 0x7f140c15f130 2023-10-14T12:19:25.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.407+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f140c15d4a0 con 0x7f140c15f130 2023-10-14T12:19:25.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.407+0000 7f1402ffd700 1 -- 172.21.15.32:0/3793515103 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f140c15d4a0 con 0x7f140c15f130 2023-10-14T12:19:25.410 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13f006af00 msgr2=0x7f13f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13f006af00 0x7f13f006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13fc000f60 tx=0x7f13fc009040 comp rx=0 tx=0).stop 2023-10-14T12:19:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 msgr2=0x7f140c15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 0x7f140c15b510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1404014040 tx=0x7f1404004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 shutdown_connections 2023-10-14T12:19:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f140c15f130 0x7f140c15b510 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f140c06af50 0x7f140c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f13f006af00 0x7f13f006d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 --2- 172.21.15.32:0/3793515103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0b28b0 0x7f140c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 >> 172.21.15.32:0/3793515103 conn(0x7f140c06dae0 msgr2=0x7f140c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 shutdown_connections 2023-10-14T12:19:25.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.409+0000 7f14142f6700 1 -- 172.21.15.32:0/3793515103 wait complete. 2023-10-14T12:19:25.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:19:25.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.550+0000 7f0dbca9e700 1 Processor -- start 2023-10-14T12:19:25.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.550+0000 7f0dbca9e700 1 -- start start 2023-10-14T12:19:25.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0dbca9e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 0x7f0db80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0dbca9e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0db80cd4b0 0x7f0db80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0dbca9e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80ce3b0 con 0x7f0db80b2940 2023-10-14T12:19:25.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0dbca9e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80b2dc0 con 0x7f0db80cd4b0 2023-10-14T12:19:25.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0dbca9e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80b6290 con 0x7f0db815a850 2023-10-14T12:19:25.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0db5d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0db80b2940 0x7f0db80ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56290/0 (socket says 172.21.15.32:56290) 2023-10-14T12:19:25.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0db5d9b700 1 -- 172.21.15.32:0/1008695423 learned_addr learned my addr 172.21.15.32:0/1008695423 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:25.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0db659c700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 0x7f0db80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412579846 0 0) 0x7f0db80ce3b0 con 0x7f0db80b2940 2023-10-14T12:19:25.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0db6d9d700 1 --2- 172.21.15.32:0/1008695423 >> v2:172.21.15.92:3300/0 conn(0x7f0db80cd4b0 0x7f0db80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.551+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da00035b0 con 0x7f0db80b2940 2023-10-14T12:19:25.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279993199 0 0) 0x7f0da00035b0 con 0x7f0db80b2940 2023-10-14T12:19:25.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 msgr2=0x7f0db80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:25.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 0x7f0db80cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 >> v2:172.21.15.92:3300/0 conn(0x7f0db80cd4b0 msgr2=0x7f0db80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:25.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 --2- 172.21.15.32:0/1008695423 >> v2:172.21.15.92:3300/0 conn(0x7f0db80cd4b0 0x7f0db80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80cc220 con 0x7f0db80b2940 2023-10-14T12:19:25.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f0da8001670 con 0x7f0db80b2940 2023-10-14T12:19:25.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 >> v1:172.21.15.32:6789/0 conn(0x7f0db80b2940 legacy=0x7f0db80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da0003a00 0x7f0da0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0da0004850 0x7f0da0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 0x7f0da0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80b2dc0 con 0x7f0da0004850 2023-10-14T12:19:25.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80b6290 con 0x7f0da0003a00 2023-10-14T12:19:25.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000ba10 con 0x7f0db815a850 2023-10-14T12:19:25.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0da0004850 0x7f0da0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db659c700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da0003a00 0x7f0da0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db6d9d700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 0x7f0da0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 -- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 msgr2=0x7f0da0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:25.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0db815a850 0x7f0da0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 -- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da0003a00 msgr2=0x7f0da0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:25.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da0003a00 0x7f0da0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 -- 172.21.15.32:0/1008695423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00035b0 con 0x7f0da0004850 2023-10-14T12:19:25.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db5d9b700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0da0004850 0x7f0da0004cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c370 tx=0x7f0da0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d8e650ba917035 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:25.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8007c60 con 0x7f0da0004850 2023-10-14T12:19:25.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8005960 con 0x7f0da0004850 2023-10-14T12:19:25.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.552+0000 7f0db559a700 1 -- 172.21.15.32:0/1008695423 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8005d10 con 0x7f0da0004850 2023-10-14T12:19:25.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0dbca9e700 1 -- 172.21.15.32:0/1008695423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0da0004850 msgr2=0x7f0da0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/1008695423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0da0004850 0x7f0da0004cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c370 tx=0x7f0da0005880 comp rx=0 tx=0).stop 2023-10-14T12:19:25.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0db6d9d700 1 -- 172.21.15.32:0/1008695423 reap_dead start 2023-10-14T12:19:25.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0dbca9e700 1 -- 172.21.15.32:0/1008695423 shutdown_connections 2023-10-14T12:19:25.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0dbca9e700 1 -- 172.21.15.32:0/1008695423 >> 172.21.15.32:0/1008695423 conn(0x7f0db806dac0 msgr2=0x7f0db806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:25.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0dbca9e700 1 -- 172.21.15.32:0/1008695423 shutdown_connections 2023-10-14T12:19:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.553+0000 7f0dbca9e700 1 -- 172.21.15.32:0/1008695423 wait complete. 2023-10-14T12:19:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.554+0000 7f0dbca9e700 1 Processor -- start 2023-10-14T12:19:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 -- start start 2023-10-14T12:19:25.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0da0004850 0x7f0db80c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db80c9430 0x7f0db815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 0x7f0db80719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8152900 con 0x7f0db8151e20 2023-10-14T12:19:25.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db815b7e0 con 0x7f0db80c9430 2023-10-14T12:19:25.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0dbca9e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80c4ff0 con 0x7f0da0004850 2023-10-14T12:19:25.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0db6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 0x7f0db80719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0db6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 0x7f0db80719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39280/0 (socket says 172.21.15.32:39280) 2023-10-14T12:19:25.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.555+0000 7f0db6d9d700 1 -- 172.21.15.32:0/3347794716 learned_addr learned my addr 172.21.15.32:0/3347794716 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:25.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db659c700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0da0004850 0x7f0db80c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db5d9b700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db80c9430 0x7f0db815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db6d9d700 1 -- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0da0004850 msgr2=0x7f0db80c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db6d9d700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0da0004850 0x7f0db80c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db6d9d700 1 -- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db80c9430 msgr2=0x7f0db815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db6d9d700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db80c9430 0x7f0db815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db6d9d700 1 -- 172.21.15.32:0/3347794716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80c52d0 con 0x7f0db8151e20 2023-10-14T12:19:25.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db659c700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0da0004850 0x7f0db80c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:25.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db5d9b700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db80c9430 0x7f0db815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:25.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0db6d9d700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 0x7f0db80719b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0db80cae10 tx=0x7f0db000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:25.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000e040 con 0x7f0db8151e20 2023-10-14T12:19:25.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db000f040 con 0x7f0db8151e20 2023-10-14T12:19:25.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db80c55b0 con 0x7f0db8151e20 2023-10-14T12:19:25.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0015670 con 0x7f0db8151e20 2023-10-14T12:19:25.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.556+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db80c5b70 con 0x7f0db8151e20 2023-10-14T12:19:25.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.557+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80c5d90 con 0x7f0db8151e20 2023-10-14T12:19:25.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.557+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0db00157d0 con 0x7f0db8151e20 2023-10-14T12:19:25.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.558+0000 7f0da6ffd700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d9806af00 0x7f0d9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:25.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.558+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0db0089be0 con 0x7f0db8151e20 2023-10-14T12:19:25.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.558+0000 7f0db659c700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d9806af00 0x7f0d9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:25.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.558+0000 7f0db659c700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d9806af00 0x7f0d9806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0db80b20f0 tx=0x7f0dac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:25.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.562+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0db0054c90 con 0x7f0db8151e20 2023-10-14T12:19:25.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.779+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0db8067d20 con 0x7f0db8151e20 2023-10-14T12:19:25.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.780+0000 7f0da6ffd700 1 -- 172.21.15.32:0/3347794716 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0db00582b0 con 0x7f0db8151e20 2023-10-14T12:19:25.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d9806af00 msgr2=0x7f0d9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d9806af00 0x7f0d9806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0db80b20f0 tx=0x7f0dac008040 comp rx=0 tx=0).stop 2023-10-14T12:19:25.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 msgr2=0x7f0db80719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:25.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 0x7f0db80719b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0db80cae10 tx=0x7f0db000f490 comp rx=0 tx=0).stop 2023-10-14T12:19:25.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 shutdown_connections 2023-10-14T12:19:25.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0db8151e20 0x7f0db80719b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0da0004850 0x7f0db80c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d9806af00 0x7f0d9806d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 --2- 172.21.15.32:0/3347794716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db80c9430 0x7f0db815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 >> 172.21.15.32:0/3347794716 conn(0x7f0db806dac0 msgr2=0x7f0db80ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 shutdown_connections 2023-10-14T12:19:25.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:25.782+0000 7f0dbca9e700 1 -- 172.21.15.32:0/3347794716 wait complete. 2023-10-14T12:19:25.787 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-14T12:19:25.796 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-14T12:19:25.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:25.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-14T12:19:25.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:19:25.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:25.842 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T12:19:25.859 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:25.860 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:25.882 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:25.882 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:25.942 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:25.943 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:26.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:26.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.126+0000 7fba9df31700 1 Processor -- start 2023-10-14T12:19:26.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.126+0000 7fba9df31700 1 -- start start 2023-10-14T12:19:26.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba9df31700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980b2980 0x7fba9806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba9df31700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fba980728e0 0x7fba9815e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba9df31700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba98070040 con 0x7fba9815a8e0 2023-10-14T12:19:26.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba9df31700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980d0420 con 0x7fba980728e0 2023-10-14T12:19:26.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba9df31700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980afce0 con 0x7fba980b2980 2023-10-14T12:19:26.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba97fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fba980728e0 0x7fba9815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba97fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fba980728e0 0x7fba9815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39288/0 (socket says 172.21.15.32:39288) 2023-10-14T12:19:26.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.127+0000 7fba97fff700 1 -- 172.21.15.32:0/229813982 learned_addr learned my addr 172.21.15.32:0/229813982 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:26.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba96ffd700 1 --2- 172.21.15.32:0/229813982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980b2980 0x7fba9806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba97fff700 1 -- 172.21.15.32:0/229813982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980b2980 msgr2=0x7fba9806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:26.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba97fff700 1 --2- 172.21.15.32:0/229813982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980b2980 0x7fba9806fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba97fff700 1 -- 172.21.15.32:0/229813982 >> v1:172.21.15.92:6789/0 conn(0x7fba9815a8e0 legacy=0x7fba980b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:26.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba97fff700 1 -- 172.21.15.32:0/229813982 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98071e00 con 0x7fba980728e0 2023-10-14T12:19:26.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba97fff700 1 --2- 172.21.15.32:0/229813982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba980728e0 0x7fba9815e450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fba90009e50 tx=0x7fba9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28851116ce3620dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba967fc700 1 -- 172.21.15.32:0/229813982 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000e070 con 0x7fba980728e0 2023-10-14T12:19:26.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba967fc700 1 -- 172.21.15.32:0/229813982 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000b9c0 con 0x7fba980728e0 2023-10-14T12:19:26.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.128+0000 7fba967fc700 1 -- 172.21.15.32:0/229813982 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000bd70 con 0x7fba980728e0 2023-10-14T12:19:26.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 -- 172.21.15.32:0/229813982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba980728e0 msgr2=0x7fba9815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 --2- 172.21.15.32:0/229813982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba980728e0 0x7fba9815e450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fba90009e50 tx=0x7fba9000b330 comp rx=0 tx=0).stop 2023-10-14T12:19:26.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 -- 172.21.15.32:0/229813982 shutdown_connections 2023-10-14T12:19:26.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 --2- 172.21.15.32:0/229813982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba980728e0 0x7fba9815e450 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 --2- 172.21.15.32:0/229813982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980b2980 0x7fba9806fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 -- 172.21.15.32:0/229813982 >> 172.21.15.32:0/229813982 conn(0x7fba980cd270 msgr2=0x7fba980cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:26.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 -- 172.21.15.32:0/229813982 shutdown_connections 2023-10-14T12:19:26.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.129+0000 7fba9df31700 1 -- 172.21.15.32:0/229813982 wait complete. 2023-10-14T12:19:26.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.130+0000 7fba9df31700 1 Processor -- start 2023-10-14T12:19:26.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.130+0000 7fba9df31700 1 -- start start 2023-10-14T12:19:26.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba9df31700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980728e0 0x7fba980c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba9df31700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba980b2980 0x7fba980c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba9df31700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 0x7fba980b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba9df31700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c71b0 con 0x7fba9815a8e0 2023-10-14T12:19:26.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba9df31700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815c2d0 con 0x7fba980b2980 2023-10-14T12:19:26.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba9df31700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815c5b0 con 0x7fba980728e0 2023-10-14T12:19:26.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 0x7fba980b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 0x7fba980b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39294/0 (socket says 172.21.15.32:39294) 2023-10-14T12:19:26.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 -- 172.21.15.32:0/720607599 learned_addr learned my addr 172.21.15.32:0/720607599 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:26.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba96ffd700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba980b2980 0x7fba980c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba977fe700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980728e0 0x7fba980c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 -- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980728e0 msgr2=0x7fba980c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980728e0 0x7fba980c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 -- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba980b2980 msgr2=0x7fba980c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba980b2980 0x7fba980c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.131+0000 7fba97fff700 1 -- 172.21.15.32:0/720607599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009b30 con 0x7fba9815a8e0 2023-10-14T12:19:26.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.132+0000 7fba97fff700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 0x7fba980b4020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba90012000 tx=0x7fba90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.132+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90004800 con 0x7fba9815a8e0 2023-10-14T12:19:26.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.132+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90004960 con 0x7fba9815a8e0 2023-10-14T12:19:26.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.132+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9001b670 con 0x7fba9815a8e0 2023-10-14T12:19:26.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.132+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9815c890 con 0x7fba9815a8e0 2023-10-14T12:19:26.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.132+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9815ce50 con 0x7fba9815a8e0 2023-10-14T12:19:26.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.133+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba98067d20 con 0x7fba9815a8e0 2023-10-14T12:19:26.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.133+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fba9001b7d0 con 0x7fba9815a8e0 2023-10-14T12:19:26.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.134+0000 7fba8ffff700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fba7806af00 0x7fba7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.134+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba9008aa60 con 0x7fba9815a8e0 2023-10-14T12:19:26.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.134+0000 7fba977fe700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fba7806af00 0x7fba7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.134+0000 7fba977fe700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fba7806af00 0x7fba7806d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba80000fb0 tx=0x7fba80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.138+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba90055ba0 con 0x7fba9815a8e0 2023-10-14T12:19:26.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.341+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba9806f550 con 0x7fba9815a8e0 2023-10-14T12:19:26.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.342+0000 7fba8ffff700 1 -- 172.21.15.32:0/720607599 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fba900591c0 con 0x7fba9815a8e0 2023-10-14T12:19:26.344 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:26.344 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fba7806af00 msgr2=0x7fba7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fba7806af00 0x7fba7806d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba80000fb0 tx=0x7fba80009040 comp rx=0 tx=0).stop 2023-10-14T12:19:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 msgr2=0x7fba980b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 0x7fba980b4020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba90012000 tx=0x7fba90004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 shutdown_connections 2023-10-14T12:19:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba9815a8e0 0x7fba980b4020 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba980728e0 0x7fba980c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fba7806af00 0x7fba7806d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 --2- 172.21.15.32:0/720607599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba980b2980 0x7fba980c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 >> 172.21.15.32:0/720607599 conn(0x7fba980cd270 msgr2=0x7fba980cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:26.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 shutdown_connections 2023-10-14T12:19:26.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.344+0000 7fba9df31700 1 -- 172.21.15.32:0/720607599 wait complete. 2023-10-14T12:19:26.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:26.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:26.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.486+0000 7f5cae2d9700 1 Processor -- start 2023-10-14T12:19:26.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.486+0000 7f5cae2d9700 1 -- start start 2023-10-14T12:19:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5cae2d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5cae2d9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ca80d1d90 0x7f5ca80cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5cae2d9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca815ee90 con 0x7f5ca80cf6d0 2023-10-14T12:19:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5cae2d9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca80cfb50 con 0x7f5ca80d1d90 2023-10-14T12:19:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5cae2d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8158370 con 0x7f5ca815eab0 2023-10-14T12:19:26.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5ca77fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5ca80cf6d0 0x7f5ca80d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56322/0 (socket says 172.21.15.32:56322) 2023-10-14T12:19:26.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5ca77fe700 1 -- 172.21.15.32:0/797708928 learned_addr learned my addr 172.21.15.32:0/797708928 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:26.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.487+0000 7f5ca7fff700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5cac876700 1 --2- 172.21.15.32:0/797708928 >> v2:172.21.15.32:3300/0 conn(0x7f5ca80d1d90 0x7f5ca80cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5ca6ffd700 1 -- 172.21.15.32:0/797708928 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005409810 0 0) 0x7f5ca815ee90 con 0x7f5ca80cf6d0 2023-10-14T12:19:26.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5ca6ffd700 1 -- 172.21.15.32:0/797708928 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c900035b0 con 0x7f5ca80cf6d0 2023-10-14T12:19:26.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5cac876700 1 -- 172.21.15.32:0/797708928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 msgr2=0x7f5ca80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:26.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5cac876700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca80cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5cac876700 1 -- 172.21.15.32:0/797708928 >> v1:172.21.15.32:6789/0 conn(0x7f5ca80cf6d0 legacy=0x7f5ca80d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5cac876700 1 -- 172.21.15.32:0/797708928 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca80d23b0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5ca7fff700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:26.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5cac876700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca80cbc10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ca815f020 tx=0x7f5ca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d648cf80b33e6a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5ca6ffd700 1 -- 172.21.15.32:0/797708928 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0016070 con 0x7f5ca80d1d90 2023-10-14T12:19:26.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5ca6ffd700 1 -- 172.21.15.32:0/797708928 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca000bb20 con 0x7f5ca80d1d90 2023-10-14T12:19:26.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.488+0000 7f5ca6ffd700 1 -- 172.21.15.32:0/797708928 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca000e070 con 0x7f5ca80d1d90 2023-10-14T12:19:26.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 -- 172.21.15.32:0/797708928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 msgr2=0x7f5ca80cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca80cbc10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ca815f020 tx=0x7f5ca000b330 comp rx=0 tx=0).stop 2023-10-14T12:19:26.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 -- 172.21.15.32:0/797708928 shutdown_connections 2023-10-14T12:19:26.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca80cbc10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/797708928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 -- 172.21.15.32:0/797708928 >> 172.21.15.32:0/797708928 conn(0x7f5ca80665a0 msgr2=0x7f5ca8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:26.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 -- 172.21.15.32:0/797708928 shutdown_connections 2023-10-14T12:19:26.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.489+0000 7f5cae2d9700 1 -- 172.21.15.32:0/797708928 wait complete. 2023-10-14T12:19:26.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.490+0000 7f5cae2d9700 1 Processor -- start 2023-10-14T12:19:26.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 -- start start 2023-10-14T12:19:26.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca80cf6d0 0x7f5ca8153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca8160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca81f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81543e0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80c5220 con 0x7f5ca80cf6d0 2023-10-14T12:19:26.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5cae2d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80c5500 con 0x7f5ca815eab0 2023-10-14T12:19:26.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.491+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca8160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca8160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39306/0 (socket says 172.21.15.32:39306) 2023-10-14T12:19:26.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 -- 172.21.15.32:0/531794313 learned_addr learned my addr 172.21.15.32:0/531794313 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:26.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca7fff700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca80cf6d0 0x7f5ca8153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5cac876700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca81f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 -- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 msgr2=0x7f5ca81f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca81f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 -- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca80cf6d0 msgr2=0x7f5ca8153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca80cf6d0 0x7f5ca8153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 -- 172.21.15.32:0/531794313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980094a0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca77fe700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca8160a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c001eb0 tx=0x7f5c9c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c005d70 con 0x7f5ca80d1d90 2023-10-14T12:19:26.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0070d0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c007460 con 0x7f5ca80d1d90 2023-10-14T12:19:26.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca0009a70 con 0x7f5ca80d1d90 2023-10-14T12:19:26.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.492+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca80c5ac0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.493+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca80cdce0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.494+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5c9c0075c0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.494+0000 7f5ca4ff9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5c9406af00 0x7f5c9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.495+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c9c088b50 con 0x7f5ca80d1d90 2023-10-14T12:19:26.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.495+0000 7f5ca7fff700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5c9406af00 0x7f5c9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.495+0000 7f5ca7fff700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5c9406af00 0x7f5c9406d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80b01c0 tx=0x7f5c98009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.498+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c9c088e60 con 0x7f5ca80d1d90 2023-10-14T12:19:26.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.696+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ca80cdce0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.696+0000 7f5ca4ff9700 1 -- 172.21.15.32:0/531794313 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ca80cdce0 con 0x7f5ca80d1d90 2023-10-14T12:19:26.698 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:26.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5c9406af00 msgr2=0x7f5c9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5c9406af00 0x7f5c9406d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80b01c0 tx=0x7f5c98009210 comp rx=0 tx=0).stop 2023-10-14T12:19:26.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 msgr2=0x7f5ca8160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca8160a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c001eb0 tx=0x7f5c9c00c7b0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 shutdown_connections 2023-10-14T12:19:26.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ca815eab0 0x7f5ca81f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5c9406af00 0x7f5c9406d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca80cf6d0 0x7f5ca8153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 --2- 172.21.15.32:0/531794313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ca80d1d90 0x7f5ca8160a70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.698+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 >> 172.21.15.32:0/531794313 conn(0x7f5ca80665a0 msgr2=0x7f5ca815dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:26.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.699+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 shutdown_connections 2023-10-14T12:19:26.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.699+0000 7f5cae2d9700 1 -- 172.21.15.32:0/531794313 wait complete. 2023-10-14T12:19:26.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:26.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.838+0000 7f4511fa5700 1 Processor -- start 2023-10-14T12:19:26.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.838+0000 7f4511fa5700 1 -- start start 2023-10-14T12:19:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f4511fa5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f450c0cd950 0x7f450c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f4511fa5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f450c06a840 0x7f450c06ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f4511fa5700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c0cf290 con 0x7f450c0cede0 2023-10-14T12:19:26.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f4511fa5700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c1619a0 con 0x7f450c06a840 2023-10-14T12:19:26.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f4511fa5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c06b1b0 con 0x7f450c0cd950 2023-10-14T12:19:26.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f450bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f450c06a840 0x7f450c06ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f450affd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f450c0cede0 0x7f450c15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56336/0 (socket says 172.21.15.32:56336) 2023-10-14T12:19:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.839+0000 7f450affd700 1 -- 172.21.15.32:0/690639743 learned_addr learned my addr 172.21.15.32:0/690639743 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450b7fe700 1 --2- 172.21.15.32:0/690639743 >> v2:172.21.15.92:3300/0 conn(0x7f450c0cd950 0x7f450c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450bfff700 1 -- 172.21.15.32:0/690639743 >> v2:172.21.15.92:3300/0 conn(0x7f450c0cd950 msgr2=0x7f450c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450bfff700 1 --2- 172.21.15.32:0/690639743 >> v2:172.21.15.92:3300/0 conn(0x7f450c0cd950 0x7f450c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450bfff700 1 -- 172.21.15.32:0/690639743 >> v1:172.21.15.32:6789/0 conn(0x7f450c0cede0 legacy=0x7f450c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450bfff700 1 -- 172.21.15.32:0/690639743 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0b2d60 con 0x7f450c06a840 2023-10-14T12:19:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450a7fc700 1 -- 172.21.15.32:0/690639743 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144952186 0 0) 0x7f450c0cf290 con 0x7f450c0cede0 2023-10-14T12:19:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450bfff700 1 --2- 172.21.15.32:0/690639743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c06a840 0x7f450c06ac70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f450c0d0430 tx=0x7f450400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712af2d1b0ad2162 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450a7fc700 1 -- 172.21.15.32:0/690639743 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400e070 con 0x7f450c06a840 2023-10-14T12:19:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450a7fc700 1 -- 172.21.15.32:0/690639743 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400bbd0 con 0x7f450c06a840 2023-10-14T12:19:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.840+0000 7f450a7fc700 1 -- 172.21.15.32:0/690639743 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504012430 con 0x7f450c06a840 2023-10-14T12:19:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 -- 172.21.15.32:0/690639743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c06a840 msgr2=0x7f450c06ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 --2- 172.21.15.32:0/690639743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c06a840 0x7f450c06ac70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f450c0d0430 tx=0x7f450400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 -- 172.21.15.32:0/690639743 shutdown_connections 2023-10-14T12:19:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 --2- 172.21.15.32:0/690639743 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c06a840 0x7f450c06ac70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 --2- 172.21.15.32:0/690639743 >> v2:172.21.15.92:3300/0 conn(0x7f450c0cd950 0x7f450c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 -- 172.21.15.32:0/690639743 >> 172.21.15.32:0/690639743 conn(0x7f450c06dae0 msgr2=0x7f450c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 -- 172.21.15.32:0/690639743 shutdown_connections 2023-10-14T12:19:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.841+0000 7f4511fa5700 1 -- 172.21.15.32:0/690639743 wait complete. 2023-10-14T12:19:26.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.842+0000 7f4511fa5700 1 Processor -- start 2023-10-14T12:19:26.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.842+0000 7f4511fa5700 1 -- start start 2023-10-14T12:19:26.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f4511fa5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f450c06a840 0x7f450c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f4511fa5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f450c0cd950 0x7f450c1f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f4511fa5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 0x7f450c1f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f4511fa5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c7fb0 con 0x7f450c0cede0 2023-10-14T12:19:26.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f4511fa5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c8f50 con 0x7f450c06a840 2023-10-14T12:19:26.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f4511fa5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c151840 con 0x7f450c0cd950 2023-10-14T12:19:26.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 0x7f450c1f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 0x7f450c1f7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39322/0 (socket says 172.21.15.32:39322) 2023-10-14T12:19:26.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 -- 172.21.15.32:0/4287618636 learned_addr learned my addr 172.21.15.32:0/4287618636 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:26.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450b7fe700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f450c06a840 0x7f450c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450affd700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f450c0cd950 0x7f450c1f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 -- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f450c0cd950 msgr2=0x7f450c1f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f450c0cd950 0x7f450c1f70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 -- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f450c06a840 msgr2=0x7f450c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:26.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f450c06a840 0x7f450c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:26.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.843+0000 7f450bfff700 1 -- 172.21.15.32:0/4287618636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009a70 con 0x7f450c0cede0 2023-10-14T12:19:26.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.844+0000 7f450bfff700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 0x7f450c1f7600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f450c0cf420 tx=0x7f4504004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.844+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504012430 con 0x7f450c0cede0 2023-10-14T12:19:26.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.844+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504020070 con 0x7f450c0cede0 2023-10-14T12:19:26.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.844+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c0c8190 con 0x7f450c0cede0 2023-10-14T12:19:26.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.844+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504003ea0 con 0x7f450c0cede0 2023-10-14T12:19:26.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.844+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c0c8750 con 0x7f450c0cede0 2023-10-14T12:19:26.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.845+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c067d20 con 0x7f450c0cede0 2023-10-14T12:19:26.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.845+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4504004280 con 0x7f450c0cede0 2023-10-14T12:19:26.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.846+0000 7f4503fff700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f44ec06af00 0x7f44ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:26.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.846+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4504022070 con 0x7f450c0cede0 2023-10-14T12:19:26.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.846+0000 7f450b7fe700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f44ec06af00 0x7f44ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:26.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.847+0000 7f450b7fe700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f44ec06af00 0x7f44ec06d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00ab60 tx=0x7f44fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:26.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:26.850+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45040568c0 con 0x7f450c0cede0 2023-10-14T12:19:27.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.048+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f450c0caab0 con 0x7f450c0cede0 2023-10-14T12:19:27.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.049+0000 7f4503fff700 1 -- 172.21.15.32:0/4287618636 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4504059ee0 con 0x7f450c0cede0 2023-10-14T12:19:27.050 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:27.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f44ec06af00 msgr2=0x7f44ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f44ec06af00 0x7f44ec06d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00ab60 tx=0x7f44fc008040 comp rx=0 tx=0).stop 2023-10-14T12:19:27.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 msgr2=0x7f450c1f7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 0x7f450c1f7600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f450c0cf420 tx=0x7f4504004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 shutdown_connections 2023-10-14T12:19:27.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f450c0cede0 0x7f450c1f7600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f44ec06af00 0x7f44ec06d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f450c06a840 0x7f450c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 --2- 172.21.15.32:0/4287618636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f450c0cd950 0x7f450c1f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 >> 172.21.15.32:0/4287618636 conn(0x7f450c06dae0 msgr2=0x7f450c15fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:27.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 shutdown_connections 2023-10-14T12:19:27.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.051+0000 7f4511fa5700 1 -- 172.21.15.32:0/4287618636 wait complete. 2023-10-14T12:19:27.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.191+0000 7f9cfe973700 1 Processor -- start 2023-10-14T12:19:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.191+0000 7f9cfe973700 1 -- start start 2023-10-14T12:19:27.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.192+0000 7f9cfe973700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 0x7f9cf80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.192+0000 7f9cfe973700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf80b2d60 con 0x7f9cf80cd950 2023-10-14T12:19:27.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.192+0000 7f9cfe973700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf80cdd30 con 0x7f9cf806a840 2023-10-14T12:19:27.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.192+0000 7f9cfe973700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81619a0 con 0x7f9cf815e2f0 2023-10-14T12:19:27.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.192+0000 7f9cf7fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9cf80cd950 0x7f9cf815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56350/0 (socket says 172.21.15.32:56350) 2023-10-14T12:19:27.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.192+0000 7f9cf7fff700 1 -- 172.21.15.32:0/4057195960 learned_addr learned my addr 172.21.15.32:0/4057195960 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:27.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf77fe700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 0x7f9cf80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786045318 0 0) 0x7f9cf80b2d60 con 0x7f9cf80cd950 2023-10-14T12:19:27.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce40035b0 con 0x7f9cf80cd950 2023-10-14T12:19:27.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251916995 0 0) 0x7f9cf80cdd30 con 0x7f9cf806a840 2023-10-14T12:19:27.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf80b2d60 con 0x7f9cf806a840 2023-10-14T12:19:27.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606922212 0 0) 0x7f9ce40035b0 con 0x7f9cf80cd950 2023-10-14T12:19:27.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 msgr2=0x7f9cf80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:27.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 0x7f9cf80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 >> v1:172.21.15.92:6789/0 conn(0x7f9cf806a840 legacy=0x7f9cf8161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf815e920 con 0x7f9cf80cd950 2023-10-14T12:19:27.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f9ce0001670 con 0x7f9cf80cd950 2023-10-14T12:19:27.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 >> v1:172.21.15.32:6789/0 conn(0x7f9cf80cd950 legacy=0x7f9cf815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce4003bc0 0x7f9ce4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 0x7f9ce4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce4004d90 0x7f9ce4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81619a0 con 0x7f9ce4004d90 2023-10-14T12:19:27.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce400bac0 con 0x7f9ce4003bc0 2023-10-14T12:19:27.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce400bc80 con 0x7f9cf815e2f0 2023-10-14T12:19:27.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cfcf10700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce4004d90 0x7f9ce4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf7fff700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce4003bc0 0x7f9ce4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cf77fe700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 0x7f9ce4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cfcf10700 1 -- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 msgr2=0x7f9ce4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:27.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.193+0000 7f9cfcf10700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf815e2f0 0x7f9ce4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfcf10700 1 -- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce4003bc0 msgr2=0x7f9ce4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:27.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfcf10700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce4003bc0 0x7f9ce4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfcf10700 1 -- 172.21.15.32:0/4057195960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40035b0 con 0x7f9ce4004d90 2023-10-14T12:19:27.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfcf10700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce4004d90 0x7f9ce4005210 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c2f0 tx=0x7f9ce4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305770d8b8061cf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:27.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0001f30 con 0x7f9ce4004d90 2023-10-14T12:19:27.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000ce90 con 0x7f9ce4004d90 2023-10-14T12:19:27.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cf6ffd700 1 -- 172.21.15.32:0/4057195960 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0003c40 con 0x7f9ce4004d90 2023-10-14T12:19:27.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfe973700 1 -- 172.21.15.32:0/4057195960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce4004d90 msgr2=0x7f9ce4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfe973700 1 --2- 172.21.15.32:0/4057195960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce4004d90 0x7f9ce4005210 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c2f0 tx=0x7f9ce4005880 comp rx=0 tx=0).stop 2023-10-14T12:19:27.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfcf10700 1 -- 172.21.15.32:0/4057195960 reap_dead start 2023-10-14T12:19:27.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfe973700 1 -- 172.21.15.32:0/4057195960 shutdown_connections 2023-10-14T12:19:27.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfe973700 1 -- 172.21.15.32:0/4057195960 >> 172.21.15.32:0/4057195960 conn(0x7f9cf806dae0 msgr2=0x7f9cf806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:27.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfe973700 1 -- 172.21.15.32:0/4057195960 shutdown_connections 2023-10-14T12:19:27.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.194+0000 7f9cfe973700 1 -- 172.21.15.32:0/4057195960 wait complete. 2023-10-14T12:19:27.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.196+0000 7f9cfe973700 1 Processor -- start 2023-10-14T12:19:27.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.196+0000 7f9cfe973700 1 -- start start 2023-10-14T12:19:27.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf814f8f0 0x7f9cf80ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 0x7f9cf80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf80c8360 0x7f9cf81f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80b45f0 con 0x7f9cf80c7840 2023-10-14T12:19:27.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80c87e0 con 0x7f9cf814f8f0 2023-10-14T12:19:27.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80b42a0 con 0x7f9cf80c8360 2023-10-14T12:19:27.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 0x7f9cf80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 0x7f9cf80c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39340/0 (socket says 172.21.15.32:39340) 2023-10-14T12:19:27.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 -- 172.21.15.32:0/1018985271 learned_addr learned my addr 172.21.15.32:0/1018985271 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:27.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf7fff700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf814f8f0 0x7f9cf80ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfcf10700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf80c8360 0x7f9cf81f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 -- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf80c8360 msgr2=0x7f9cf81f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf80c8360 0x7f9cf81f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 -- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf814f8f0 msgr2=0x7f9cf80ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf814f8f0 0x7f9cf80ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 -- 172.21.15.32:0/1018985271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80aefb0 con 0x7f9cf80c7840 2023-10-14T12:19:27.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf77fe700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 0x7f9cf80c7e20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80119f0 tx=0x7f9ce8011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:27.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8005c30 con 0x7f9cf80c7840 2023-10-14T12:19:27.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8005d90 con 0x7f9cf80c7840 2023-10-14T12:19:27.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800f950 con 0x7f9cf80c7840 2023-10-14T12:19:27.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf80af290 con 0x7f9cf80c7840 2023-10-14T12:19:27.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.197+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf80aec30 con 0x7f9cf80c7840 2023-10-14T12:19:27.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.198+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf80b4730 con 0x7f9cf80c7840 2023-10-14T12:19:27.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.199+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ce800fab0 con 0x7f9cf80c7840 2023-10-14T12:19:27.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.199+0000 7f9cf4ff9700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9cd806af00 0x7f9cd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.199+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ce8089bc0 con 0x7f9cf80c7840 2023-10-14T12:19:27.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.200+0000 7f9cf7fff700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9cd806af00 0x7f9cd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.200+0000 7f9cf7fff700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9cd806af00 0x7f9cd806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00048d0 tx=0x7f9ce0000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:27.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.204+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cf80b4730 con 0x7f9cf80c7840 2023-10-14T12:19:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.408+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9cf80b4730 con 0x7f9cf80c7840 2023-10-14T12:19:27.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.409+0000 7f9cf4ff9700 1 -- 172.21.15.32:0/1018985271 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9cf80b4730 con 0x7f9cf80c7840 2023-10-14T12:19:27.410 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:27.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9cd806af00 msgr2=0x7f9cd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9cd806af00 0x7f9cd806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00048d0 tx=0x7f9ce0000ed0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 msgr2=0x7f9cf80c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 0x7f9cf80c7e20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80119f0 tx=0x7f9ce8011d00 comp rx=0 tx=0).stop 2023-10-14T12:19:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 shutdown_connections 2023-10-14T12:19:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9cf80c8360 0x7f9cf81f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9cd806af00 0x7f9cd806d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cf814f8f0 0x7f9cf80ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 --2- 172.21.15.32:0/1018985271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cf80c7840 0x7f9cf80c7e20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 >> 172.21.15.32:0/1018985271 conn(0x7f9cf806dae0 msgr2=0x7f9cf806e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 shutdown_connections 2023-10-14T12:19:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.411+0000 7f9cfe973700 1 -- 172.21.15.32:0/1018985271 wait complete. 2023-10-14T12:19:27.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:19:27.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.552+0000 7ff768d38700 1 Processor -- start 2023-10-14T12:19:27.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.552+0000 7ff768d38700 1 -- start start 2023-10-14T12:19:27.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff768d38700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff76415dce0 0x7ff7640b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff768d38700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76415e0c0 0x7ff7640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff768d38700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7640cfa30 0x7ff7640cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff768d38700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640d03c0 con 0x7ff76415dce0 2023-10-14T12:19:27.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff768d38700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640cbc40 con 0x7ff7640cfa30 2023-10-14T12:19:27.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff768d38700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76406cb70 con 0x7ff76415e0c0 2023-10-14T12:19:27.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff76415dce0 0x7ff7640b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff76415dce0 0x7ff7640b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39346/0 (socket says 172.21.15.32:39346) 2023-10-14T12:19:27.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 -- 172.21.15.32:0/868321220 learned_addr learned my addr 172.21.15.32:0/868321220 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:27.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff762d9d700 1 --2- 172.21.15.32:0/868321220 >> v2:172.21.15.92:3300/0 conn(0x7ff7640cfa30 0x7ff7640cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff761d9b700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76415e0c0 0x7ff7640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 -- 172.21.15.32:0/868321220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76415e0c0 msgr2=0x7ff7640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:27.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76415e0c0 0x7ff7640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 -- 172.21.15.32:0/868321220 >> v2:172.21.15.92:3300/0 conn(0x7ff7640cfa30 msgr2=0x7ff7640cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:27.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 --2- 172.21.15.32:0/868321220 >> v2:172.21.15.92:3300/0 conn(0x7ff7640cfa30 0x7ff7640cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 -- 172.21.15.32:0/868321220 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76406ce50 con 0x7ff76415dce0 2023-10-14T12:19:27.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff762d9d700 1 --2- 172.21.15.32:0/868321220 >> v2:172.21.15.92:3300/0 conn(0x7ff7640cfa30 0x7ff7640cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:27.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff761d9b700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76415e0c0 0x7ff7640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:27.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.553+0000 7ff76259c700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415dce0 0x7ff7640b03c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff764067c30 tx=0x7ff754009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ffefa54b9e6176 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:27.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff76159a700 1 -- 172.21.15.32:0/868321220 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400b870 con 0x7ff76415dce0 2023-10-14T12:19:27.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff76159a700 1 -- 172.21.15.32:0/868321220 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75400b9d0 con 0x7ff76415dce0 2023-10-14T12:19:27.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff76159a700 1 -- 172.21.15.32:0/868321220 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400bd60 con 0x7ff76415dce0 2023-10-14T12:19:27.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 -- 172.21.15.32:0/868321220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415dce0 msgr2=0x7ff7640b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415dce0 0x7ff7640b03c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff764067c30 tx=0x7ff754009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 -- 172.21.15.32:0/868321220 shutdown_connections 2023-10-14T12:19:27.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 --2- 172.21.15.32:0/868321220 >> v2:172.21.15.92:3300/0 conn(0x7ff7640cfa30 0x7ff7640cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415dce0 0x7ff7640b03c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 --2- 172.21.15.32:0/868321220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76415e0c0 0x7ff7640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 -- 172.21.15.32:0/868321220 >> 172.21.15.32:0/868321220 conn(0x7ff7640d15f0 msgr2=0x7ff7640d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:27.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 -- 172.21.15.32:0/868321220 shutdown_connections 2023-10-14T12:19:27.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.554+0000 7ff768d38700 1 -- 172.21.15.32:0/868321220 wait complete. 2023-10-14T12:19:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 Processor -- start 2023-10-14T12:19:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 -- start start 2023-10-14T12:19:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7640cfa30 0x7ff76415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff76415dce0 0x7ff7640c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 0x7ff7641e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c5d80 con 0x7ff76415e0c0 2023-10-14T12:19:27.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c6060 con 0x7ff76415dce0 2023-10-14T12:19:27.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.556+0000 7ff768d38700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c6340 con 0x7ff7640cfa30 2023-10-14T12:19:27.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 0x7ff7641e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 0x7ff7641e70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39356/0 (socket says 172.21.15.32:39356) 2023-10-14T12:19:27.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 -- 172.21.15.32:0/3593282171 learned_addr learned my addr 172.21.15.32:0/3593282171 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:27.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff76259c700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7640cfa30 0x7ff76415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff761d9b700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff76415dce0 0x7ff7640c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 -- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7640cfa30 msgr2=0x7ff76415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7640cfa30 0x7ff76415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 -- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff76415dce0 msgr2=0x7ff7640c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff76415dce0 0x7ff7640c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 -- 172.21.15.32:0/3593282171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754009550 con 0x7ff76415e0c0 2023-10-14T12:19:27.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff761d9b700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff76415dce0 0x7ff7640c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:27.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff762d9d700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 0x7ff7641e70b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff75c007e10 tx=0x7ff75c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:27.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00ddd0 con 0x7ff76415e0c0 2023-10-14T12:19:27.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c00f040 con 0x7ff76415e0c0 2023-10-14T12:19:27.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c003c60 con 0x7ff76415e0c0 2023-10-14T12:19:27.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7640c6620 con 0x7ff76415e0c0 2023-10-14T12:19:27.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.557+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76415ac10 con 0x7ff76415e0c0 2023-10-14T12:19:27.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.558+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7640c6b40 con 0x7ff76415e0c0 2023-10-14T12:19:27.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.559+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff75c004030 con 0x7ff76415e0c0 2023-10-14T12:19:27.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.559+0000 7ff752ffd700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74406af00 0x7ff74406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.559+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff75c0895d0 con 0x7ff76415e0c0 2023-10-14T12:19:27.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.559+0000 7ff76259c700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74406af00 0x7ff74406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.560+0000 7ff76259c700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74406af00 0x7ff74406d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:27.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.564+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7640c6b40 con 0x7ff76415e0c0 2023-10-14T12:19:27.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.779+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff7640c6b40 con 0x7ff76415e0c0 2023-10-14T12:19:27.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.780+0000 7ff752ffd700 1 -- 172.21.15.32:0/3593282171 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff7640c6b40 con 0x7ff76415e0c0 2023-10-14T12:19:27.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74406af00 msgr2=0x7ff74406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74406af00 0x7ff74406d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754008030 comp rx=0 tx=0).stop 2023-10-14T12:19:27.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 msgr2=0x7ff7641e70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 0x7ff7641e70b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff75c007e10 tx=0x7ff75c00d3b0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 shutdown_connections 2023-10-14T12:19:27.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff76415e0c0 0x7ff7641e70b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7640cfa30 0x7ff76415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff74406af00 0x7ff74406d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 --2- 172.21.15.32:0/3593282171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff76415dce0 0x7ff7640c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 >> 172.21.15.32:0/3593282171 conn(0x7ff7640d15f0 msgr2=0x7ff76415ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:27.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 shutdown_connections 2023-10-14T12:19:27.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.782+0000 7ff768d38700 1 -- 172.21.15.32:0/3593282171 wait complete. 2023-10-14T12:19:27.786 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-14T12:19:27.795 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-14T12:19:27.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:27.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-14T12:19:27.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:19:27.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:27.846 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T12:19:27.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T12:19:27.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:27.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.992+0000 7f4f51fd5700 1 Processor -- start 2023-10-14T12:19:27.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.992+0000 7f4f51fd5700 1 -- start start 2023-10-14T12:19:27.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f51fd5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cd950 0x7f4f4c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f51fd5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4f4c0cede0 0x7f4f4c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:27.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f51fd5700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0cf260 con 0x7f4f4c06a840 2023-10-14T12:19:27.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f51fd5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c1619a0 con 0x7f4f4c0cede0 2023-10-14T12:19:27.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f51fd5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b2d60 con 0x7f4f4c0cd950 2023-10-14T12:19:27.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f4bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4f4c06a840 0x7f4f4c161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56386/0 (socket says 172.21.15.32:56386) 2023-10-14T12:19:27.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f4bfff700 1 -- 172.21.15.32:0/2861002654 learned_addr learned my addr 172.21.15.32:0/2861002654 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:27.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f4b7fe700 1 --2- 172.21.15.32:0/2861002654 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cd950 0x7f4f4c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f4affd700 1 --2- 172.21.15.32:0/2861002654 >> v2:172.21.15.92:3300/0 conn(0x7f4f4c0cede0 0x7f4f4c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:27.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.993+0000 7f4f4a7fc700 1 -- 172.21.15.32:0/2861002654 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843027195 0 0) 0x7f4f4c0cf260 con 0x7f4f4c06a840 2023-10-14T12:19:27.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4a7fc700 1 -- 172.21.15.32:0/2861002654 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f380035b0 con 0x7f4f4c06a840 2023-10-14T12:19:27.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/2861002654 >> v2:172.21.15.92:3300/0 conn(0x7f4f4c0cede0 msgr2=0x7f4f4c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:27.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4b7fe700 1 --2- 172.21.15.32:0/2861002654 >> v2:172.21.15.92:3300/0 conn(0x7f4f4c0cede0 0x7f4f4c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:27.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/2861002654 >> v1:172.21.15.32:6789/0 conn(0x7f4f4c06a840 legacy=0x7f4f4c161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:27.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/2861002654 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0cdd30 con 0x7f4f4c0cd950 2023-10-14T12:19:28.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4affd700 1 --2- 172.21.15.32:0/2861002654 >> v2:172.21.15.92:3300/0 conn(0x7f4f4c0cede0 0x7f4f4c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:28.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4b7fe700 1 --2- 172.21.15.32:0/2861002654 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cd950 0x7f4f4c15e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009840 tx=0x7f4f3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb5548f8ab13750 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4a7fc700 1 -- 172.21.15.32:0/2861002654 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011830 con 0x7f4f4c0cd950 2023-10-14T12:19:28.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4a7fc700 1 -- 172.21.15.32:0/2861002654 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c011990 con 0x7f4f4c0cd950 2023-10-14T12:19:28.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.994+0000 7f4f4a7fc700 1 -- 172.21.15.32:0/2861002654 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011d20 con 0x7f4f4c0cd950 2023-10-14T12:19:28.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 -- 172.21.15.32:0/2861002654 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cd950 msgr2=0x7f4f4c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/2861002654 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cd950 0x7f4f4c15e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009840 tx=0x7f4f3c009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:28.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 -- 172.21.15.32:0/2861002654 shutdown_connections 2023-10-14T12:19:28.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/2861002654 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cd950 0x7f4f4c15e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/2861002654 >> v2:172.21.15.92:3300/0 conn(0x7f4f4c0cede0 0x7f4f4c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 -- 172.21.15.32:0/2861002654 >> 172.21.15.32:0/2861002654 conn(0x7f4f4c06dae0 msgr2=0x7f4f4c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:28.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 -- 172.21.15.32:0/2861002654 shutdown_connections 2023-10-14T12:19:28.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.995+0000 7f4f51fd5700 1 -- 172.21.15.32:0/2861002654 wait complete. 2023-10-14T12:19:28.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.996+0000 7f4f51fd5700 1 Processor -- start 2023-10-14T12:19:28.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.996+0000 7f4f51fd5700 1 -- start start 2023-10-14T12:19:28.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f51fd5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 0x7f4f4c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f51fd5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f4c0cd950 0x7f4f4c0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f51fd5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cede0 0x7f4f4c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f51fd5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c1f4ba0 con 0x7f4f4c06a840 2023-10-14T12:19:28.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f51fd5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b5630 con 0x7f4f4c0cd950 2023-10-14T12:19:28.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f51fd5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b5910 con 0x7f4f4c0cede0 2023-10-14T12:19:28.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 0x7f4f4c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 0x7f4f4c0c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39364/0 (socket says 172.21.15.32:39364) 2023-10-14T12:19:28.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/4052898472 learned_addr learned my addr 172.21.15.32:0/4052898472 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:28.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4bfff700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cede0 0x7f4f4c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4affd700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f4c0cd950 0x7f4f4c0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cede0 msgr2=0x7f4f4c0b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cede0 0x7f4f4c0b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f4c0cd950 msgr2=0x7f4f4c0b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f4c0cd950 0x7f4f4c0b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 -- 172.21.15.32:0/4052898472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34009430 con 0x7f4f4c06a840 2023-10-14T12:19:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.997+0000 7f4f4b7fe700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 0x7f4f4c0c9e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0090b0 tx=0x7f4f3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.998+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0036a0 con 0x7f4f4c06a840 2023-10-14T12:19:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.998+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c01f070 con 0x7f4f4c06a840 2023-10-14T12:19:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.998+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c003a00 con 0x7f4f4c06a840 2023-10-14T12:19:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.998+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0094a0 con 0x7f4f4c06a840 2023-10-14T12:19:28.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.998+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c0b5ed0 con 0x7f4f4c06a840 2023-10-14T12:19:28.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.999+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c1f4ce0 con 0x7f4f4c06a840 2023-10-14T12:19:28.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.999+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f3c003b60 con 0x7f4f4c06a840 2023-10-14T12:19:28.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:27.999+0000 7f4f43fff700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4f2c06af00 0x7f4f2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.000+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f3c021070 con 0x7f4f4c06a840 2023-10-14T12:19:28.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.000+0000 7f4f4affd700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4f2c06af00 0x7f4f2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.000+0000 7f4f4affd700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4f2c06af00 0x7f4f2c06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0cac80 tx=0x7f4f34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.004+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f4c1f4ce0 con 0x7f4f4c06a840 2023-10-14T12:19:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.248+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f4c1f4ce0 con 0x7f4f4c06a840 2023-10-14T12:19:28.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.248+0000 7f4f43fff700 1 -- 172.21.15.32:0/4052898472 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f4f4c1f4ce0 con 0x7f4f4c06a840 2023-10-14T12:19:28.250 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:28.250 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:19:28.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4f2c06af00 msgr2=0x7f4f2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4f2c06af00 0x7f4f2c06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0cac80 tx=0x7f4f34008040 comp rx=0 tx=0).stop 2023-10-14T12:19:28.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 msgr2=0x7f4f4c0c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 0x7f4f4c0c9e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0090b0 tx=0x7f4f3c004750 comp rx=0 tx=0).stop 2023-10-14T12:19:28.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 shutdown_connections 2023-10-14T12:19:28.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f4c0cede0 0x7f4f4c0b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f4c06a840 0x7f4f4c0c9e30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f4f2c06af00 0x7f4f2c06d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 --2- 172.21.15.32:0/4052898472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f4c0cd950 0x7f4f4c0b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.250+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 >> 172.21.15.32:0/4052898472 conn(0x7f4f4c06dae0 msgr2=0x7f4f4c15d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:28.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.251+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 shutdown_connections 2023-10-14T12:19:28.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.251+0000 7f4f51fd5700 1 -- 172.21.15.32:0/4052898472 wait complete. 2023-10-14T12:19:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:19:28.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:28.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.389+0000 7f0d4e456700 1 Processor -- start 2023-10-14T12:19:28.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.389+0000 7f0d4e456700 1 -- start start 2023-10-14T12:19:28.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4e456700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4e456700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d480b7ab0 0x7f0d480ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4e456700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480b6610 con 0x7f0d48160e30 2023-10-14T12:19:28.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4e456700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d480d1da0 con 0x7f0d480b7ab0 2023-10-14T12:19:28.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4e456700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480d2080 con 0x7f0d480d08a0 2023-10-14T12:19:28.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4c9f3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d480b7ab0 0x7f0d480ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4c9f3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d480b7ab0 0x7f0d480ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39376/0 (socket says 172.21.15.32:39376) 2023-10-14T12:19:28.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d4c9f3700 1 -- 172.21.15.32:0/1801923550 learned_addr learned my addr 172.21.15.32:0/1801923550 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:28.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.390+0000 7f0d477fe700 1 --2- 172.21.15.32:0/1801923550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4c9f3700 1 -- 172.21.15.32:0/1801923550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 msgr2=0x7f0d480d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:28.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4c9f3700 1 --2- 172.21.15.32:0/1801923550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4c9f3700 1 -- 172.21.15.32:0/1801923550 >> v1:172.21.15.92:6789/0 conn(0x7f0d48160e30 legacy=0x7f0d480d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4c9f3700 1 -- 172.21.15.32:0/1801923550 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480d2360 con 0x7f0d480b7ab0 2023-10-14T12:19:28.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4c9f3700 1 --2- 172.21.15.32:0/1801923550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d480ce3d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009e50 tx=0x7f0d4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e4388ba6ebcbdb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d46ffd700 1 -- 172.21.15.32:0/1801923550 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000e070 con 0x7f0d480b7ab0 2023-10-14T12:19:28.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d46ffd700 1 -- 172.21.15.32:0/1801923550 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000b9c0 con 0x7f0d480b7ab0 2023-10-14T12:19:28.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d46ffd700 1 -- 172.21.15.32:0/1801923550 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000bd70 con 0x7f0d480b7ab0 2023-10-14T12:19:28.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4e456700 1 -- 172.21.15.32:0/1801923550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 msgr2=0x7f0d480ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.391+0000 7f0d4e456700 1 --2- 172.21.15.32:0/1801923550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d480ce3d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009e50 tx=0x7f0d4000b330 comp rx=0 tx=0).stop 2023-10-14T12:19:28.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.392+0000 7f0d4e456700 1 -- 172.21.15.32:0/1801923550 shutdown_connections 2023-10-14T12:19:28.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.392+0000 7f0d4e456700 1 --2- 172.21.15.32:0/1801923550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d480ce3d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.392+0000 7f0d4e456700 1 --2- 172.21.15.32:0/1801923550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.392+0000 7f0d4e456700 1 -- 172.21.15.32:0/1801923550 >> 172.21.15.32:0/1801923550 conn(0x7f0d4809cb40 msgr2=0x7f0d480d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:28.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.392+0000 7f0d4e456700 1 -- 172.21.15.32:0/1801923550 shutdown_connections 2023-10-14T12:19:28.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.392+0000 7f0d4e456700 1 -- 172.21.15.32:0/1801923550 wait complete. 2023-10-14T12:19:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.393+0000 7f0d4e456700 1 Processor -- start 2023-10-14T12:19:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.393+0000 7f0d4e456700 1 -- start start 2023-10-14T12:19:28.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d4814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48160e30 0x7f0d480b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814d730 con 0x7f0d480b7ab0 2023-10-14T12:19:28.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814cb80 con 0x7f0d48160e30 2023-10-14T12:19:28.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814cd90 con 0x7f0d480d08a0 2023-10-14T12:19:28.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d4814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d4814c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39378/0 (socket says 172.21.15.32:39378) 2023-10-14T12:19:28.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 -- 172.21.15.32:0/4273693375 learned_addr learned my addr 172.21.15.32:0/4273693375 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:28.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4c9f3700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48160e30 0x7f0d480b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d477fe700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 -- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 msgr2=0x7f0d480b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 -- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48160e30 msgr2=0x7f0d480b8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48160e30 0x7f0d480b8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 -- 172.21.15.32:0/4273693375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009b30 con 0x7f0d480b7ab0 2023-10-14T12:19:28.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4c9f3700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48160e30 0x7f0d480b8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:28.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d47fff700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d4814c300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c4d0 tx=0x7f0d3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300052d0 con 0x7f0d480b7ab0 2023-10-14T12:19:28.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30005430 con 0x7f0d480b7ab0 2023-10-14T12:19:28.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300038f0 con 0x7f0d480b7ab0 2023-10-14T12:19:28.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4814d070 con 0x7f0d480b7ab0 2023-10-14T12:19:28.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.394+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4814c840 con 0x7f0d480b7ab0 2023-10-14T12:19:28.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.395+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d480a1500 con 0x7f0d480b7ab0 2023-10-14T12:19:28.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.396+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d30003a50 con 0x7f0d480b7ab0 2023-10-14T12:19:28.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.396+0000 7f0d44ff9700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d2806af00 0x7f0d2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.397+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d30088990 con 0x7f0d480b7ab0 2023-10-14T12:19:28.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.397+0000 7f0d477fe700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d2806af00 0x7f0d2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.397+0000 7f0d477fe700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d2806af00 0x7f0d2806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d4809d560 tx=0x7f0d38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.401+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d30053ad0 con 0x7f0d480b7ab0 2023-10-14T12:19:28.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.603+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d48067d20 con 0x7f0d480b7ab0 2023-10-14T12:19:28.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.604+0000 7f0d44ff9700 1 -- 172.21.15.32:0/4273693375 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f0d30017090 con 0x7f0d480b7ab0 2023-10-14T12:19:28.605 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:28.606 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:28.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d2806af00 msgr2=0x7f0d2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d2806af00 0x7f0d2806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d4809d560 tx=0x7f0d38008040 comp rx=0 tx=0).stop 2023-10-14T12:19:28.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 msgr2=0x7f0d4814c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d4814c300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c4d0 tx=0x7f0d3000c890 comp rx=0 tx=0).stop 2023-10-14T12:19:28.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 shutdown_connections 2023-10-14T12:19:28.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0d2806af00 0x7f0d2806d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d48160e30 0x7f0d480b8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d480b7ab0 0x7f0d4814c300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 --2- 172.21.15.32:0/4273693375 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d480d08a0 0x7f0d480b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 >> 172.21.15.32:0/4273693375 conn(0x7f0d4809cb40 msgr2=0x7f0d480ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:28.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 shutdown_connections 2023-10-14T12:19:28.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.606+0000 7f0d4e456700 1 -- 172.21.15.32:0/4273693375 wait complete. 2023-10-14T12:19:28.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:18:45.023238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:18:45.871697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:28.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:28.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 Processor -- start 2023-10-14T12:19:28.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 -- start start 2023-10-14T12:19:28.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3d6815e030 0x7f3d680cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d6806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6806adb0 con 0x7f3d6806a840 2023-10-14T12:19:28.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6806b090 con 0x7f3d6815e030 2023-10-14T12:19:28.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.748+0000 7f3d6e048700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6806b370 con 0x7f3d680ce280 2023-10-14T12:19:28.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3d6815e030 0x7f3d680cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3d6815e030 0x7f3d680cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39386/0 (socket says 172.21.15.32:39386) 2023-10-14T12:19:28.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 -- 172.21.15.32:0/932300952 learned_addr learned my addr 172.21.15.32:0/932300952 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:28.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d67fff700 1 --2- 172.21.15.32:0/932300952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d6806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 -- 172.21.15.32:0/932300952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 msgr2=0x7f3d6806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 --2- 172.21.15.32:0/932300952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d6806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 -- 172.21.15.32:0/932300952 >> v1:172.21.15.92:6789/0 conn(0x7f3d6806a840 legacy=0x7f3d680cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 -- 172.21.15.32:0/932300952 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6806b650 con 0x7f3d6815e030 2023-10-14T12:19:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d677fe700 1 --2- 172.21.15.32:0/932300952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680cb3a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098f0 tx=0x7f3d50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e72b773e1cbd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d667fc700 1 -- 172.21.15.32:0/932300952 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000b8a0 con 0x7f3d6815e030 2023-10-14T12:19:28.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d667fc700 1 -- 172.21.15.32:0/932300952 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5000ba00 con 0x7f3d6815e030 2023-10-14T12:19:28.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.749+0000 7f3d667fc700 1 -- 172.21.15.32:0/932300952 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000bd90 con 0x7f3d6815e030 2023-10-14T12:19:28.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 -- 172.21.15.32:0/932300952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 msgr2=0x7f3d680cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 --2- 172.21.15.32:0/932300952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680cb3a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098f0 tx=0x7f3d50009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:28.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 -- 172.21.15.32:0/932300952 shutdown_connections 2023-10-14T12:19:28.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 --2- 172.21.15.32:0/932300952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d6806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 --2- 172.21.15.32:0/932300952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680cb3a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 -- 172.21.15.32:0/932300952 >> 172.21.15.32:0/932300952 conn(0x7f3d680cc6f0 msgr2=0x7f3d680ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:28.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 -- 172.21.15.32:0/932300952 shutdown_connections 2023-10-14T12:19:28.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.750+0000 7f3d6e048700 1 -- 172.21.15.32:0/932300952 wait complete. 2023-10-14T12:19:28.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.751+0000 7f3d6e048700 1 Processor -- start 2023-10-14T12:19:28.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.751+0000 7f3d6e048700 1 -- start start 2023-10-14T12:19:28.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d6e048700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6806a840 0x7f3d680c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d6e048700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d68158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d6e048700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d6e048700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c9710 con 0x7f3d6815e030 2023-10-14T12:19:28.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d6e048700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c8130 con 0x7f3d6806a840 2023-10-14T12:19:28.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d6e048700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c8410 con 0x7f3d680ce280 2023-10-14T12:19:28.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39396/0 (socket says 172.21.15.32:39396) 2023-10-14T12:19:28.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 -- 172.21.15.32:0/3570498634 learned_addr learned my addr 172.21.15.32:0/3570498634 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:28.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d677fe700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6806a840 0x7f3d680c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d66ffd700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d68158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 -- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 msgr2=0x7f3d68158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d68158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 -- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6806a840 msgr2=0x7f3d680c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6806a840 0x7f3d680c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d67fff700 1 -- 172.21.15.32:0/3570498634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009550 con 0x7f3d6815e030 2023-10-14T12:19:28.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.752+0000 7f3d677fe700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6806a840 0x7f3d680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:28.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.753+0000 7f3d67fff700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680c7700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3d60007de0 tx=0x7f3d6000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.753+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000ede0 con 0x7f3d6815e030 2023-10-14T12:19:28.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.753+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60014420 con 0x7f3d6815e030 2023-10-14T12:19:28.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.753+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600147d0 con 0x7f3d6815e030 2023-10-14T12:19:28.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.753+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d680c86f0 con 0x7f3d6815e030 2023-10-14T12:19:28.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.753+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d680c8cb0 con 0x7f3d6815e030 2023-10-14T12:19:28.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.754+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d68067d20 con 0x7f3d6815e030 2023-10-14T12:19:28.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.754+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d60014930 con 0x7f3d6815e030 2023-10-14T12:19:28.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.755+0000 7f3d5ffff700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3d4806af00 0x7f3d4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:28.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.755+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d60089d50 con 0x7f3d6815e030 2023-10-14T12:19:28.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.755+0000 7f3d677fe700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3d4806af00 0x7f3d4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:28.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.755+0000 7f3d677fe700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3d4806af00 0x7f3d4806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098f0 tx=0x7f3d50008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:28.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.759+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d6008d030 con 0x7f3d6815e030 2023-10-14T12:19:28.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.957+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d68066a30 con 0x7f3d6815e030 2023-10-14T12:19:28.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.957+0000 7f3d5ffff700 1 -- 172.21.15.32:0/3570498634 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d60054e00 con 0x7f3d6815e030 2023-10-14T12:19:28.959 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:28.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3d4806af00 msgr2=0x7f3d4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3d4806af00 0x7f3d4806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098f0 tx=0x7f3d50008030 comp rx=0 tx=0).stop 2023-10-14T12:19:28.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 msgr2=0x7f3d680c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:28.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680c7700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3d60007de0 tx=0x7f3d6000e3c0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 shutdown_connections 2023-10-14T12:19:28.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d6815e030 0x7f3d680c7700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3d4806af00 0x7f3d4806d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d6806a840 0x7f3d680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 --2- 172.21.15.32:0/3570498634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d680ce280 0x7f3d68158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:28.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.959+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 >> 172.21.15.32:0/3570498634 conn(0x7f3d680cc6f0 msgr2=0x7f3d680ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:28.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.960+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 shutdown_connections 2023-10-14T12:19:28.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:28.960+0000 7f3d6e048700 1 -- 172.21.15.32:0/3570498634 wait complete. 2023-10-14T12:19:28.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:19:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.099+0000 7f7b48ba9700 1 Processor -- start 2023-10-14T12:19:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.099+0000 7f7b48ba9700 1 -- start start 2023-10-14T12:19:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b48ba9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b4415e2f0 0x7f7b440cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b48ba9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7b4406a840 0x7f7b4406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b48ba9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4406b1a0 con 0x7f7b440cd950 2023-10-14T12:19:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b48ba9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b441619a0 con 0x7f7b4415e2f0 2023-10-14T12:19:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b48ba9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440b2d60 con 0x7f7b4406a840 2023-10-14T12:19:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b41d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b4415e2f0 0x7f7b440cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b4259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7b440cd950 0x7f7b4415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56424/0 (socket says 172.21.15.32:56424) 2023-10-14T12:19:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b4259c700 1 -- 172.21.15.32:0/2284449102 learned_addr learned my addr 172.21.15.32:0/2284449102 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b42d9d700 1 --2- 172.21.15.32:0/2284449102 >> v2:172.21.15.92:3300/0 conn(0x7f7b4406a840 0x7f7b4406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b41d9b700 1 -- 172.21.15.32:0/2284449102 >> v2:172.21.15.92:3300/0 conn(0x7f7b4406a840 msgr2=0x7f7b4406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b41d9b700 1 --2- 172.21.15.32:0/2284449102 >> v2:172.21.15.92:3300/0 conn(0x7f7b4406a840 0x7f7b4406ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b41d9b700 1 -- 172.21.15.32:0/2284449102 >> v1:172.21.15.32:6789/0 conn(0x7f7b440cd950 legacy=0x7f7b4415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b41d9b700 1 -- 172.21.15.32:0/2284449102 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440cdd30 con 0x7f7b4415e2f0 2023-10-14T12:19:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b4159a700 1 -- 172.21.15.32:0/2284449102 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679575885 0 0) 0x7f7b4406b1a0 con 0x7f7b440cd950 2023-10-14T12:19:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.100+0000 7f7b41d9b700 1 --2- 172.21.15.32:0/2284449102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b440cede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7b440afed0 tx=0x7f7b34009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482be1d651411a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b4159a700 1 -- 172.21.15.32:0/2284449102 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34005e30 con 0x7f7b4415e2f0 2023-10-14T12:19:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b4159a700 1 -- 172.21.15.32:0/2284449102 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34006030 con 0x7f7b4415e2f0 2023-10-14T12:19:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b4159a700 1 -- 172.21.15.32:0/2284449102 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340063c0 con 0x7f7b4415e2f0 2023-10-14T12:19:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2284449102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 msgr2=0x7f7b440cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2284449102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b440cede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7b440afed0 tx=0x7f7b34009b00 comp rx=0 tx=0).stop 2023-10-14T12:19:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2284449102 shutdown_connections 2023-10-14T12:19:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2284449102 >> v2:172.21.15.92:3300/0 conn(0x7f7b4406a840 0x7f7b4406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2284449102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b440cede0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2284449102 >> 172.21.15.32:0/2284449102 conn(0x7f7b4406dae0 msgr2=0x7f7b4406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2284449102 shutdown_connections 2023-10-14T12:19:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.101+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2284449102 wait complete. 2023-10-14T12:19:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 Processor -- start 2023-10-14T12:19:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 -- start start 2023-10-14T12:19:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4406a840 0x7f7b440af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b440cd950 0x7f7b4415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b4415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4415c230 con 0x7f7b4415e2f0 2023-10-14T12:19:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440c6ef0 con 0x7f7b4406a840 2023-10-14T12:19:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.103+0000 7f7b48ba9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440af590 con 0x7f7b440cd950 2023-10-14T12:19:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b4415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b4415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39410/0 (socket says 172.21.15.32:39410) 2023-10-14T12:19:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 -- 172.21.15.32:0/2181234166 learned_addr learned my addr 172.21.15.32:0/2181234166 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:29.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b4259c700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4406a840 0x7f7b440af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b41d9b700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b440cd950 0x7f7b4415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 -- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b440cd950 msgr2=0x7f7b4415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b440cd950 0x7f7b4415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 -- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4406a840 msgr2=0x7f7b440af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4406a840 0x7f7b440af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 -- 172.21.15.32:0/2181234166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009430 con 0x7f7b4415e2f0 2023-10-14T12:19:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b42d9d700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b4415bcf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00cd70 tx=0x7f7b3c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c003a20 con 0x7f7b4415e2f0 2023-10-14T12:19:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c003b80 con 0x7f7b4415e2f0 2023-10-14T12:19:29.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c004020 con 0x7f7b4415e2f0 2023-10-14T12:19:29.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b440c6650 con 0x7f7b4415e2f0 2023-10-14T12:19:29.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.104+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b440af860 con 0x7f7b4415e2f0 2023-10-14T12:19:29.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.105+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b44067d20 con 0x7f7b4415e2f0 2023-10-14T12:19:29.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.106+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b3c004180 con 0x7f7b4415e2f0 2023-10-14T12:19:29.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.106+0000 7f7b32ffd700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7b2406af00 0x7f7b2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.106+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b3c012070 con 0x7f7b4415e2f0 2023-10-14T12:19:29.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.106+0000 7f7b4259c700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7b2406af00 0x7f7b2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.107+0000 7f7b4259c700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7b2406af00 0x7f7b2406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b38000f60 tx=0x7f7b38007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.110+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b3c054f00 con 0x7f7b4415e2f0 2023-10-14T12:19:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.312+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b440ce680 con 0x7f7b4415e2f0 2023-10-14T12:19:29.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.312+0000 7f7b32ffd700 1 -- 172.21.15.32:0/2181234166 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b3c058520 con 0x7f7b4415e2f0 2023-10-14T12:19:29.314 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-14T12:19:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7b2406af00 msgr2=0x7f7b2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7b2406af00 0x7f7b2406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b38000f60 tx=0x7f7b38007be0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 msgr2=0x7f7b4415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b4415bcf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00cd70 tx=0x7f7b3c00a570 comp rx=0 tx=0).stop 2023-10-14T12:19:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 shutdown_connections 2023-10-14T12:19:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b4415e2f0 0x7f7b4415bcf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f7b2406af00 0x7f7b2406d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b4406a840 0x7f7b440af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 --2- 172.21.15.32:0/2181234166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b440cd950 0x7f7b4415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 >> 172.21.15.32:0/2181234166 conn(0x7f7b4406dae0 msgr2=0x7f7b4406ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 shutdown_connections 2023-10-14T12:19:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.314+0000 7f7b48ba9700 1 -- 172.21.15.32:0/2181234166 wait complete. 2023-10-14T12:19:29.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:19:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.455+0000 7f7479d27700 1 Processor -- start 2023-10-14T12:19:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.455+0000 7f7479d27700 1 -- start start 2023-10-14T12:19:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f7479d27700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f747415f1f0 0x7f74740cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f7479d27700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747415e7a0 con 0x7f747415ab10 2023-10-14T12:19:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f7479d27700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74740d0090 con 0x7f74740cfc60 2023-10-14T12:19:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f7479d27700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740b29a0 con 0x7f747415f1f0 2023-10-14T12:19:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74737fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f747415ab10 0x7f74740b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56438/0 (socket says 172.21.15.32:56438) 2023-10-14T12:19:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74737fe700 1 -- 172.21.15.32:0/2066257635 learned_addr learned my addr 172.21.15.32:0/2066257635 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f7472ffd700 1 --2- 172.21.15.32:0/2066257635 >> v2:172.21.15.92:3300/0 conn(0x7f747415f1f0 0x7f74740cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935394356 0 0) 0x7f747415e7a0 con 0x7f747415ab10 2023-10-14T12:19:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c0035b0 con 0x7f747415ab10 2023-10-14T12:19:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84600152 0 0) 0x7f745c0035b0 con 0x7f747415ab10 2023-10-14T12:19:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 >> v2:172.21.15.92:3300/0 conn(0x7f747415f1f0 msgr2=0x7f74740cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 --2- 172.21.15.32:0/2066257635 >> v2:172.21.15.92:3300/0 conn(0x7f747415f1f0 0x7f74740cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 >> v1:172.21.15.92:6789/0 conn(0x7f74740cfc60 legacy=0x7f74740cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740b2c80 con 0x7f747415ab10 2023-10-14T12:19:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f7464001670 con 0x7f747415ab10 2023-10-14T12:19:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 >> v1:172.21.15.32:6789/0 conn(0x7f747415ab10 legacy=0x7f74740b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f745c003a00 0x7f745c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004850 0x7f745c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c005210 0x7f745c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740b29a0 con 0x7f745c005210 2023-10-14T12:19:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00c0b0 con 0x7f745c004850 2023-10-14T12:19:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00c270 con 0x7f745c003a00 2023-10-14T12:19:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.456+0000 7f7473fff700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c005210 0x7f745c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7472ffd700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004850 0x7f745c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f74737fe700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f745c003a00 0x7f745c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 -- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f745c003a00 msgr2=0x7f745c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f745c003a00 0x7f745c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 -- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004850 msgr2=0x7f745c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004850 0x7f745c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 -- 172.21.15.32:0/2066257635 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0035b0 con 0x7f745c005210 2023-10-14T12:19:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 -- 172.21.15.32:0/2066257635 reap_dead start 2023-10-14T12:19:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f7473fff700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c005210 0x7f745c00ba10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c190 tx=0x7f745c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ff4193bc591ced server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c001db0 con 0x7f745c005210 2023-10-14T12:19:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00ccf0 con 0x7f745c005210 2023-10-14T12:19:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.457+0000 7f74727fc700 1 -- 172.21.15.32:0/2066257635 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c003c40 con 0x7f745c005210 2023-10-14T12:19:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 -- 172.21.15.32:0/2066257635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c005210 msgr2=0x7f745c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c005210 0x7f745c00ba10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c190 tx=0x7f745c005880 comp rx=0 tx=0).stop 2023-10-14T12:19:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 -- 172.21.15.32:0/2066257635 shutdown_connections 2023-10-14T12:19:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 --2- 172.21.15.32:0/2066257635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c005210 0x7f745c00ba10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 -- 172.21.15.32:0/2066257635 >> 172.21.15.32:0/2066257635 conn(0x7f747406dae0 msgr2=0x7f747406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 -- 172.21.15.32:0/2066257635 shutdown_connections 2023-10-14T12:19:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.458+0000 7f7479d27700 1 -- 172.21.15.32:0/2066257635 wait complete. 2023-10-14T12:19:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.459+0000 7f7479d27700 1 Processor -- start 2023-10-14T12:19:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.459+0000 7f7479d27700 1 -- start start 2023-10-14T12:19:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7479d27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c005210 0x7f74740b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7479d27700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 0x7f74740c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7479d27700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f747415a0f0 0x7f74740c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7479d27700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740b0970 con 0x7f7474159c70 2023-10-14T12:19:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7479d27700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740b0c10 con 0x7f745c005210 2023-10-14T12:19:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7479d27700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740b0ef0 con 0x7f747415a0f0 2023-10-14T12:19:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 0x7f74740c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 0x7f74740c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39428/0 (socket says 172.21.15.32:39428) 2023-10-14T12:19:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 -- 172.21.15.32:0/3217983713 learned_addr learned my addr 172.21.15.32:0/3217983713 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f74737fe700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c005210 0x7f74740b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7473fff700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f747415a0f0 0x7f74740c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 -- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f747415a0f0 msgr2=0x7f74740c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f747415a0f0 0x7f74740c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 -- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c005210 msgr2=0x7f74740b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c005210 0x7f74740b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 -- 172.21.15.32:0/3217983713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740b11d0 con 0x7f7474159c70 2023-10-14T12:19:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.460+0000 7f7472ffd700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 0x7f74740c6000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7468009fd0 tx=0x7f7468011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.461+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468009610 con 0x7f7474159c70 2023-10-14T12:19:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.461+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7468005c30 con 0x7f7474159c70 2023-10-14T12:19:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.461+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74740b14b0 con 0x7f7474159c70 2023-10-14T12:19:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.461+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800f6b0 con 0x7f7474159c70 2023-10-14T12:19:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.461+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74740b24f0 con 0x7f7474159c70 2023-10-14T12:19:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.461+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74740b1820 con 0x7f7474159c70 2023-10-14T12:19:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.462+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f746800f810 con 0x7f7474159c70 2023-10-14T12:19:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.462+0000 7f745bfff700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f746006af00 0x7f746006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.462+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7468089c90 con 0x7f7474159c70 2023-10-14T12:19:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.463+0000 7f74737fe700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f746006af00 0x7f746006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.463+0000 7f74737fe700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f746006af00 0x7f746006d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7464001200 tx=0x7f7464009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.467+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7468054dd0 con 0x7f7474159c70 2023-10-14T12:19:29.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.668+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74740b2740 con 0x7f7474159c70 2023-10-14T12:19:29.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.668+0000 7f745bfff700 1 -- 172.21.15.32:0/3217983713 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7468021020 con 0x7f7474159c70 2023-10-14T12:19:29.670 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-14T12:19:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f746006af00 msgr2=0x7f746006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f746006af00 0x7f746006d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7464001200 tx=0x7f7464009040 comp rx=0 tx=0).stop 2023-10-14T12:19:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 msgr2=0x7f74740c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 0x7f74740c6000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7468009fd0 tx=0x7f7468011d30 comp rx=0 tx=0).stop 2023-10-14T12:19:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 shutdown_connections 2023-10-14T12:19:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f747415a0f0 0x7f74740c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f746006af00 0x7f746006d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c005210 0x7f74740b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 --2- 172.21.15.32:0/3217983713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7474159c70 0x7f74740c6000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 >> 172.21.15.32:0/3217983713 conn(0x7f747406dae0 msgr2=0x7f74740b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:29.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 shutdown_connections 2023-10-14T12:19:29.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.670+0000 7f7479d27700 1 -- 172.21.15.32:0/3217983713 wait complete. 2023-10-14T12:19:29.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:29.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.807+0000 7f431b661700 1 Processor -- start 2023-10-14T12:19:29.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.808+0000 7f431b661700 1 -- start start 2023-10-14T12:19:29.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.808+0000 7f431b661700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.808+0000 7f431b661700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43140cfc60 0x7f43140cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.808+0000 7f431b661700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431415e7a0 con 0x7f431415ab10 2023-10-14T12:19:29.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.808+0000 7f431b661700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43140d00d0 con 0x7f43140cfc60 2023-10-14T12:19:29.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.808+0000 7f431b661700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b29a0 con 0x7f431415f1f0 2023-10-14T12:19:29.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f43193fd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f431415ab10 0x7f43140b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56458/0 (socket says 172.21.15.32:56458) 2023-10-14T12:19:29.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f43193fd700 1 -- 172.21.15.32:0/3978094876 learned_addr learned my addr 172.21.15.32:0/3978094876 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:29.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4319bfe700 1 --2- 172.21.15.32:0/3978094876 >> v2:172.21.15.32:3300/0 conn(0x7f43140cfc60 0x7f43140cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4318bfc700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f430bfff700 1 -- 172.21.15.32:0/3978094876 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148860064 0 0) 0x7f431415e7a0 con 0x7f431415ab10 2023-10-14T12:19:29.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4319bfe700 1 -- 172.21.15.32:0/3978094876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 msgr2=0x7f43140cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:29.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4319bfe700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4319bfe700 1 -- 172.21.15.32:0/3978094876 >> v1:172.21.15.32:6789/0 conn(0x7f431415ab10 legacy=0x7f43140b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4319bfe700 1 -- 172.21.15.32:0/3978094876 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43140b2c80 con 0x7f43140cfc60 2023-10-14T12:19:29.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4318bfc700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:29.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f4319bfe700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43140cfc60 0x7f43140cbf40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f430c009d90 tx=0x7f430c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dbb410cca712dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f430bfff700 1 -- 172.21.15.32:0/3978094876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c00e070 con 0x7f43140cfc60 2023-10-14T12:19:29.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f430bfff700 1 -- 172.21.15.32:0/3978094876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430c00bbd0 con 0x7f43140cfc60 2023-10-14T12:19:29.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.809+0000 7f430bfff700 1 -- 172.21.15.32:0/3978094876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c012430 con 0x7f43140cfc60 2023-10-14T12:19:29.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 -- 172.21.15.32:0/3978094876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43140cfc60 msgr2=0x7f43140cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43140cfc60 0x7f43140cbf40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f430c009d90 tx=0x7f430c00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 -- 172.21.15.32:0/3978094876 shutdown_connections 2023-10-14T12:19:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43140cfc60 0x7f43140cbf40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 --2- 172.21.15.32:0/3978094876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 -- 172.21.15.32:0/3978094876 >> 172.21.15.32:0/3978094876 conn(0x7f431406dae0 msgr2=0x7f431406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:29.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 -- 172.21.15.32:0/3978094876 shutdown_connections 2023-10-14T12:19:29.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.810+0000 7f431b661700 1 -- 172.21.15.32:0/3978094876 wait complete. 2023-10-14T12:19:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.811+0000 7f431b661700 1 Processor -- start 2023-10-14T12:19:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.811+0000 7f431b661700 1 -- start start 2023-10-14T12:19:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f431b661700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43140cfc60 0x7f43141569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f431b661700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 0x7f43140c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f431b661700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f431b661700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43140c6f00 con 0x7f431415ab10 2023-10-14T12:19:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f431b661700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b1250 con 0x7f43140cfc60 2023-10-14T12:19:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f431b661700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b1530 con 0x7f431415f1f0 2023-10-14T12:19:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 0x7f43140c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 0x7f43140c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39442/0 (socket says 172.21.15.32:39442) 2023-10-14T12:19:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 -- 172.21.15.32:0/2605227302 learned_addr learned my addr 172.21.15.32:0/2605227302 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4319bfe700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f43193fd700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43140cfc60 0x7f43141569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 -- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 msgr2=0x7f43140c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 -- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43140cfc60 msgr2=0x7f43141569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43140cfc60 0x7f43141569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 -- 172.21.15.32:0/2605227302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c009a70 con 0x7f431415ab10 2023-10-14T12:19:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f43193fd700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43140cfc60 0x7f43141569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4319bfe700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.812+0000 7f4318bfc700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 0x7f43140c4150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f431000c7f0 tx=0x7f431000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.813+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310005c20 con 0x7f431415ab10 2023-10-14T12:19:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.813+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310005d80 con 0x7f431415ab10 2023-10-14T12:19:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.813+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43140b1810 con 0x7f431415ab10 2023-10-14T12:19:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.813+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310011800 con 0x7f431415ab10 2023-10-14T12:19:29.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.813+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4314156f10 con 0x7f431415ab10 2023-10-14T12:19:29.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.814+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4314067d20 con 0x7f431415ab10 2023-10-14T12:19:29.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.814+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4310011960 con 0x7f431415ab10 2023-10-14T12:19:29.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.814+0000 7f4309ffb700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f42f806af00 0x7f42f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:29.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.815+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4310089910 con 0x7f431415ab10 2023-10-14T12:19:29.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.815+0000 7f43193fd700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f42f806af00 0x7f42f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:29.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.815+0000 7f43193fd700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f42f806af00 0x7f42f806d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4304007fd0 tx=0x7f4304009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:29.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:29.819+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43100549c0 con 0x7f431415ab10 2023-10-14T12:19:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.061+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43140afc10 con 0x7f431415ab10 2023-10-14T12:19:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.062+0000 7f4309ffb700 1 -- 172.21.15.32:0/2605227302 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f4310057fe0 con 0x7f431415ab10 2023-10-14T12:19:30.064 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:19:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f42f806af00 msgr2=0x7f42f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f42f806af00 0x7f42f806d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4304007fd0 tx=0x7f4304009040 comp rx=0 tx=0).stop 2023-10-14T12:19:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 msgr2=0x7f43140c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 0x7f43140c4150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f431000c7f0 tx=0x7f431000cbb0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 shutdown_connections 2023-10-14T12:19:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f431415f1f0 0x7f43140c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f42f806af00 0x7f42f806d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43140cfc60 0x7f43141569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 --2- 172.21.15.32:0/2605227302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f431415ab10 0x7f43140c4150 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 >> 172.21.15.32:0/2605227302 conn(0x7f431406dae0 msgr2=0x7f43140b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 shutdown_connections 2023-10-14T12:19:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.065+0000 7f431b661700 1 -- 172.21.15.32:0/2605227302 wait complete. 2023-10-14T12:19:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:19:30.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:30.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.202+0000 7fe7c6700700 1 Processor -- start 2023-10-14T12:19:30.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.203+0000 7fe7c6700700 1 -- start start 2023-10-14T12:19:30.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.203+0000 7fe7c6700700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7c00cd950 0x7fe7c015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.203+0000 7fe7c6700700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe7c00cede0 0x7fe7c015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.203+0000 7fe7c6700700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00cf290 con 0x7fe7c006a840 2023-10-14T12:19:30.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.203+0000 7fe7c6700700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c01619a0 con 0x7fe7c00cd950 2023-10-14T12:19:30.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.203+0000 7fe7c6700700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00b2d60 con 0x7fe7c00cede0 2023-10-14T12:19:30.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7c00cd950 0x7fe7c015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7c4c9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe7c006a840 0x7fe7c0161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56476/0 (socket says 172.21.15.32:56476) 2023-10-14T12:19:30.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7c4c9d700 1 -- 172.21.15.32:0/1128966385 learned_addr learned my addr 172.21.15.32:0/1128966385 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:30.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bf7fe700 1 --2- 172.21.15.32:0/1128966385 >> v2:172.21.15.92:3300/0 conn(0x7fe7c00cede0 0x7fe7c015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bffff700 1 -- 172.21.15.32:0/1128966385 >> v2:172.21.15.92:3300/0 conn(0x7fe7c00cede0 msgr2=0x7fe7c015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:30.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bffff700 1 --2- 172.21.15.32:0/1128966385 >> v2:172.21.15.92:3300/0 conn(0x7fe7c00cede0 0x7fe7c015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bffff700 1 -- 172.21.15.32:0/1128966385 >> v1:172.21.15.32:6789/0 conn(0x7fe7c006a840 legacy=0x7fe7c0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7beffd700 1 -- 172.21.15.32:0/1128966385 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074843437 0 0) 0x7fe7c00cf290 con 0x7fe7c006a840 2023-10-14T12:19:30.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bffff700 1 -- 172.21.15.32:0/1128966385 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00cdd30 con 0x7fe7c00cd950 2023-10-14T12:19:30.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7bffff700 1 --2- 172.21.15.32:0/1128966385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c00cd950 0x7fe7c015e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0161ae0 tx=0x7fe7b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2351cbb51374ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7beffd700 1 -- 172.21.15.32:0/1128966385 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0004020 con 0x7fe7c00cd950 2023-10-14T12:19:30.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7beffd700 1 -- 172.21.15.32:0/1128966385 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0004180 con 0x7fe7c00cd950 2023-10-14T12:19:30.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.204+0000 7fe7beffd700 1 -- 172.21.15.32:0/1128966385 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0004530 con 0x7fe7c00cd950 2023-10-14T12:19:30.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 -- 172.21.15.32:0/1128966385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c00cd950 msgr2=0x7fe7c015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 --2- 172.21.15.32:0/1128966385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c00cd950 0x7fe7c015e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0161ae0 tx=0x7fe7b0009b20 comp rx=0 tx=0).stop 2023-10-14T12:19:30.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 -- 172.21.15.32:0/1128966385 shutdown_connections 2023-10-14T12:19:30.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 --2- 172.21.15.32:0/1128966385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c00cd950 0x7fe7c015e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 --2- 172.21.15.32:0/1128966385 >> v2:172.21.15.92:3300/0 conn(0x7fe7c00cede0 0x7fe7c015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 -- 172.21.15.32:0/1128966385 >> 172.21.15.32:0/1128966385 conn(0x7fe7c006dae0 msgr2=0x7fe7c006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:30.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 -- 172.21.15.32:0/1128966385 shutdown_connections 2023-10-14T12:19:30.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.205+0000 7fe7c6700700 1 -- 172.21.15.32:0/1128966385 wait complete. 2023-10-14T12:19:30.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.206+0000 7fe7c6700700 1 Processor -- start 2023-10-14T12:19:30.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.206+0000 7fe7c6700700 1 -- start start 2023-10-14T12:19:30.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c6700700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 0x7fe7c0153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c6700700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c00cd950 0x7fe7c00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c6700700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7c00cede0 0x7fe7c00afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c6700700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01543c0 con 0x7fe7c006a840 2023-10-14T12:19:30.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c6700700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0155da0 con 0x7fe7c00cd950 2023-10-14T12:19:30.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c6700700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0156080 con 0x7fe7c00cede0 2023-10-14T12:19:30.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 0x7fe7c0153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 0x7fe7c0153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39454/0 (socket says 172.21.15.32:39454) 2023-10-14T12:19:30.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 -- 172.21.15.32:0/3332153742 learned_addr learned my addr 172.21.15.32:0/3332153742 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:30.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bf7fe700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c00cd950 0x7fe7c00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c4c9d700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7c00cede0 0x7fe7c00afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 -- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7c00cede0 msgr2=0x7fe7c00afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7c00cede0 0x7fe7c00afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 -- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c00cd950 msgr2=0x7fe7c00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c00cd950 0x7fe7c00c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 -- 172.21.15.32:0/3332153742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00094a0 con 0x7fe7c006a840 2023-10-14T12:19:30.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7c4c9d700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7c00cede0 0x7fe7c00afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:30.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.207+0000 7fe7bffff700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 0x7fe7c0153910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00090b0 tx=0x7fe7b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.208+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0011e50 con 0x7fe7c006a840 2023-10-14T12:19:30.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.208+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b00036a0 con 0x7fe7c006a840 2023-10-14T12:19:30.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.208+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c0156360 con 0x7fe7c006a840 2023-10-14T12:19:30.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.208+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0003a50 con 0x7fe7c006a840 2023-10-14T12:19:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.208+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c0156920 con 0x7fe7c006a840 2023-10-14T12:19:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.209+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0067d20 con 0x7fe7c006a840 2023-10-14T12:19:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.209+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7b0003bb0 con 0x7fe7c006a840 2023-10-14T12:19:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.209+0000 7fe7bcff9700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe7ac06af00 0x7fe7ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.210+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7b008aa80 con 0x7fe7c006a840 2023-10-14T12:19:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.210+0000 7fe7bf7fe700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe7ac06af00 0x7fe7ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.210+0000 7fe7bf7fe700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe7ac06af00 0x7fe7ac06d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7c01f6a30 tx=0x7fe7b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.214+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7b0055bc0 con 0x7fe7c006a840 2023-10-14T12:19:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.416+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7c00c9ba0 con 0x7fe7c006a840 2023-10-14T12:19:30.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.417+0000 7fe7bcff9700 1 -- 172.21.15.32:0/3332153742 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fe7b00591e0 con 0x7fe7c006a840 2023-10-14T12:19:30.419 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:30.419 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe7ac06af00 msgr2=0x7fe7ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe7ac06af00 0x7fe7ac06d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7c01f6a30 tx=0x7fe7b4008040 comp rx=0 tx=0).stop 2023-10-14T12:19:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 msgr2=0x7fe7c0153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 0x7fe7c0153910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00090b0 tx=0x7fe7b0004750 comp rx=0 tx=0).stop 2023-10-14T12:19:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 shutdown_connections 2023-10-14T12:19:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7c00cede0 0x7fe7c00afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7c006a840 0x7fe7c0153910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe7ac06af00 0x7fe7ac06d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 --2- 172.21.15.32:0/3332153742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c00cd950 0x7fe7c00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 >> 172.21.15.32:0/3332153742 conn(0x7fe7c006dae0 msgr2=0x7fe7c00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:30.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 shutdown_connections 2023-10-14T12:19:30.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.419+0000 7fe7c6700700 1 -- 172.21.15.32:0/3332153742 wait complete. 2023-10-14T12:19:30.433 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T12:19:30.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:30.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.558+0000 7fb3a3e0b700 1 Processor -- start 2023-10-14T12:19:30.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.558+0000 7fb3a3e0b700 1 -- start start 2023-10-14T12:19:30.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a3e0b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb39c0d0c70 0x7fb39c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a3e0b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a3e0b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c0d23e0 con 0x7fb39c15b740 2023-10-14T12:19:30.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a3e0b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c15bb20 con 0x7fb39c0d0c70 2023-10-14T12:19:30.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a3e0b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0cf190 con 0x7fb39c0c5110 2023-10-14T12:19:30.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a13a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb39c0d0c70 0x7fb39c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a23a8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a1ba7700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb39c15b740 0x7fb39c0d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:55362/0 (socket says 172.21.15.32:55362) 2023-10-14T12:19:30.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a13a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb39c0d0c70 0x7fb39c0cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43732/0 (socket says 172.21.15.32:43732) 2023-10-14T12:19:30.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a23a8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:45158/0 (socket says 172.21.15.32:45158) 2023-10-14T12:19:30.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a13a6700 1 -- 172.21.15.32:0/2118259036 learned_addr learned my addr 172.21.15.32:0/2118259036 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:30.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2118259036 >> v2:172.21.15.92:3300/0 conn(0x7fb39c0d0c70 msgr2=0x7fb39c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:30.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a23a8700 1 --2- 172.21.15.32:0/2118259036 >> v2:172.21.15.92:3300/0 conn(0x7fb39c0d0c70 0x7fb39c0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2118259036 >> v1:172.21.15.92:6789/0 conn(0x7fb39c15b740 legacy=0x7fb39c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.559+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2118259036 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0cbd40 con 0x7fb39c0c5110 2023-10-14T12:19:30.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a23a8700 1 --2- 172.21.15.32:0/2118259036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ce510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb394009d90 tx=0x7fb39400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d816a56d0d3606a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a0ba5700 1 -- 172.21.15.32:0/2118259036 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400e070 con 0x7fb39c0c5110 2023-10-14T12:19:30.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a0ba5700 1 -- 172.21.15.32:0/2118259036 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39400bb20 con 0x7fb39c0c5110 2023-10-14T12:19:30.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a0ba5700 1 -- 172.21.15.32:0/2118259036 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394012430 con 0x7fb39c0c5110 2023-10-14T12:19:30.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2118259036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 msgr2=0x7fb39c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2118259036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ce510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb394009d90 tx=0x7fb39400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:30.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2118259036 shutdown_connections 2023-10-14T12:19:30.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2118259036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ce510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2118259036 >> v2:172.21.15.92:3300/0 conn(0x7fb39c0d0c70 0x7fb39c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2118259036 >> 172.21.15.32:0/2118259036 conn(0x7fb39c0665a0 msgr2=0x7fb39c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:30.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2118259036 shutdown_connections 2023-10-14T12:19:30.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.560+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2118259036 wait complete. 2023-10-14T12:19:30.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 Processor -- start 2023-10-14T12:19:30.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 -- start start 2023-10-14T12:19:30.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb39c0d0c70 0x7fb39c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 0x7fb39c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0a93e0 con 0x7fb39c15b740 2023-10-14T12:19:30.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0cb670 con 0x7fb39c0d0c70 2023-10-14T12:19:30.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.562+0000 7fb3a3e0b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0c9550 con 0x7fb39c0c5110 2023-10-14T12:19:30.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 0x7fb39c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 0x7fb39c0b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39472/0 (socket says 172.21.15.32:39472) 2023-10-14T12:19:30.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2436927940 learned_addr learned my addr 172.21.15.32:0/2436927940 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:30.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a13a6700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb39c0d0c70 0x7fb39c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a1ba7700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 msgr2=0x7fb39c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb39c0d0c70 msgr2=0x7fb39c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb39c0d0c70 0x7fb39c0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 -- 172.21.15.32:0/2436927940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394009a70 con 0x7fb39c15b740 2023-10-14T12:19:30.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a23a8700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 0x7fb39c0b66a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb394014040 tx=0x7fb394004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394012430 con 0x7fb39c15b740 2023-10-14T12:19:30.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb394020070 con 0x7fb39c15b740 2023-10-14T12:19:30.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394004280 con 0x7fb39c15b740 2023-10-14T12:19:30.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c0c9830 con 0x7fb39c15b740 2023-10-14T12:19:30.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.563+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c0c9df0 con 0x7fb39c15b740 2023-10-14T12:19:30.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.564+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c067d20 con 0x7fb39c15b740 2023-10-14T12:19:30.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.565+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb3940043e0 con 0x7fb39c15b740 2023-10-14T12:19:30.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.565+0000 7fb3927fc700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb38006af00 0x7fb38006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.565+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb394022070 con 0x7fb39c15b740 2023-10-14T12:19:30.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.565+0000 7fb3a1ba7700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb38006af00 0x7fb38006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.566+0000 7fb3a1ba7700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb38006af00 0x7fb38006d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb398000f60 tx=0x7fb398007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.570+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb394056430 con 0x7fb39c15b740 2023-10-14T12:19:30.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.813+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb39c0cf7e0 con 0x7fb39c15b740 2023-10-14T12:19:30.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.814+0000 7fb3927fc700 1 -- 172.21.15.32:0/2436927940 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fb394059a50 con 0x7fb39c15b740 2023-10-14T12:19:30.815 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:30.816 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:19:30.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb38006af00 msgr2=0x7fb38006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb38006af00 0x7fb38006d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb398000f60 tx=0x7fb398007d70 comp rx=0 tx=0).stop 2023-10-14T12:19:30.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 msgr2=0x7fb39c0b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 0x7fb39c0b66a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb394014040 tx=0x7fb394004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 shutdown_connections 2023-10-14T12:19:30.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb39c15b740 0x7fb39c0b66a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb39c0c5110 0x7fb39c0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb38006af00 0x7fb38006d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 --2- 172.21.15.32:0/2436927940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb39c0d0c70 0x7fb39c0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 >> 172.21.15.32:0/2436927940 conn(0x7fb39c0665a0 msgr2=0x7fb39c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:30.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 shutdown_connections 2023-10-14T12:19:30.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.816+0000 7fb3a3e0b700 1 -- 172.21.15.32:0/2436927940 wait complete. 2023-10-14T12:19:30.820 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:19:30.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.953+0000 7f96e7f3b700 1 Processor -- start 2023-10-14T12:19:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.954+0000 7f96e7f3b700 1 -- start start 2023-10-14T12:19:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.954+0000 7f96e7f3b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96e015e2f0 0x7f96e00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.954+0000 7f96e7f3b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e006a840 0x7f96e006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e7f3b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00b2d60 con 0x7f96e00cd950 2023-10-14T12:19:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e7f3b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e01619a0 con 0x7f96e015e2f0 2023-10-14T12:19:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e7f3b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e006b1f0 con 0x7f96e006a840 2023-10-14T12:19:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e64d8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e006a840 0x7f96e006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e54d6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96e015e2f0 0x7f96e00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e5cd7700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f96e00cd950 0x7f96e015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:55376/0 (socket says 172.21.15.32:55376) 2023-10-14T12:19:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e5cd7700 1 -- 172.21.15.32:0/161253251 learned_addr learned my addr 172.21.15.32:0/161253251 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e4cd5700 1 -- 172.21.15.32:0/161253251 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592099124 0 0) 0x7f96e00b2d60 con 0x7f96e00cd950 2023-10-14T12:19:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e64d8700 1 -- 172.21.15.32:0/161253251 >> v2:172.21.15.92:3300/0 conn(0x7f96e015e2f0 msgr2=0x7f96e00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e64d8700 1 --2- 172.21.15.32:0/161253251 >> v2:172.21.15.92:3300/0 conn(0x7f96e015e2f0 0x7f96e00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e64d8700 1 -- 172.21.15.32:0/161253251 >> v1:172.21.15.92:6789/0 conn(0x7f96e00cd950 legacy=0x7f96e015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e64d8700 1 -- 172.21.15.32:0/161253251 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00cdd30 con 0x7f96e006a840 2023-10-14T12:19:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e54d6700 1 --2- 172.21.15.32:0/161253251 >> v2:172.21.15.92:3300/0 conn(0x7f96e015e2f0 0x7f96e00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.955+0000 7f96e64d8700 1 --2- 172.21.15.32:0/161253251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e006a840 0x7f96e006acb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96e0161ae0 tx=0x7f96d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57bff0b295a84bb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e4cd5700 1 -- 172.21.15.32:0/161253251 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8016070 con 0x7f96e006a840 2023-10-14T12:19:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e4cd5700 1 -- 172.21.15.32:0/161253251 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800bb20 con 0x7f96e006a840 2023-10-14T12:19:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e4cd5700 1 -- 172.21.15.32:0/161253251 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800e070 con 0x7f96e006a840 2023-10-14T12:19:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 -- 172.21.15.32:0/161253251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e006a840 msgr2=0x7f96e006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/161253251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e006a840 0x7f96e006acb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96e0161ae0 tx=0x7f96d800b330 comp rx=0 tx=0).stop 2023-10-14T12:19:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 -- 172.21.15.32:0/161253251 shutdown_connections 2023-10-14T12:19:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/161253251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e006a840 0x7f96e006acb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/161253251 >> v2:172.21.15.92:3300/0 conn(0x7f96e015e2f0 0x7f96e00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 -- 172.21.15.32:0/161253251 >> 172.21.15.32:0/161253251 conn(0x7f96e006dae0 msgr2=0x7f96e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 -- 172.21.15.32:0/161253251 shutdown_connections 2023-10-14T12:19:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.956+0000 7f96e7f3b700 1 -- 172.21.15.32:0/161253251 wait complete. 2023-10-14T12:19:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.957+0000 7f96e7f3b700 1 Processor -- start 2023-10-14T12:19:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 -- start start 2023-10-14T12:19:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 0x7f96e014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e00cd950 0x7f96e014b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e015e2f0 0x7f96e006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014d5a0 con 0x7f96e006a840 2023-10-14T12:19:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014c990 con 0x7f96e015e2f0 2023-10-14T12:19:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e7f3b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014cc70 con 0x7f96e00cd950 2023-10-14T12:19:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e5cd7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 0x7f96e014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e5cd7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 0x7f96e014c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39482/0 (socket says 172.21.15.32:39482) 2023-10-14T12:19:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.958+0000 7f96e5cd7700 1 -- 172.21.15.32:0/2714625450 learned_addr learned my addr 172.21.15.32:0/2714625450 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e54d6700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e00cd950 0x7f96e014b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e64d8700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e015e2f0 0x7f96e006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e5cd7700 1 -- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e00cd950 msgr2=0x7f96e014b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e5cd7700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e00cd950 0x7f96e014b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e5cd7700 1 -- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e015e2f0 msgr2=0x7f96e006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e5cd7700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e015e2f0 0x7f96e006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e5cd7700 1 -- 172.21.15.32:0/2714625450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4009430 con 0x7f96e006a840 2023-10-14T12:19:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e5cd7700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 0x7f96e014c140 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c520 tx=0x7f96dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc004c80 con 0x7f96e006a840 2023-10-14T12:19:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc004e00 con 0x7f96e006a840 2023-10-14T12:19:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d8009a70 con 0x7f96e006a840 2023-10-14T12:19:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc007310 con 0x7f96e006a840 2023-10-14T12:19:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.959+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e014d230 con 0x7f96e006a840 2023-10-14T12:19:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.960+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0067d20 con 0x7f96e006a840 2023-10-14T12:19:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.961+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f96dc007470 con 0x7f96e006a840 2023-10-14T12:19:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.961+0000 7f96d27fc700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f96c406af00 0x7f96c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.961+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96dc0892b0 con 0x7f96e006a840 2023-10-14T12:19:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.961+0000 7f96e54d6700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f96c406af00 0x7f96c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.962+0000 7f96e54d6700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f96c406af00 0x7f96c406d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f96e006ecc0 tx=0x7f96d40091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:30.966+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96dc0542d0 con 0x7f96e006a840 2023-10-14T12:19:31.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.211+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96e00b2630 con 0x7f96e006a840 2023-10-14T12:19:31.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.212+0000 7f96d27fc700 1 -- 172.21.15.32:0/2714625450 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f96dc0578f0 con 0x7f96e006a840 2023-10-14T12:19:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:31.214 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2997823890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2997823890},{"type":"v1","addr":"172.21.15.32:6833","nonce":2997823890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/262657526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":262657526},{"type":"v1","addr":"172.21.15.92:6835","nonce":262657526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1901431842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1901431842},{"type":"v1","addr":"172.21.15.32:6835","nonce":1901431842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:18:46.896041+0000","modified":"2023-10-14T12:18:49.918084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6837/2838644499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2838644499},{"type":"v1","addr":"172.21.15.92:6837","nonce":2838644499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:19:31.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f96c406af00 msgr2=0x7f96c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f96c406af00 0x7f96c406d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f96e006ecc0 tx=0x7f96d40091c0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 msgr2=0x7f96e014c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 0x7f96e014c140 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c520 tx=0x7f96dc00c830 comp rx=0 tx=0).stop 2023-10-14T12:19:31.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 shutdown_connections 2023-10-14T12:19:31.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f96c406af00 0x7f96c406d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e015e2f0 0x7f96e006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96e006a840 0x7f96e014c140 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 --2- 172.21.15.32:0/2714625450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e00cd950 0x7f96e014b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 >> 172.21.15.32:0/2714625450 conn(0x7f96e006dae0 msgr2=0x7f96e00b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:31.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 shutdown_connections 2023-10-14T12:19:31.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.214+0000 7f96e7f3b700 1 -- 172.21.15.32:0/2714625450 wait complete. 2023-10-14T12:19:31.218 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-10-14T12:19:31.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.352+0000 7f954134e700 1 Processor -- start 2023-10-14T12:19:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.352+0000 7f954134e700 1 -- start start 2023-10-14T12:19:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f954134e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0b7050 0x7f953c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f954134e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c15e4e0 con 0x7f953c15dbc0 2023-10-14T12:19:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f954134e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c0d28e0 con 0x7f953c0d3fc0 2023-10-14T12:19:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f954134e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0b7560 con 0x7f953c0b7050 2023-10-14T12:19:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f953affd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f953c15dbc0 0x7f953c0d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56514/0 (socket says 172.21.15.32:56514) 2023-10-14T12:19:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f953affd700 1 -- 172.21.15.32:0/568863458 learned_addr learned my addr 172.21.15.32:0/568863458 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f953b7fe700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0b7050 0x7f953c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912052446 0 0) 0x7f953c15e4e0 con 0x7f953c15dbc0 2023-10-14T12:19:31.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95240035b0 con 0x7f953c15dbc0 2023-10-14T12:19:31.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165446038 0 0) 0x7f953c0d28e0 con 0x7f953c0d3fc0 2023-10-14T12:19:31.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f953c15e4e0 con 0x7f953c0d3fc0 2023-10-14T12:19:31.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4233058816 0 0) 0x7f95240035b0 con 0x7f953c15dbc0 2023-10-14T12:19:31.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0b7050 msgr2=0x7f953c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:31.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0b7050 0x7f953c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 >> v1:172.21.15.92:6789/0 conn(0x7f953c0d3fc0 legacy=0x7f953c0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0b7840 con 0x7f953c15dbc0 2023-10-14T12:19:31.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f95300017f0 con 0x7f953c15dbc0 2023-10-14T12:19:31.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.353+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 >> v1:172.21.15.32:6789/0 conn(0x7f953c15dbc0 legacy=0x7f953c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f9524003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9524004850 0x7f9524004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9524005210 0x7f952400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0b7560 con 0x7f9524003bc0 2023-10-14T12:19:31.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952400c000 con 0x7f9524004850 2023-10-14T12:19:31.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952400c1c0 con 0x7f9524005210 2023-10-14T12:19:31.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953b7fe700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0b7050 0x7f953c15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:31.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f9524003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953a7fc700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9524004850 0x7f9524004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953b7fe700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9524005210 0x7f952400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 -- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9524005210 msgr2=0x7f952400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:31.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9524005210 0x7f952400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 -- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9524004850 msgr2=0x7f9524004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:31.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9524004850 0x7f9524004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 -- 172.21.15.32:0/568863458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240035b0 con 0x7f9524003bc0 2023-10-14T12:19:31.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953a7fc700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9524004850 0x7f9524004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:31.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f953affd700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f9524003fc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f953000c210 tx=0x7f9524005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc425804fe3b6274 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:31.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953000cd50 con 0x7f9524003bc0 2023-10-14T12:19:31.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530001c00 con 0x7f9524003bc0 2023-10-14T12:19:31.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.354+0000 7f9539ffb700 1 -- 172.21.15.32:0/568863458 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530007310 con 0x7f9524003bc0 2023-10-14T12:19:31.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f954134e700 1 -- 172.21.15.32:0/568863458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 msgr2=0x7f9524003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f954134e700 1 --2- 172.21.15.32:0/568863458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f9524003fc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f953000c210 tx=0x7f9524005880 comp rx=0 tx=0).stop 2023-10-14T12:19:31.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f953b7fe700 1 -- 172.21.15.32:0/568863458 reap_dead start 2023-10-14T12:19:31.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f954134e700 1 -- 172.21.15.32:0/568863458 shutdown_connections 2023-10-14T12:19:31.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f954134e700 1 -- 172.21.15.32:0/568863458 >> 172.21.15.32:0/568863458 conn(0x7f953c09cb40 msgr2=0x7f953c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:31.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f954134e700 1 -- 172.21.15.32:0/568863458 shutdown_connections 2023-10-14T12:19:31.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.355+0000 7f954134e700 1 -- 172.21.15.32:0/568863458 wait complete. 2023-10-14T12:19:31.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.357+0000 7f954134e700 1 Processor -- start 2023-10-14T12:19:31.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.357+0000 7f954134e700 1 -- start start 2023-10-14T12:19:31.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f953c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0ca9f0 0x7f953c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f953c0cda20 0x7f953c06c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c156500 con 0x7f9524003bc0 2023-10-14T12:19:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c159830 con 0x7f953c0cda20 2023-10-14T12:19:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c158cb0 con 0x7f953c0ca9f0 2023-10-14T12:19:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f953c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f953c155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39500/0 (socket says 172.21.15.32:39500) 2023-10-14T12:19:31.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 -- 172.21.15.32:0/3837102587 learned_addr learned my addr 172.21.15.32:0/3837102587 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953a7fc700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0ca9f0 0x7f953c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953b7fe700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f953c0cda20 0x7f953c06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 -- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0ca9f0 msgr2=0x7f953c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0ca9f0 0x7f953c0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 -- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f953c0cda20 msgr2=0x7f953c06c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f953c0cda20 0x7f953c06c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 -- 172.21.15.32:0/3837102587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c158f90 con 0x7f9524003bc0 2023-10-14T12:19:31.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953b7fe700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f953c0cda20 0x7f953c06c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:31.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f953affd700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f953c155ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9530000ef0 tx=0x7f953c0cdea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:31.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530005d00 con 0x7f9524003bc0 2023-10-14T12:19:31.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530005e80 con 0x7f9524003bc0 2023-10-14T12:19:31.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c159270 con 0x7f9524003bc0 2023-10-14T12:19:31.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530007310 con 0x7f9524003bc0 2023-10-14T12:19:31.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.358+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c159f70 con 0x7f9524003bc0 2023-10-14T12:19:31.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.359+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c15a2e0 con 0x7f9524003bc0 2023-10-14T12:19:31.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.360+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9530019070 con 0x7f9524003bc0 2023-10-14T12:19:31.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.360+0000 7f95237fe700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f952806af00 0x7f952806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.360+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f953008a830 con 0x7f9524003bc0 2023-10-14T12:19:31.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.360+0000 7f953a7fc700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f952806af00 0x7f952806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.361+0000 7f953a7fc700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f952806af00 0x7f952806d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f952c000c00 tx=0x7f952c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:31.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.365+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9530055a90 con 0x7f9524003bc0 2023-10-14T12:19:31.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.566+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f953c04ebb0 con 0x7f9524003bc0 2023-10-14T12:19:31.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.568+0000 7f95237fe700 1 -- 172.21.15.32:0/3837102587 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f95300590b0 con 0x7f9524003bc0 2023-10-14T12:19:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:31.570 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:18:48.492939+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:18:45.023238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:18:45.871697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:31.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f952806af00 msgr2=0x7f952806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f952806af00 0x7f952806d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f952c000c00 tx=0x7f952c009040 comp rx=0 tx=0).stop 2023-10-14T12:19:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 msgr2=0x7f953c155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f953c155ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9530000ef0 tx=0x7f953c0cdea0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 shutdown_connections 2023-10-14T12:19:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f952806af00 0x7f952806d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f953c0cda20 0x7f953c06c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524003bc0 0x7f953c155ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 --2- 172.21.15.32:0/3837102587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f953c0ca9f0 0x7f953c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 >> 172.21.15.32:0/3837102587 conn(0x7f953c09cb40 msgr2=0x7f953c0d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:31.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 shutdown_connections 2023-10-14T12:19:31.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.570+0000 7f954134e700 1 -- 172.21.15.32:0/3837102587 wait complete. 2023-10-14T12:19:31.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T12:19:31.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.708+0000 7f5cf138d700 1 Processor -- start 2023-10-14T12:19:31.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.708+0000 7f5cf138d700 1 -- start start 2023-10-14T12:19:31.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5cf138d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5cec15dce0 0x7f5cec0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5cf138d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec06cb70 con 0x7f5cec0cfc00 2023-10-14T12:19:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5cf138d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec06ce50 con 0x7f5cec15e0c0 2023-10-14T12:19:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5cf138d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cec0cbc40 con 0x7f5cec15dce0 2023-10-14T12:19:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5ceb7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5cec0cfc00 0x7f5cec0cc090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56536/0 (socket says 172.21.15.32:56536) 2023-10-14T12:19:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5ceb7fe700 1 -- 172.21.15.32:0/2062417282 learned_addr learned my addr 172.21.15.32:0/2062417282 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:31.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.709+0000 7f5ceaffd700 1 --2- 172.21.15.32:0/2062417282 >> v2:172.21.15.92:3300/0 conn(0x7f5cec15dce0 0x7f5cec0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620271969 0 0) 0x7f5cec06cb70 con 0x7f5cec0cfc00 2023-10-14T12:19:31.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd40035b0 con 0x7f5cec0cfc00 2023-10-14T12:19:31.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677843766 0 0) 0x7f5cec06ce50 con 0x7f5cec15e0c0 2023-10-14T12:19:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cec06cb70 con 0x7f5cec15e0c0 2023-10-14T12:19:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ceaffd700 1 -- 172.21.15.32:0/2062417282 >> v1:172.21.15.92:6789/0 conn(0x7f5cec15e0c0 legacy=0x7f5cec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ceaffd700 1 -- 172.21.15.32:0/2062417282 >> v1:172.21.15.32:6789/0 conn(0x7f5cec0cfc00 legacy=0x7f5cec0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ceaffd700 1 -- 172.21.15.32:0/2062417282 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec06d130 con 0x7f5cec15dce0 2023-10-14T12:19:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ceaffd700 1 --2- 172.21.15.32:0/2062417282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec0b03c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009840 tx=0x7f5ce0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ada64ae84a696005 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0011830 con 0x7f5cec15dce0 2023-10-14T12:19:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0011990 con 0x7f5cec15dce0 2023-10-14T12:19:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.710+0000 7f5ce9ffb700 1 -- 172.21.15.32:0/2062417282 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0011d20 con 0x7f5cec15dce0 2023-10-14T12:19:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 -- 172.21.15.32:0/2062417282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 msgr2=0x7f5cec0b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2062417282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec0b03c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009840 tx=0x7f5ce0009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 -- 172.21.15.32:0/2062417282 shutdown_connections 2023-10-14T12:19:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2062417282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec0b03c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 -- 172.21.15.32:0/2062417282 >> 172.21.15.32:0/2062417282 conn(0x7f5cec0d15f0 msgr2=0x7f5cec0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 -- 172.21.15.32:0/2062417282 shutdown_connections 2023-10-14T12:19:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.711+0000 7f5cf138d700 1 -- 172.21.15.32:0/2062417282 wait complete. 2023-10-14T12:19:31.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.712+0000 7f5cf138d700 1 Processor -- start 2023-10-14T12:19:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.712+0000 7f5cf138d700 1 -- start start 2023-10-14T12:19:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cf138d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5cec0cfc00 0x7f5cec15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cf138d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cf138d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 0x7f5cec0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cf138d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0b1570 con 0x7f5cec15e0c0 2023-10-14T12:19:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cf138d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0b0960 con 0x7f5cec15dce0 2023-10-14T12:19:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cf138d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0b0c40 con 0x7f5cec0cfc00 2023-10-14T12:19:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 0x7f5cec0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 0x7f5cec0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39518/0 (socket says 172.21.15.32:39518) 2023-10-14T12:19:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 -- 172.21.15.32:0/2813550369 learned_addr learned my addr 172.21.15.32:0/2813550369 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5cea7fc700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceaffd700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5cec0cfc00 0x7f5cec15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 -- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5cec0cfc00 msgr2=0x7f5cec15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5cec0cfc00 0x7f5cec15bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 -- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 msgr2=0x7f5cec15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec15e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.713+0000 7f5ceb7fe700 1 -- 172.21.15.32:0/2813550369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00094a0 con 0x7f5cec15e0c0 2023-10-14T12:19:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.714+0000 7f5ceb7fe700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 0x7f5cec0b1a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400cba0 tx=0x7f5ce400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.714+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400aa40 con 0x7f5cec15e0c0 2023-10-14T12:19:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.714+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce400aba0 con 0x7f5cec15e0c0 2023-10-14T12:19:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.714+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec0b0f20 con 0x7f5cec15e0c0 2023-10-14T12:19:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.714+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4012400 con 0x7f5cec15e0c0 2023-10-14T12:19:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.714+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec15c490 con 0x7f5cec15e0c0 2023-10-14T12:19:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.715+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec0b1720 con 0x7f5cec15e0c0 2023-10-14T12:19:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.715+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ce401b3b0 con 0x7f5cec15e0c0 2023-10-14T12:19:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.716+0000 7f5cd37fe700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5cd806af00 0x7f5cd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.716+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ce4089350 con 0x7f5cec15e0c0 2023-10-14T12:19:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.716+0000 7f5ceaffd700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5cd806af00 0x7f5cd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.716+0000 7f5ceaffd700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5cd806af00 0x7f5cd806d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009fd0 tx=0x7f5ce001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.720+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cec0b1720 con 0x7f5cec15e0c0 2023-10-14T12:19:31.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.968+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5cec067d20 con 0x7f5cec15e0c0 2023-10-14T12:19:31.969 INFO:tasks.ceph.mon.a.smithi032.stderr:2023-10-14T12:19:31.968+0000 7f9079f45700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T12:19:31.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.969+0000 7f5cd37fe700 1 -- 172.21.15.32:0/2813550369 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5ce4054380 con 0x7f5cec15e0c0 2023-10-14T12:19:31.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5cd806af00 msgr2=0x7f5cd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5cd806af00 0x7f5cd806d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009fd0 tx=0x7f5ce001c040 comp rx=0 tx=0).stop 2023-10-14T12:19:31.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 msgr2=0x7f5cec0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:31.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 0x7f5cec0b1a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400cba0 tx=0x7f5ce400ceb0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 shutdown_connections 2023-10-14T12:19:31.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cec15e0c0 0x7f5cec0b1a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5cec0cfc00 0x7f5cec15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5cd806af00 0x7f5cd806d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 --2- 172.21.15.32:0/2813550369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cec15dce0 0x7f5cec15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:31.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 >> 172.21.15.32:0/2813550369 conn(0x7f5cec0d15f0 msgr2=0x7f5cec0ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:31.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.972+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 shutdown_connections 2023-10-14T12:19:31.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:31.973+0000 7f5cf138d700 1 -- 172.21.15.32:0/2813550369 wait complete. 2023-10-14T12:19:31.977 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T12:19:31.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T12:19:32.013 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-10-14T12:19:32.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.113+0000 7f1b68524700 1 Processor -- start 2023-10-14T12:19:32.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.113+0000 7f1b68524700 1 -- start start 2023-10-14T12:19:32.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b68524700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b6015eab0 0x7f1b600cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:32.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b68524700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600d1d90 0x7f1b600cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:32.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b68524700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6015ee90 con 0x7f1b600cf6d0 2023-10-14T12:19:32.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b68524700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b600d21c0 con 0x7f1b6015eab0 2023-10-14T12:19:32.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b68524700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600cfb60 con 0x7f1b600d1d90 2023-10-14T12:19:32.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b65abf700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1b600cf6d0 0x7f1b600d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56546/0 (socket says 172.21.15.32:56546) 2023-10-14T12:19:32.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b65abf700 1 -- 172.21.15.32:0/477306898 learned_addr learned my addr 172.21.15.32:0/477306898 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b662c0700 1 --2- 172.21.15.32:0/477306898 >> v2:172.21.15.92:3300/0 conn(0x7f1b6015eab0 0x7f1b600cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b66ac1700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600d1d90 0x7f1b600cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b652be700 1 -- 172.21.15.32:0/477306898 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155534265 0 0) 0x7f1b6015ee90 con 0x7f1b600cf6d0 2023-10-14T12:19:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.114+0000 7f1b652be700 1 -- 172.21.15.32:0/477306898 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c0035b0 con 0x7f1b600cf6d0 2023-10-14T12:19:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b662c0700 1 -- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600d1d90 msgr2=0x7f1b600cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b662c0700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600d1d90 0x7f1b600cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b662c0700 1 -- 172.21.15.32:0/477306898 >> v1:172.21.15.32:6789/0 conn(0x7f1b600cf6d0 legacy=0x7f1b600d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b662c0700 1 -- 172.21.15.32:0/477306898 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60158370 con 0x7f1b6015eab0 2023-10-14T12:19:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b66ac1700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600d1d90 0x7f1b600cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:32.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b662c0700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b6015eab0 0x7f1b600cf190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009840 tx=0x7f1b50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35da94fc6b6d0107 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:32.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b652be700 1 -- 172.21.15.32:0/477306898 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50011830 con 0x7f1b6015eab0 2023-10-14T12:19:32.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b652be700 1 -- 172.21.15.32:0/477306898 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50011990 con 0x7f1b6015eab0 2023-10-14T12:19:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b652be700 1 -- 172.21.15.32:0/477306898 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50011d20 con 0x7f1b6015eab0 2023-10-14T12:19:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b68524700 1 -- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b6015eab0 msgr2=0x7f1b600cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.115+0000 7f1b68524700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b6015eab0 0x7f1b600cf190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009840 tx=0x7f1b50009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.116+0000 7f1b68524700 1 -- 172.21.15.32:0/477306898 shutdown_connections 2023-10-14T12:19:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.116+0000 7f1b68524700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b6015eab0 0x7f1b600cf190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.116+0000 7f1b68524700 1 --2- 172.21.15.32:0/477306898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600d1d90 0x7f1b600cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.116+0000 7f1b68524700 1 -- 172.21.15.32:0/477306898 >> 172.21.15.32:0/477306898 conn(0x7f1b600665a0 msgr2=0x7f1b60066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.116+0000 7f1b68524700 1 -- 172.21.15.32:0/477306898 shutdown_connections 2023-10-14T12:19:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.116+0000 7f1b68524700 1 -- 172.21.15.32:0/477306898 wait complete. 2023-10-14T12:19:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 Processor -- start 2023-10-14T12:19:32.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 -- start start 2023-10-14T12:19:32.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600cf6d0 0x7f1b6006c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:32.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b600d1d90 0x7f1b601e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:32.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 0x7f1b60156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:32.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c4ea0 con 0x7f1b6015eab0 2023-10-14T12:19:32.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b601e9660 con 0x7f1b600d1d90 2023-10-14T12:19:32.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.117+0000 7f1b68524700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c6af0 con 0x7f1b600cf6d0 2023-10-14T12:19:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 0x7f1b60156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 0x7f1b60156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39532/0 (socket says 172.21.15.32:39532) 2023-10-14T12:19:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 -- 172.21.15.32:0/3403315831 learned_addr learned my addr 172.21.15.32:0/3403315831 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b662c0700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600cf6d0 0x7f1b6006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b65abf700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b600d1d90 0x7f1b601e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 -- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600cf6d0 msgr2=0x7f1b6006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600cf6d0 0x7f1b6006c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 -- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b600d1d90 msgr2=0x7f1b601e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b600d1d90 0x7f1b601e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 -- 172.21.15.32:0/3403315831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009a70 con 0x7f1b6015eab0 2023-10-14T12:19:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b65abf700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b600d1d90 0x7f1b601e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b662c0700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600cf6d0 0x7f1b6006c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b66ac1700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 0x7f1b60156b40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009e60 tx=0x7f1b5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58009cd0 con 0x7f1b6015eab0 2023-10-14T12:19:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5800f040 con 0x7f1b6015eab0 2023-10-14T12:19:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500094a0 con 0x7f1b6015eab0 2023-10-14T12:19:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800ce20 con 0x7f1b6015eab0 2023-10-14T12:19:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.118+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600c4bc0 con 0x7f1b6015eab0 2023-10-14T12:19:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.119+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60067d20 con 0x7f1b6015eab0 2023-10-14T12:19:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.120+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1b58014480 con 0x7f1b6015eab0 2023-10-14T12:19:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.120+0000 7f1b56ffd700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1b4406af30 0x7f1b4406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.120+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1b58089c30 con 0x7f1b6015eab0 2023-10-14T12:19:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.120+0000 7f1b662c0700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1b4406af30 0x7f1b4406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.121+0000 7f1b662c0700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1b4406af30 0x7f1b4406d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b500090b0 tx=0x7f1b50008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.125+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b58054d10 con 0x7f1b6015eab0 2023-10-14T12:19:32.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.369+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b600c6c30 con 0x7f1b6015eab0 2023-10-14T12:19:32.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.971+0000 7f1b56ffd700 1 -- 172.21.15.32:0/3403315831 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b58058330 con 0x7f1b6015eab0 2023-10-14T12:19:32.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1b4406af30 msgr2=0x7f1b4406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:32.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1b4406af30 0x7f1b4406d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b500090b0 tx=0x7f1b50008030 comp rx=0 tx=0).stop 2023-10-14T12:19:32.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 msgr2=0x7f1b60156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 0x7f1b60156b40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009e60 tx=0x7f1b5800c3a0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 shutdown_connections 2023-10-14T12:19:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6015eab0 0x7f1b60156b40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b600cf6d0 0x7f1b6006c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1b4406af30 0x7f1b4406d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 --2- 172.21.15.32:0/3403315831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b600d1d90 0x7f1b601e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 >> 172.21.15.32:0/3403315831 conn(0x7f1b600665a0 msgr2=0x7f1b600b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 shutdown_connections 2023-10-14T12:19:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:32.973+0000 7f1b68524700 1 -- 172.21.15.32:0/3403315831 wait complete. 2023-10-14T12:19:32.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T12:19:33.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.121+0000 7f20cab3e700 1 Processor -- start 2023-10-14T12:19:33.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.121+0000 7f20cab3e700 1 -- start start 2023-10-14T12:19:33.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20cab3e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20c415ddf0 0x7f20c406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:33.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20cab3e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c40b4b80 0x7f20c406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:33.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20cab3e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40cd960 con 0x7f20c40b50d0 2023-10-14T12:19:33.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20cab3e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c415e1d0 con 0x7f20c415ddf0 2023-10-14T12:19:33.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20cab3e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40cd350 con 0x7f20c40b4b80 2023-10-14T12:19:33.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20c415ddf0 0x7f20c406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:33.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20c415ddf0 0x7f20c406c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39536/0 (socket says 172.21.15.32:39536) 2023-10-14T12:19:33.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 -- 172.21.15.32:0/304173284 learned_addr learned my addr 172.21.15.32:0/304173284 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:33.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c90db700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c40b4b80 0x7f20c406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:33.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 -- 172.21.15.32:0/304173284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c40b4b80 msgr2=0x7f20c406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:33.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c40b4b80 0x7f20c406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:33.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 -- 172.21.15.32:0/304173284 >> v1:172.21.15.92:6789/0 conn(0x7f20c40b50d0 legacy=0x7f20c415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:33.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c88da700 1 -- 172.21.15.32:0/304173284 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40cecf0 con 0x7f20c415ddf0 2023-10-14T12:19:33.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.122+0000 7f20c90db700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c40b4b80 0x7f20c406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:33.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20c88da700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c415ddf0 0x7f20c406c9f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f20b80098f0 tx=0x7f20b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525a0555dec1e7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:33.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20c37fe700 1 -- 172.21.15.32:0/304173284 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8004230 con 0x7f20c415ddf0 2023-10-14T12:19:33.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20c37fe700 1 -- 172.21.15.32:0/304173284 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8004390 con 0x7f20c415ddf0 2023-10-14T12:19:33.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20c37fe700 1 -- 172.21.15.32:0/304173284 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80036a0 con 0x7f20c415ddf0 2023-10-14T12:19:33.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 -- 172.21.15.32:0/304173284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c415ddf0 msgr2=0x7f20c406c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:33.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c415ddf0 0x7f20c406c9f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f20b80098f0 tx=0x7f20b8009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:33.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 -- 172.21.15.32:0/304173284 shutdown_connections 2023-10-14T12:19:33.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c40b4b80 0x7f20c406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:33.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 --2- 172.21.15.32:0/304173284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c415ddf0 0x7f20c406c9f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:33.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 -- 172.21.15.32:0/304173284 >> 172.21.15.32:0/304173284 conn(0x7f20c406ae70 msgr2=0x7f20c40cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:33.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 -- 172.21.15.32:0/304173284 shutdown_connections 2023-10-14T12:19:33.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.123+0000 7f20cab3e700 1 -- 172.21.15.32:0/304173284 wait complete. 2023-10-14T12:19:33.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 Processor -- start 2023-10-14T12:19:33.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 -- start start 2023-10-14T12:19:33.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 0x7f20c40b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:33.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c40b50d0 0x7f20c41ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:33.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c415ddf0 0x7f20c40c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:33.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41f1950 con 0x7f20c40b4b80 2023-10-14T12:19:33.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41f1c30 con 0x7f20c40b50d0 2023-10-14T12:19:33.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.125+0000 7f20cab3e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41f1f10 con 0x7f20c415ddf0 2023-10-14T12:19:33.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 0x7f20c40b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:33.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 0x7f20c40b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39542/0 (socket says 172.21.15.32:39542) 2023-10-14T12:19:33.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 -- 172.21.15.32:0/3755370590 learned_addr learned my addr 172.21.15.32:0/3755370590 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:33.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c3fff700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c40b50d0 0x7f20c41ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:33.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c90db700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c415ddf0 0x7f20c40c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:33.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 -- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c415ddf0 msgr2=0x7f20c40c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:33.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c415ddf0 0x7f20c40c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:33.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 -- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c40b50d0 msgr2=0x7f20c41ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:33.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c40b50d0 0x7f20c41ee6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:33.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 -- 172.21.15.32:0/3755370590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8009550 con 0x7f20c40b4b80 2023-10-14T12:19:33.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c3fff700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c40b50d0 0x7f20c41ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:33.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c88da700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 0x7f20c40b18b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009130 tx=0x7f20b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:33.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800b860 con 0x7f20c40b4b80 2023-10-14T12:19:33.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800b9c0 con 0x7f20c40b4b80 2023-10-14T12:19:33.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c41f4a40 con 0x7f20c40b4b80 2023-10-14T12:19:33.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800bd70 con 0x7f20c40b4b80 2023-10-14T12:19:33.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.126+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c41f21f0 con 0x7f20c40b4b80 2023-10-14T12:19:33.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.127+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c404ebb0 con 0x7f20c40b4b80 2023-10-14T12:19:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.128+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20b801b440 con 0x7f20c40b4b80 2023-10-14T12:19:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.128+0000 7f20c17fa700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f20a806af00 0x7f20a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.128+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f20b808afe0 con 0x7f20c40b4b80 2023-10-14T12:19:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.128+0000 7f20c3fff700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f20a806af00 0x7f20a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.129+0000 7f20c3fff700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f20a806af00 0x7f20a806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20c40caaf0 tx=0x7f20b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:33.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.133+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20b80560c0 con 0x7f20c40b4b80 2023-10-14T12:19:33.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:33.338+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20c40729d0 con 0x7f20c40b4b80 2023-10-14T12:19:34.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.326+0000 7f20c17fa700 1 -- 172.21.15.32:0/3755370590 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f20b80596e0 con 0x7f20c40b4b80 2023-10-14T12:19:34.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f20a806af00 msgr2=0x7f20a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:34.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f20a806af00 0x7f20a806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20c40caaf0 tx=0x7f20b0009040 comp rx=0 tx=0).stop 2023-10-14T12:19:34.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 msgr2=0x7f20c40b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:34.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 0x7f20c40b18b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009130 tx=0x7f20b8004750 comp rx=0 tx=0).stop 2023-10-14T12:19:34.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 shutdown_connections 2023-10-14T12:19:34.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20c415ddf0 0x7f20c40c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20c40b4b80 0x7f20c40b18b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f20a806af00 0x7f20a806d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 --2- 172.21.15.32:0/3755370590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c40b50d0 0x7f20c41ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 >> 172.21.15.32:0/3755370590 conn(0x7f20c406ae70 msgr2=0x7f20c40caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:34.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.330+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 shutdown_connections 2023-10-14T12:19:34.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.331+0000 7f20cab3e700 1 -- 172.21.15.32:0/3755370590 wait complete. 2023-10-14T12:19:34.334 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2023-10-14T12:19:34.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T12:19:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.489+0000 7f45c52d7700 1 Processor -- start 2023-10-14T12:19:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.489+0000 7f45c52d7700 1 -- start start 2023-10-14T12:19:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45c52d7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f45c00d1760 0x7f45c00b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45c52d7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45c00d1b40 0x7f45c00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45c52d7700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00b6190 con 0x7f45c015d940 2023-10-14T12:19:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45c52d7700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00d2500 con 0x7f45c00d1b40 2023-10-14T12:19:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45c52d7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00cf6c0 con 0x7f45c00d1760 2023-10-14T12:19:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45be7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45c00d1b40 0x7f45c00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45bf7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f45c015d940 0x7f45c015ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56578/0 (socket says 172.21.15.32:56578) 2023-10-14T12:19:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.490+0000 7f45bf7fe700 1 -- 172.21.15.32:0/2508657615 learned_addr learned my addr 172.21.15.32:0/2508657615 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45beffd700 1 --2- 172.21.15.32:0/2508657615 >> v2:172.21.15.92:3300/0 conn(0x7f45c00d1760 0x7f45c00b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45be7fc700 1 -- 172.21.15.32:0/2508657615 >> v2:172.21.15.92:3300/0 conn(0x7f45c00d1760 msgr2=0x7f45c00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45be7fc700 1 --2- 172.21.15.32:0/2508657615 >> v2:172.21.15.92:3300/0 conn(0x7f45c00d1760 0x7f45c00b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45be7fc700 1 -- 172.21.15.32:0/2508657615 >> v1:172.21.15.32:6789/0 conn(0x7f45c015d940 legacy=0x7f45c015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45be7fc700 1 -- 172.21.15.32:0/2508657615 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00b58f0 con 0x7f45c00d1b40 2023-10-14T12:19:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45bdffb700 1 -- 172.21.15.32:0/2508657615 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135862179 0 0) 0x7f45c00b6190 con 0x7f45c015d940 2023-10-14T12:19:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45beffd700 1 --2- 172.21.15.32:0/2508657615 >> v2:172.21.15.92:3300/0 conn(0x7f45c00d1760 0x7f45c00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45be7fc700 1 --2- 172.21.15.32:0/2508657615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00d1fc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f45c008b430 tx=0x7f45b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236893733faf1fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45bdffb700 1 -- 172.21.15.32:0/2508657615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4011830 con 0x7f45c00d1b40 2023-10-14T12:19:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45bdffb700 1 -- 172.21.15.32:0/2508657615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4011990 con 0x7f45c00d1b40 2023-10-14T12:19:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.491+0000 7f45bdffb700 1 -- 172.21.15.32:0/2508657615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4011d20 con 0x7f45c00d1b40 2023-10-14T12:19:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 -- 172.21.15.32:0/2508657615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 msgr2=0x7f45c00d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 --2- 172.21.15.32:0/2508657615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00d1fc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f45c008b430 tx=0x7f45b4009b20 comp rx=0 tx=0).stop 2023-10-14T12:19:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 -- 172.21.15.32:0/2508657615 shutdown_connections 2023-10-14T12:19:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 --2- 172.21.15.32:0/2508657615 >> v2:172.21.15.92:3300/0 conn(0x7f45c00d1760 0x7f45c00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 --2- 172.21.15.32:0/2508657615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00d1fc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 -- 172.21.15.32:0/2508657615 >> 172.21.15.32:0/2508657615 conn(0x7f45c00d37a0 msgr2=0x7f45c00d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 -- 172.21.15.32:0/2508657615 shutdown_connections 2023-10-14T12:19:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.492+0000 7f45c52d7700 1 -- 172.21.15.32:0/2508657615 wait complete. 2023-10-14T12:19:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.493+0000 7f45c52d7700 1 Processor -- start 2023-10-14T12:19:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.493+0000 7f45c52d7700 1 -- start start 2023-10-14T12:19:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45c00d1760 0x7f45c01f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45c015d940 0x7f45c015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00cc400 con 0x7f45c00d1b40 2023-10-14T12:19:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00cc6e0 con 0x7f45c015d940 2023-10-14T12:19:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00cc9c0 con 0x7f45c00d1760 2023-10-14T12:19:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39558/0 (socket says 172.21.15.32:39558) 2023-10-14T12:19:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 -- 172.21.15.32:0/1325284880 learned_addr learned my addr 172.21.15.32:0/1325284880 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45bf7fe700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45c015d940 0x7f45c015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45beffd700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45c00d1760 0x7f45c01f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 -- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45c00d1760 msgr2=0x7f45c01f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45c00d1760 0x7f45c01f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 -- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45c015d940 msgr2=0x7f45c015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45c015d940 0x7f45c015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:34.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 -- 172.21.15.32:0/1325284880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094a0 con 0x7f45c00d1b40 2023-10-14T12:19:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45bf7fe700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45c015d940 0x7f45c015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45be7fc700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00cbd20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f45b40090b0 tx=0x7f45b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40036a0 con 0x7f45c00d1b40 2023-10-14T12:19:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b401f070 con 0x7f45c00d1b40 2023-10-14T12:19:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.494+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c00ccca0 con 0x7f45c00d1b40 2023-10-14T12:19:34.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.495+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4003a20 con 0x7f45c00d1b40 2023-10-14T12:19:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.495+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c00ce320 con 0x7f45c00d1b40 2023-10-14T12:19:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.496+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c004ebb0 con 0x7f45c00d1b40 2023-10-14T12:19:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.496+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45b4003b80 con 0x7f45c00d1b40 2023-10-14T12:19:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.496+0000 7f45a77fe700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45ac06af00 0x7f45ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.497+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f45b4021070 con 0x7f45c00d1b40 2023-10-14T12:19:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.497+0000 7f45beffd700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45ac06af00 0x7f45ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.497+0000 7f45beffd700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45ac06af00 0x7f45ac06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f45b000c920 tx=0x7f45b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.501+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45b40560f0 con 0x7f45c00d1b40 2023-10-14T12:19:34.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:34.700+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45c00cdc40 con 0x7f45c00d1b40 2023-10-14T12:19:35.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.331+0000 7f45a77fe700 1 -- 172.21.15.32:0/1325284880 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f45b4059710 con 0x7f45c00d1b40 2023-10-14T12:19:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.334+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45ac06af00 msgr2=0x7f45ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.334+0000 7f45c52d7700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45ac06af00 0x7f45ac06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f45b000c920 tx=0x7f45b0008040 comp rx=0 tx=0).stop 2023-10-14T12:19:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.334+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 msgr2=0x7f45c00cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:35.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.334+0000 7f45c52d7700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00cbd20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f45b40090b0 tx=0x7f45b4004750 comp rx=0 tx=0).stop 2023-10-14T12:19:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 shutdown_connections 2023-10-14T12:19:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45ac06af00 0x7f45ac06d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45c015d940 0x7f45c015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45c00d1760 0x7f45c01f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 --2- 172.21.15.32:0/1325284880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45c00d1b40 0x7f45c00cbd20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 >> 172.21.15.32:0/1325284880 conn(0x7f45c00d37a0 msgr2=0x7f45c00c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:35.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 shutdown_connections 2023-10-14T12:19:35.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.335+0000 7f45c52d7700 1 -- 172.21.15.32:0/1325284880 wait complete. 2023-10-14T12:19:35.339 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2023-10-14T12:19:35.353 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T12:19:35.353 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T12:19:35.353 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T12:19:35.354 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:19:35.354 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T12:19:35.354 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T12:19:35.355 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T12:19:35.355 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:19:35.355 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T12:19:35.356 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T12:19:35.356 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T12:19:35.356 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:19:35.357 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T12:19:35.357 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T12:19:35.357 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T12:19:35.357 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:19:35.364 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T12:19:35.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T12:19:35.365 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T12:19:35.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T12:19:35.367 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T12:19:35.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T12:19:35.368 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T12:19:35.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T12:19:35.406 INFO:tasks.ceph.mds.a:Started 2023-10-14T12:19:35.407 DEBUG:teuthology.parallel:result is None 2023-10-14T12:19:35.408 INFO:tasks.ceph.mds.c:Started 2023-10-14T12:19:35.408 DEBUG:teuthology.parallel:result is None 2023-10-14T12:19:35.410 INFO:tasks.ceph.mds.b:Started 2023-10-14T12:19:35.411 DEBUG:teuthology.parallel:result is None 2023-10-14T12:19:35.411 INFO:tasks.ceph.mds.d:Started 2023-10-14T12:19:35.412 DEBUG:teuthology.parallel:result is None 2023-10-14T12:19:35.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T12:19:35.496 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2023-10-14T12:19:35.497 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2023-10-14T12:19:35.498 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-10-14T12:19:35.498 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-10-14T12:19:35.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.558+0000 7f2202e15700 1 Processor -- start 2023-10-14T12:19:35.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.559+0000 7f2202e15700 1 -- start start 2023-10-14T12:19:35.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2202e15700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f21fc15a580 0x7f21fc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:35.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2202e15700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc15e8d0 0x7f21fc06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:35.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2202e15700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc071aa0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2202e15700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21fc06d370 con 0x7f21fc15a580 2023-10-14T12:19:35.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2202e15700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc15f140 con 0x7f21fc15e8d0 2023-10-14T12:19:35.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2200bb1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f21fc15a580 0x7f21fc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:35.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2200bb1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f21fc15a580 0x7f21fc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43856/0 (socket says 172.21.15.32:43856) 2023-10-14T12:19:35.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.560+0000 7f2200bb1700 1 -- 172.21.15.32:0/174700095 learned_addr learned my addr 172.21.15.32:0/174700095 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:35.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f21fb7fe700 1 -- 172.21.15.32:0/174700095 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464736700 0 0) 0x7f21fc071aa0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f21fb7fe700 1 -- 172.21.15.32:0/174700095 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e40035b0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f2200bb1700 1 -- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc15e8d0 msgr2=0x7f21fc06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:35.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f2200bb1700 1 --2- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc15e8d0 0x7f21fc06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f2200bb1700 1 -- 172.21.15.32:0/174700095 >> v1:172.21.15.92:6789/0 conn(0x7f21fc06c9b0 legacy=0x7f21fc15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:35.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f2200bb1700 1 -- 172.21.15.32:0/174700095 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc15ee60 con 0x7f21fc15a580 2023-10-14T12:19:35.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.561+0000 7f2200bb1700 1 --2- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15a580 0x7f21fc0727b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009e50 tx=0x7f21f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ff9d2beb515845 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:35.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.562+0000 7f21fb7fe700 1 -- 172.21.15.32:0/174700095 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400e070 con 0x7f21fc15a580 2023-10-14T12:19:35.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.562+0000 7f21fb7fe700 1 -- 172.21.15.32:0/174700095 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f400b910 con 0x7f21fc15a580 2023-10-14T12:19:35.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.562+0000 7f21fb7fe700 1 -- 172.21.15.32:0/174700095 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400bca0 con 0x7f21fc15a580 2023-10-14T12:19:35.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 -- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15a580 msgr2=0x7f21fc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:35.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 --2- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15a580 0x7f21fc0727b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009e50 tx=0x7f21f400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:35.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 -- 172.21.15.32:0/174700095 shutdown_connections 2023-10-14T12:19:35.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 --2- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc15e8d0 0x7f21fc06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 --2- 172.21.15.32:0/174700095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15a580 0x7f21fc0727b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 -- 172.21.15.32:0/174700095 >> 172.21.15.32:0/174700095 conn(0x7f21fc06afb0 msgr2=0x7f21fc0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:35.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 -- 172.21.15.32:0/174700095 shutdown_connections 2023-10-14T12:19:35.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.563+0000 7f2202e15700 1 -- 172.21.15.32:0/174700095 wait complete. 2023-10-14T12:19:35.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.565+0000 7f2202e15700 1 Processor -- start 2023-10-14T12:19:35.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.565+0000 7f2202e15700 1 -- start start 2023-10-14T12:19:35.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.566+0000 7f2202e15700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 0x7f21fc1f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:35.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.566+0000 7f2202e15700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21fc15a580 0x7f21fc0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:35.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.566+0000 7f2202e15700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15e8d0 0x7f21fc0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:35.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.566+0000 7f2202e15700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0c4820 con 0x7f21fc15a580 2023-10-14T12:19:35.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.566+0000 7f2202e15700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc154370 con 0x7f21fc15e8d0 2023-10-14T12:19:35.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.566+0000 7f2202e15700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0c3ba0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 0x7f21fc1f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:35.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 0x7f21fc1f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:45286/0 (socket says 172.21.15.32:45286) 2023-10-14T12:19:35.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 -- 172.21.15.32:0/3896335484 learned_addr learned my addr 172.21.15.32:0/3896335484 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:35.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f21fbfff700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21fc15a580 0x7f21fc0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:35.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 -- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15e8d0 msgr2=0x7f21fc0c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:35.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15e8d0 0x7f21fc0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 -- 172.21.15.32:0/3896335484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21fc15a580 msgr2=0x7f21fc0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:35.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21fc15a580 0x7f21fc0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:35.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 -- 172.21.15.32:0/3896335484 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4009b30 con 0x7f21fc06c9b0 2023-10-14T12:19:35.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f2200bb1700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 0x7f21fc1f6dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b680 tx=0x7f21f4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:35.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.567+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4004920 con 0x7f21fc06c9b0 2023-10-14T12:19:35.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.568+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40099b0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.568+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc0c3e80 con 0x7f21fc06c9b0 2023-10-14T12:19:35.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.568+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f401c680 con 0x7f21fc06c9b0 2023-10-14T12:19:35.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.568+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc0c4440 con 0x7f21fc06c9b0 2023-10-14T12:19:35.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.568+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc04ebb0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.569+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21f401c7e0 con 0x7f21fc06c9b0 2023-10-14T12:19:35.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.569+0000 7f21f97fa700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f21e806af00 0x7f21e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:35.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.570+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f21f408ac10 con 0x7f21fc06c9b0 2023-10-14T12:19:35.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.570+0000 7f21fbfff700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f21e806af00 0x7f21e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:35.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.570+0000 7f21fbfff700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f21e806af00 0x7f21e806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0b35c0 tx=0x7f21ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.574+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21f4056050 con 0x7f21fc06c9b0 2023-10-14T12:19:35.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:35.791+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f21fc0cc6e0 con 0x7f21fc06c9b0 2023-10-14T12:19:36.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.345+0000 7f21f97fa700 1 -- 172.21.15.32:0/3896335484 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f21f4059670 con 0x7f21fc06c9b0 2023-10-14T12:19:36.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f21e806af00 msgr2=0x7f21e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f21e806af00 0x7f21e806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0b35c0 tx=0x7f21ec009040 comp rx=0 tx=0).stop 2023-10-14T12:19:36.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 msgr2=0x7f21fc1f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 0x7f21fc1f6dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b680 tx=0x7f21f4004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 shutdown_connections 2023-10-14T12:19:36.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f21e806af00 0x7f21e806d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21fc15e8d0 0x7f21fc0c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21fc06c9b0 0x7f21fc1f6dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 --2- 172.21.15.32:0/3896335484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21fc15a580 0x7f21fc0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 >> 172.21.15.32:0/3896335484 conn(0x7f21fc06afb0 msgr2=0x7f21fc0aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:36.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 shutdown_connections 2023-10-14T12:19:36.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.347+0000 7f2202e15700 1 -- 172.21.15.32:0/3896335484 wait complete. 2023-10-14T12:19:36.351 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2023-10-14T12:19:36.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T12:19:36.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.494+0000 7fa563a2a700 1 Processor -- start 2023-10-14T12:19:36.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.494+0000 7fa563a2a700 1 -- start start 2023-10-14T12:19:36.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa563a2a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 0x7fa55c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa563a2a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0cf6d0 0x7fa55c0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa563a2a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0cfb30 con 0x7fa55c0d1bc0 2023-10-14T12:19:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa563a2a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0ccc20 con 0x7fa55c15eab0 2023-10-14T12:19:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa563a2a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15ee90 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa560fc5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0cf6d0 0x7fa55c0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa5617c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 0x7fa55c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa561fc7700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa55c0d1bc0 0x7fa55c161510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:55508/0 (socket says 172.21.15.32:55508) 2023-10-14T12:19:36.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa5617c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 0x7fa55c0cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43872/0 (socket says 172.21.15.32:43872) 2023-10-14T12:19:36.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa561fc7700 1 -- 172.21.15.32:0/2484721598 learned_addr learned my addr 172.21.15.32:0/2484721598 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:36.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa553fff700 1 -- 172.21.15.32:0/2484721598 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223417200 0 0) 0x7fa55c0cfb30 con 0x7fa55c0d1bc0 2023-10-14T12:19:36.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa553fff700 1 -- 172.21.15.32:0/2484721598 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5480035b0 con 0x7fa55c0d1bc0 2023-10-14T12:19:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa560fc5700 1 -- 172.21.15.32:0/2484721598 >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 msgr2=0x7fa55c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa560fc5700 1 --2- 172.21.15.32:0/2484721598 >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 0x7fa55c0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.495+0000 7fa560fc5700 1 -- 172.21.15.32:0/2484721598 >> v1:172.21.15.92:6789/0 conn(0x7fa55c0d1bc0 legacy=0x7fa55c161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa560fc5700 1 -- 172.21.15.32:0/2484721598 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c158370 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa5617c6700 1 --2- 172.21.15.32:0/2484721598 >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 0x7fa55c0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa560fc5700 1 --2- 172.21.15.32:0/2484721598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0cf6d0 0x7fa55c0d1680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009840 tx=0x7fa54c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca48c6f9b6f5e6a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:36.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa553fff700 1 -- 172.21.15.32:0/2484721598 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c011830 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa553fff700 1 -- 172.21.15.32:0/2484721598 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c011990 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa553fff700 1 -- 172.21.15.32:0/2484721598 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c011d20 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa563a2a700 1 -- 172.21.15.32:0/2484721598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0cf6d0 msgr2=0x7fa55c0d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa563a2a700 1 --2- 172.21.15.32:0/2484721598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0cf6d0 0x7fa55c0d1680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009840 tx=0x7fa54c009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:36.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa563a2a700 1 -- 172.21.15.32:0/2484721598 shutdown_connections 2023-10-14T12:19:36.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa563a2a700 1 --2- 172.21.15.32:0/2484721598 >> v2:172.21.15.92:3300/0 conn(0x7fa55c15eab0 0x7fa55c0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa563a2a700 1 --2- 172.21.15.32:0/2484721598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0cf6d0 0x7fa55c0d1680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.496+0000 7fa563a2a700 1 -- 172.21.15.32:0/2484721598 >> 172.21.15.32:0/2484721598 conn(0x7fa55c0665a0 msgr2=0x7fa55c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.497+0000 7fa563a2a700 1 -- 172.21.15.32:0/2484721598 shutdown_connections 2023-10-14T12:19:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.497+0000 7fa563a2a700 1 -- 172.21.15.32:0/2484721598 wait complete. 2023-10-14T12:19:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.498+0000 7fa563a2a700 1 Processor -- start 2023-10-14T12:19:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.498+0000 7fa563a2a700 1 -- start start 2023-10-14T12:19:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.498+0000 7fa563a2a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 0x7fa55c15fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.498+0000 7fa563a2a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0d1bc0 0x7fa55c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa563a2a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c15eab0 0x7fa55c161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa563a2a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c6770 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa563a2a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c1f31d0 con 0x7fa55c15eab0 2023-10-14T12:19:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa563a2a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c157980 con 0x7fa55c0d1bc0 2023-10-14T12:19:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 0x7fa55c15fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 0x7fa55c15fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39610/0 (socket says 172.21.15.32:39610) 2023-10-14T12:19:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 -- 172.21.15.32:0/762210371 learned_addr learned my addr 172.21.15.32:0/762210371 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa561fc7700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c15eab0 0x7fa55c161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa560fc5700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0d1bc0 0x7fa55c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 -- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0d1bc0 msgr2=0x7fa55c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0d1bc0 0x7fa55c157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 -- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c15eab0 msgr2=0x7fa55c161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c15eab0 0x7fa55c161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 -- 172.21.15.32:0/762210371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580094a0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa561fc7700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c15eab0 0x7fa55c161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa5617c6700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 0x7fa55c15fb70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa55800ebe0 tx=0x7fa558009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800c910 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55800ca70 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c0094a0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.499+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800cde0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.500+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c161a70 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.500+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c0c68b0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.501+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa558013470 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.501+0000 7fa551ffb700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa54006af00 0x7fa54006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.501+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa558089440 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.502+0000 7fa560fc5700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa54006af00 0x7fa54006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.502+0000 7fa560fc5700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa54006af00 0x7fa54006d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0b71c0 tx=0x7fa54c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.506+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa55c0c68b0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.786+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa55c0c68b0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.786+0000 7fa551ffb700 1 -- 172.21.15.32:0/762210371 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa55c0c68b0 con 0x7fa55c0cf6d0 2023-10-14T12:19:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:36.788 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2023-10-14T12:19:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2023-10-14T12:19:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hiplrqSaHRAAES8OghPOSw2npKafMXiIAQ==", 2023-10-14T12:19:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-14T12:19:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-14T12:19:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2023-10-14T12:19:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hiplPdFyKhAAHoa5EIYmuDylqZvqAvW0aw==", 2023-10-14T12:19:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-14T12:19:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-14T12:19:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2023-10-14T12:19:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hiplnuYQJRAAXr4jabJT4v7t7n5/nHTuiQ==", 2023-10-14T12:19:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-14T12:19:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-14T12:19:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2023-10-14T12:19:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hipln7H0MRAA4paEuBYUWvi1C3Q34jueZg==", 2023-10-14T12:19:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-14T12:19:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-14T12:19:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2023-10-14T12:19:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD3hiplzH7cGhAA88LnkIr4eFWoIN55H1CnhQ==", 2023-10-14T12:19:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2023-10-14T12:19:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD6hiplf4u+GhAAlNk5fZGFEahIUIab1n1ZmQ==", 2023-10-14T12:19:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2023-10-14T12:19:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD9hiplCV+mGhAAslJMVkAfYSD8TFuDngSJDw==", 2023-10-14T12:19:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2023-10-14T12:19:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAAhypla9EFGhAAGezETrPKT/nm9vaMALDi2Q==", 2023-10-14T12:19:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2023-10-14T12:19:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAGhyplWcDqFhAACaifXfBK0P7iW9M736dFFg==", 2023-10-14T12:19:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2023-10-14T12:19:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAJhypl6CRpFxAATFnfNGOdwssFbo0WSc630A==", 2023-10-14T12:19:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2023-10-14T12:19:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAMhypl3E3gFhAA2u0NVzKX2u11h7lGQWMoOQ==", 2023-10-14T12:19:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2023-10-14T12:19:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAPhypla+Z1FxAAOC3wIVmu+ugmHLKIhxMfTw==", 2023-10-14T12:19:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-14T12:19:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-14T12:19:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2023-10-14T12:19:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hiplbLVwNhAA8WYVpBrISyYWaAdxO/MbXg==", 2023-10-14T12:19:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-14T12:19:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-14T12:19:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-14T12:19:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2023-10-14T12:19:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD2hipl/kK0ARAAdDok989IrMUt12F3mU2l8w==", 2023-10-14T12:19:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-14T12:19:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-14T12:19:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-14T12:19:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.2", 2023-10-14T12:19:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hiplPAjpORAAZfBb1jttYTRyMNLJ0NatGg==", 2023-10-14T12:19:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-14T12:19:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-14T12:19:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-14T12:19:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.3", 2023-10-14T12:19:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD2hipl21R2BxAAVzz6xKow1ABtONFgIpTVZw==", 2023-10-14T12:19:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-14T12:19:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-14T12:19:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-14T12:19:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-14T12:19:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2023-10-14T12:19:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD0hiplwu3MOhAAYcYqFSApRYtJJ5AjKJMH3A==", 2023-10-14T12:19:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-10-14T12:19:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-14T12:19:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-14T12:19:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mds", 2023-10-14T12:19:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAVhyplayghGBAAtx1cNrazkHKaX4NZ3U2RBg==", 2023-10-14T12:19:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T12:19:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T12:19:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAVhypl8DMhGBAAdBloP4mYp00RXdSnbS9jHw==", 2023-10-14T12:19:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T12:19:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-osd", 2023-10-14T12:19:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAVhyplTzwhGBAAMRyJqnAlUL1+RKbzZJYjPg==", 2023-10-14T12:19:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T12:19:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T12:19:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAVhyplXEQhGBAA/D4hi+KMnS2vPPYptYmUcg==", 2023-10-14T12:19:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T12:19:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T12:19:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAVhyplZkwhGBAAhYAY6GvHGI5HHjeUaWlHMw==", 2023-10-14T12:19:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T12:19:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T12:19:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAVhyplk1QhGBAAcpn9WKzpATrbejPXoFz9KQ==", 2023-10-14T12:19:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T12:19:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2023-10-14T12:19:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hipllvgOGhAAH2D/yYTLtMoUoZrou6FNAQ==", 2023-10-14T12:19:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-10-14T12:19:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2023-10-14T12:19:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-14T12:19:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2023-10-14T12:19:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQD1hipl6RBqFRAAEXs8yqVj3iQWD4kBHomBcA==", 2023-10-14T12:19:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-14T12:19:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-10-14T12:19:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2023-10-14T12:19:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-14T12:19:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2023-10-14T12:19:36.833 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:36.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa54006af00 msgr2=0x7fa54006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa54006af00 0x7fa54006d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0b71c0 tx=0x7fa54c008030 comp rx=0 tx=0).stop 2023-10-14T12:19:36.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 msgr2=0x7fa55c15fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 0x7fa55c15fb70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa55800ebe0 tx=0x7fa558009ec0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 shutdown_connections 2023-10-14T12:19:36.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa54006af00 0x7fa54006d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c15eab0 0x7fa55c161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c0cf6d0 0x7fa55c15fb70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 --2- 172.21.15.32:0/762210371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa55c0d1bc0 0x7fa55c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 >> 172.21.15.32:0/762210371 conn(0x7fa55c0665a0 msgr2=0x7fa55c0ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:36.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 shutdown_connections 2023-10-14T12:19:36.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.788+0000 7fa563a2a700 1 -- 172.21.15.32:0/762210371 wait complete. 2023-10-14T12:19:36.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T12:19:36.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.963+0000 7f64e2a15700 1 Processor -- start 2023-10-14T12:19:36.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.963+0000 7f64e2a15700 1 -- start start 2023-10-14T12:19:36.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64e2a15700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f64dc161670 0x7f64dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64e2a15700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc0b2950 0x7f64dc06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64e2a15700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc071ab0 con 0x7f64dc0cc3f0 2023-10-14T12:19:36.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64e2a15700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc161bc0 con 0x7f64dc161670 2023-10-14T12:19:36.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64e2a15700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc161ea0 con 0x7f64dc0b2950 2023-10-14T12:19:36.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64db7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f64dc161670 0x7f64dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64e0fb2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc0b2950 0x7f64dc06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64dbfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f64dc0cc3f0 0x7f64dc0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:55518/0 (socket says 172.21.15.32:55518) 2023-10-14T12:19:36.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.964+0000 7f64dbfff700 1 -- 172.21.15.32:0/557302530 learned_addr learned my addr 172.21.15.32:0/557302530 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:36.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e0fb2700 1 -- 172.21.15.32:0/557302530 >> v2:172.21.15.92:3300/0 conn(0x7f64dc161670 msgr2=0x7f64dc06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:36.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e0fb2700 1 --2- 172.21.15.32:0/557302530 >> v2:172.21.15.92:3300/0 conn(0x7f64dc161670 0x7f64dc06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e0fb2700 1 -- 172.21.15.32:0/557302530 >> v1:172.21.15.92:6789/0 conn(0x7f64dc0cc3f0 legacy=0x7f64dc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e0fb2700 1 -- 172.21.15.32:0/557302530 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc162180 con 0x7f64dc0b2950 2023-10-14T12:19:36.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64db7fe700 1 --2- 172.21.15.32:0/557302530 >> v2:172.21.15.92:3300/0 conn(0x7f64dc161670 0x7f64dc06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:36.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e0fb2700 1 --2- 172.21.15.32:0/557302530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc0b2950 0x7f64dc06ad80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009d90 tx=0x7f64d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1fb084927d127fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:36.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64daffd700 1 -- 172.21.15.32:0/557302530 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400e070 con 0x7f64dc0b2950 2023-10-14T12:19:36.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64daffd700 1 -- 172.21.15.32:0/557302530 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400bb20 con 0x7f64dc0b2950 2023-10-14T12:19:36.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64daffd700 1 -- 172.21.15.32:0/557302530 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4012430 con 0x7f64dc0b2950 2023-10-14T12:19:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e2a15700 1 -- 172.21.15.32:0/557302530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc0b2950 msgr2=0x7f64dc06ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.965+0000 7f64e2a15700 1 --2- 172.21.15.32:0/557302530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc0b2950 0x7f64dc06ad80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009d90 tx=0x7f64d400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.966+0000 7f64e2a15700 1 -- 172.21.15.32:0/557302530 shutdown_connections 2023-10-14T12:19:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.966+0000 7f64e2a15700 1 --2- 172.21.15.32:0/557302530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc0b2950 0x7f64dc06ad80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.966+0000 7f64e2a15700 1 --2- 172.21.15.32:0/557302530 >> v2:172.21.15.92:3300/0 conn(0x7f64dc161670 0x7f64dc06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.966+0000 7f64e2a15700 1 -- 172.21.15.32:0/557302530 >> 172.21.15.32:0/557302530 conn(0x7f64dc06dac0 msgr2=0x7f64dc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.966+0000 7f64e2a15700 1 -- 172.21.15.32:0/557302530 shutdown_connections 2023-10-14T12:19:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.966+0000 7f64e2a15700 1 -- 172.21.15.32:0/557302530 wait complete. 2023-10-14T12:19:36.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.967+0000 7f64e2a15700 1 Processor -- start 2023-10-14T12:19:36.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.967+0000 7f64e2a15700 1 -- start start 2023-10-14T12:19:36.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e2a15700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 0x7f64dc15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e2a15700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64dc0cc3f0 0x7f64dc0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e2a15700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc161670 0x7f64dc0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e2a15700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0c7580 con 0x7f64dc0b2950 2023-10-14T12:19:36.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e2a15700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0c7b40 con 0x7f64dc0cc3f0 2023-10-14T12:19:36.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e2a15700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0b5e30 con 0x7f64dc161670 2023-10-14T12:19:36.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 0x7f64dc15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 0x7f64dc15c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39624/0 (socket says 172.21.15.32:39624) 2023-10-14T12:19:36.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 -- 172.21.15.32:0/4263081135 learned_addr learned my addr 172.21.15.32:0/4263081135 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:36.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64db7fe700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64dc0cc3f0 0x7f64dc0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64e0fb2700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc161670 0x7f64dc0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 -- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc161670 msgr2=0x7f64dc0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc161670 0x7f64dc0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 -- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64dc0cc3f0 msgr2=0x7f64dc0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:36.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64dc0cc3f0 0x7f64dc0b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:36.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 -- 172.21.15.32:0/4263081135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0094a0 con 0x7f64dc0b2950 2023-10-14T12:19:36.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.968+0000 7f64dbfff700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 0x7f64dc15c870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c580 tx=0x7f64c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:36.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.969+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4005d70 con 0x7f64dc0b2950 2023-10-14T12:19:36.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.969+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40070d0 con 0x7f64dc0b2950 2023-10-14T12:19:36.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.969+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d4009a70 con 0x7f64dc0b2950 2023-10-14T12:19:36.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.969+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4007440 con 0x7f64dc0b2950 2023-10-14T12:19:36.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.969+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc0cd060 con 0x7f64dc0b2950 2023-10-14T12:19:36.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.969+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc067d20 con 0x7f64dc0b2950 2023-10-14T12:19:36.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.970+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f64c40075a0 con 0x7f64dc0b2950 2023-10-14T12:19:36.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.970+0000 7f64d8ff9700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f64bc06af00 0x7f64bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:36.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.971+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64c40885e0 con 0x7f64dc0b2950 2023-10-14T12:19:36.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.971+0000 7f64db7fe700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f64bc06af00 0x7f64bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:36.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.971+0000 7f64db7fe700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f64bc06af00 0x7f64bc06d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0b1ee0 tx=0x7f64cc009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:36.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:36.975+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64c4053a10 con 0x7f64dc0b2950 2023-10-14T12:19:37.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.258+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f64dc0b6430 con 0x7f64dc0b2950 2023-10-14T12:19:37.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.260+0000 7f64d8ff9700 1 -- 172.21.15.32:0/4263081135 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f64c4057030 con 0x7f64dc0b2950 2023-10-14T12:19:37.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f64bc06af00 msgr2=0x7f64bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f64bc06af00 0x7f64bc06d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0b1ee0 tx=0x7f64cc009210 comp rx=0 tx=0).stop 2023-10-14T12:19:37.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 msgr2=0x7f64dc15c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 0x7f64dc15c870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c580 tx=0x7f64c400c890 comp rx=0 tx=0).stop 2023-10-14T12:19:37.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 shutdown_connections 2023-10-14T12:19:37.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64dc161670 0x7f64dc0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64dc0b2950 0x7f64dc15c870 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f64bc06af00 0x7f64bc06d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 --2- 172.21.15.32:0/4263081135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64dc0cc3f0 0x7f64dc0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 >> 172.21.15.32:0/4263081135 conn(0x7f64dc06dac0 msgr2=0x7f64dc0cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:37.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 shutdown_connections 2023-10-14T12:19:37.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.262+0000 7f64e2a15700 1 -- 172.21.15.32:0/4263081135 wait complete. 2023-10-14T12:19:37.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T12:19:37.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.402+0000 7f9c3b23a700 1 Processor -- start 2023-10-14T12:19:37.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.402+0000 7f9c3b23a700 1 -- start start 2023-10-14T12:19:37.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c3b23a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9c3415bbc0 0x7f9c340d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c3b23a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c340cce60 con 0x7f9c340ce4c0 2023-10-14T12:19:37.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c3b23a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c340b2ba0 con 0x7f9c3415bfa0 2023-10-14T12:19:37.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c3b23a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c340cd4e0 con 0x7f9c3415bbc0 2023-10-14T12:19:37.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c397d7700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9c340ce4c0 0x7f9c340b0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56662/0 (socket says 172.21.15.32:56662) 2023-10-14T12:19:37.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c397d7700 1 -- 172.21.15.32:0/1839677255 learned_addr learned my addr 172.21.15.32:0/1839677255 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:37.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c38fd6700 1 --2- 172.21.15.32:0/1839677255 >> v2:172.21.15.92:3300/0 conn(0x7f9c3415bbc0 0x7f9c340d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988864294 0 0) 0x7f9c340cce60 con 0x7f9c340ce4c0 2023-10-14T12:19:37.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c240035b0 con 0x7f9c340ce4c0 2023-10-14T12:19:37.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3111198054 0 0) 0x7f9c240035b0 con 0x7f9c340ce4c0 2023-10-14T12:19:37.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 >> v2:172.21.15.92:3300/0 conn(0x7f9c3415bbc0 msgr2=0x7f9c340d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:37.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.403+0000 7f9c337fe700 1 --2- 172.21.15.32:0/1839677255 >> v2:172.21.15.92:3300/0 conn(0x7f9c3415bbc0 0x7f9c340d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 >> v1:172.21.15.92:6789/0 conn(0x7f9c3415bfa0 legacy=0x7f9c340cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340cd100 con 0x7f9c340ce4c0 2023-10-14T12:19:37.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f9c2c0019f0 con 0x7f9c340ce4c0 2023-10-14T12:19:37.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 >> v1:172.21.15.32:6789/0 conn(0x7f9c340ce4c0 legacy=0x7f9c340b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c24003a00 0x7f9c24003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c24004850 0x7f9c24004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c2400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340cd4e0 con 0x7f9c24005210 2023-10-14T12:19:37.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2400c1b0 con 0x7f9c24003a00 2023-10-14T12:19:37.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2400c370 con 0x7f9c24004850 2023-10-14T12:19:37.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c38fd6700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c24003a00 0x7f9c24003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c2400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c33fff700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c24004850 0x7f9c24004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 -- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c24004850 msgr2=0x7f9c24004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:37.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c24004850 0x7f9c24004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 -- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c24003a00 msgr2=0x7f9c24003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:37.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c24003a00 0x7f9c24003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 -- 172.21.15.32:0/1839677255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240035b0 con 0x7f9c24005210 2023-10-14T12:19:37.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 -- 172.21.15.32:0/1839677255 reap_dead start 2023-10-14T12:19:37.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c397d7700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c2400ba10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a830 tx=0x7f9c24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8ae3351e6d2c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:37.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00a2f0 con 0x7f9c24005210 2023-10-14T12:19:37.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c012600 con 0x7f9c24005210 2023-10-14T12:19:37.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.404+0000 7f9c337fe700 1 -- 172.21.15.32:0/1839677255 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0129b0 con 0x7f9c24005210 2023-10-14T12:19:37.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 -- 172.21.15.32:0/1839677255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 msgr2=0x7f9c2400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c2400ba10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a830 tx=0x7f9c24005880 comp rx=0 tx=0).stop 2023-10-14T12:19:37.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 -- 172.21.15.32:0/1839677255 shutdown_connections 2023-10-14T12:19:37.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/1839677255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c2400ba10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 -- 172.21.15.32:0/1839677255 >> 172.21.15.32:0/1839677255 conn(0x7f9c340d15f0 msgr2=0x7f9c340d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:37.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 -- 172.21.15.32:0/1839677255 shutdown_connections 2023-10-14T12:19:37.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.405+0000 7f9c3b23a700 1 -- 172.21.15.32:0/1839677255 wait complete. 2023-10-14T12:19:37.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.406+0000 7f9c3b23a700 1 Processor -- start 2023-10-14T12:19:37.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.406+0000 7f9c3b23a700 1 -- start start 2023-10-14T12:19:37.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c3b23a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c340c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c3b23a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340b18d0 0x7f9c340b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c3b23a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3415e780 0x7f9c3415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c3b23a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340b2290 con 0x7f9c24005210 2023-10-14T12:19:37.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c3b23a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340c5df0 con 0x7f9c3415e780 2023-10-14T12:19:37.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c3b23a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3415e2f0 con 0x7f9c340b18d0 2023-10-14T12:19:37.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c38fd6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c340c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c38fd6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c340c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39648/0 (socket says 172.21.15.32:39648) 2023-10-14T12:19:37.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c38fd6700 1 -- 172.21.15.32:0/3147174587 learned_addr learned my addr 172.21.15.32:0/3147174587 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:37.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c397d7700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3415e780 0x7f9c3415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c38fd6700 1 -- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340b18d0 msgr2=0x7f9c340b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.407+0000 7f9c33fff700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340b18d0 0x7f9c340b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c38fd6700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340b18d0 0x7f9c340b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c38fd6700 1 -- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3415e780 msgr2=0x7f9c3415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c38fd6700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3415e780 0x7f9c3415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c38fd6700 1 -- 172.21.15.32:0/3147174587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340c79b0 con 0x7f9c24005210 2023-10-14T12:19:37.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c397d7700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3415e780 0x7f9c3415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:37.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c38fd6700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c340c58b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c28003a60 tx=0x7f9c28003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:37.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2801b040 con 0x7f9c24005210 2023-10-14T12:19:37.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2801f620 con 0x7f9c24005210 2023-10-14T12:19:37.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c340c7c80 con 0x7f9c24005210 2023-10-14T12:19:37.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2801f9d0 con 0x7f9c24005210 2023-10-14T12:19:37.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.408+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3415df80 con 0x7f9c24005210 2023-10-14T12:19:37.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.409+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3406bd30 con 0x7f9c24005210 2023-10-14T12:19:37.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.410+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c2801fb30 con 0x7f9c24005210 2023-10-14T12:19:37.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.410+0000 7f9c317fa700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1806af00 0x7f9c1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.410+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c28091c60 con 0x7f9c24005210 2023-10-14T12:19:37.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.410+0000 7f9c33fff700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1806af00 0x7f9c1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.411+0000 7f9c33fff700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1806af00 0x7f9c1806d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000e480 tx=0x7f9c2000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:37.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.415+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c2805d0f0 con 0x7f9c24005210 2023-10-14T12:19:37.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.697+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9c34067d20 con 0x7f9c24005210 2023-10-14T12:19:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.699+0000 7f9c317fa700 1 -- 172.21.15.32:0/3147174587 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9c28060710 con 0x7f9c24005210 2023-10-14T12:19:37.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1806af00 msgr2=0x7f9c1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1806af00 0x7f9c1806d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000e480 tx=0x7f9c2000b040 comp rx=0 tx=0).stop 2023-10-14T12:19:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 msgr2=0x7f9c340c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c340c58b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c28003a60 tx=0x7f9c28003e20 comp rx=0 tx=0).stop 2023-10-14T12:19:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 shutdown_connections 2023-10-14T12:19:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1806af00 0x7f9c1806d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3415e780 0x7f9c3415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c24005210 0x7f9c340c58b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 --2- 172.21.15.32:0/3147174587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c340b18d0 0x7f9c340b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 >> 172.21.15.32:0/3147174587 conn(0x7f9c340d15f0 msgr2=0x7f9c3415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:37.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 shutdown_connections 2023-10-14T12:19:37.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.701+0000 7f9c3b23a700 1 -- 172.21.15.32:0/3147174587 wait complete. 2023-10-14T12:19:37.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T12:19:37.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.839+0000 7f82d1cb2700 1 Processor -- start 2023-10-14T12:19:37.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.839+0000 7f82d1cb2700 1 -- start start 2023-10-14T12:19:37.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82d1cb2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f82cc0ce4c0 0x7f82cc0d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82d1cb2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bfa0 0x7f82cc0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82d1cb2700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc0cce60 con 0x7f82cc15bbc0 2023-10-14T12:19:37.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82d1cb2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0cd4e0 con 0x7f82cc0ce4c0 2023-10-14T12:19:37.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82d1cb2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0b2ba0 con 0x7f82cc15bfa0 2023-10-14T12:19:37.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82caffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f82cc0ce4c0 0x7f82cc0d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82cb7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f82cc15bbc0 0x7f82cc0cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56678/0 (socket says 172.21.15.32:56678) 2023-10-14T12:19:37.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82caffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f82cc0ce4c0 0x7f82cc0d20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39656/0 (socket says 172.21.15.32:39656) 2023-10-14T12:19:37.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82cb7fe700 1 -- 172.21.15.32:0/1118887991 learned_addr learned my addr 172.21.15.32:0/1118887991 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:37.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82cbfff700 1 --2- 172.21.15.32:0/1118887991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bfa0 0x7f82cc0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82caffd700 1 -- 172.21.15.32:0/1118887991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bfa0 msgr2=0x7f82cc0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:37.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82caffd700 1 --2- 172.21.15.32:0/1118887991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bfa0 0x7f82cc0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82caffd700 1 -- 172.21.15.32:0/1118887991 >> v1:172.21.15.32:6789/0 conn(0x7f82cc15bbc0 legacy=0x7f82cc0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.840+0000 7f82caffd700 1 -- 172.21.15.32:0/1118887991 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0cd100 con 0x7f82cc0ce4c0 2023-10-14T12:19:37.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82caffd700 1 --2- 172.21.15.32:0/1118887991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0d20e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009840 tx=0x7f82b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbf07a12e23701 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:37.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82ca7fc700 1 -- 172.21.15.32:0/1118887991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4011830 con 0x7f82cc0ce4c0 2023-10-14T12:19:37.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82ca7fc700 1 -- 172.21.15.32:0/1118887991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b4011990 con 0x7f82cc0ce4c0 2023-10-14T12:19:37.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82ca7fc700 1 -- 172.21.15.32:0/1118887991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4011d20 con 0x7f82cc0ce4c0 2023-10-14T12:19:37.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 -- 172.21.15.32:0/1118887991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc0ce4c0 msgr2=0x7f82cc0d20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/1118887991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0d20e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009840 tx=0x7f82b4009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:37.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 -- 172.21.15.32:0/1118887991 shutdown_connections 2023-10-14T12:19:37.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/1118887991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bfa0 0x7f82cc0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/1118887991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0d20e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 -- 172.21.15.32:0/1118887991 >> 172.21.15.32:0/1118887991 conn(0x7f82cc0d15f0 msgr2=0x7f82cc0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:37.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 -- 172.21.15.32:0/1118887991 shutdown_connections 2023-10-14T12:19:37.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.841+0000 7f82d1cb2700 1 -- 172.21.15.32:0/1118887991 wait complete. 2023-10-14T12:19:37.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.843+0000 7f82d1cb2700 1 Processor -- start 2023-10-14T12:19:37.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.843+0000 7f82d1cb2700 1 -- start start 2023-10-14T12:19:37.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82d1cb2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82d1cb2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bbc0 0x7f82cc0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82d1cb2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 0x7f82cc14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82d1cb2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0af510 con 0x7f82cc15bfa0 2023-10-14T12:19:37.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82d1cb2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c6170 con 0x7f82cc0ce4c0 2023-10-14T12:19:37.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82d1cb2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc14ed00 con 0x7f82cc15bbc0 2023-10-14T12:19:37.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 0x7f82cc14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 0x7f82cc14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39664/0 (socket says 172.21.15.32:39664) 2023-10-14T12:19:37.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82cbfff700 1 -- 172.21.15.32:0/2210841234 learned_addr learned my addr 172.21.15.32:0/2210841234 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:37.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.844+0000 7f82cb7fe700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cbfff700 1 -- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bbc0 msgr2=0x7f82cc0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cbfff700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bbc0 0x7f82cc0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cbfff700 1 -- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82cc0ce4c0 msgr2=0x7f82cc0ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:37.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cbfff700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:37.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cbfff700 1 -- 172.21.15.32:0/2210841234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40094a0 con 0x7f82cc15bfa0 2023-10-14T12:19:37.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cb7fe700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:37.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82cbfff700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 0x7f82cc14e7c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82c4007e60 tx=0x7f82c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:37.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400ed80 con 0x7f82cc15bfa0 2023-10-14T12:19:37.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4014420 con 0x7f82cc15bfa0 2023-10-14T12:19:37.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc0ae990 con 0x7f82cc15bfa0 2023-10-14T12:19:37.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40147d0 con 0x7f82cc15bfa0 2023-10-14T12:19:37.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.845+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc0aef50 con 0x7f82cc15bfa0 2023-10-14T12:19:37.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.846+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc06dfb0 con 0x7f82cc15bfa0 2023-10-14T12:19:37.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.846+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82c4014930 con 0x7f82cc15bfa0 2023-10-14T12:19:37.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.847+0000 7f82c3fff700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f82ac06af00 0x7f82ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:37.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.847+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f82c4089970 con 0x7f82cc15bfa0 2023-10-14T12:19:37.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.847+0000 7f82cb7fe700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f82ac06af00 0x7f82ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:37.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.848+0000 7f82cb7fe700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f82ac06af00 0x7f82ac06d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f82bc005910 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:37.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:37.851+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82c4054d70 con 0x7f82cc15bfa0 2023-10-14T12:19:38.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.135+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f82cc067d20 con 0x7f82cc15bfa0 2023-10-14T12:19:38.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.137+0000 7f82c3fff700 1 -- 172.21.15.32:0/2210841234 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f82c4058390 con 0x7f82cc15bfa0 2023-10-14T12:19:38.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f82ac06af00 msgr2=0x7f82ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f82ac06af00 0x7f82ac06d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f82bc005910 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2023-10-14T12:19:38.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 msgr2=0x7f82cc14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 0x7f82cc14e7c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82c4007e60 tx=0x7f82c400e3c0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 shutdown_connections 2023-10-14T12:19:38.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82cc15bfa0 0x7f82cc14e7c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f82ac06af00 0x7f82ac06d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82cc0ce4c0 0x7f82cc0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 --2- 172.21.15.32:0/2210841234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82cc15bbc0 0x7f82cc0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.139+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 >> 172.21.15.32:0/2210841234 conn(0x7f82cc0d15f0 msgr2=0x7f82cc153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:38.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.140+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 shutdown_connections 2023-10-14T12:19:38.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.140+0000 7f82d1cb2700 1 -- 172.21.15.32:0/2210841234 wait complete. 2023-10-14T12:19:38.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T12:19:38.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.278+0000 7f9622147700 1 Processor -- start 2023-10-14T12:19:38.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.278+0000 7f9622147700 1 -- start start 2023-10-14T12:19:38.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f9622147700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f961c15e0c0 0x7f961c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f9622147700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f961c0cfc00 0x7f961c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f9622147700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c06cb70 con 0x7f961c15dce0 2023-10-14T12:19:38.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f9622147700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c0cbc40 con 0x7f961c0cfc00 2023-10-14T12:19:38.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f9622147700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c06ce50 con 0x7f961c15e0c0 2023-10-14T12:19:38.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f961c15dce0 0x7f961c0cf4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56692/0 (socket says 172.21.15.32:56692) 2023-10-14T12:19:38.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f961c0cfc00 0x7f961c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961b7fe700 1 -- 172.21.15.32:0/3178448947 learned_addr learned my addr 172.21.15.32:0/3178448947 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:38.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961affd700 1 --2- 172.21.15.32:0/3178448947 >> v2:172.21.15.92:3300/0 conn(0x7f961c15e0c0 0x7f961c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961bfff700 1 -- 172.21.15.32:0/3178448947 >> v2:172.21.15.92:3300/0 conn(0x7f961c15e0c0 msgr2=0x7f961c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:38.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961bfff700 1 --2- 172.21.15.32:0/3178448947 >> v2:172.21.15.92:3300/0 conn(0x7f961c15e0c0 0x7f961c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961bfff700 1 -- 172.21.15.32:0/3178448947 >> v1:172.21.15.32:6789/0 conn(0x7f961c15dce0 legacy=0x7f961c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961bfff700 1 -- 172.21.15.32:0/3178448947 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c06d130 con 0x7f961c0cfc00 2023-10-14T12:19:38.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.279+0000 7f961a7fc700 1 -- 172.21.15.32:0/3178448947 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249916286 0 0) 0x7f961c06cb70 con 0x7f961c15dce0 2023-10-14T12:19:38.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f961bfff700 1 --2- 172.21.15.32:0/3178448947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c0cc090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f961c0b41e0 tx=0x7f961400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1e5b1d93682733 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:38.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f961a7fc700 1 -- 172.21.15.32:0/3178448947 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400e070 con 0x7f961c0cfc00 2023-10-14T12:19:38.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f961a7fc700 1 -- 172.21.15.32:0/3178448947 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400bbd0 con 0x7f961c0cfc00 2023-10-14T12:19:38.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f961a7fc700 1 -- 172.21.15.32:0/3178448947 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614012430 con 0x7f961c0cfc00 2023-10-14T12:19:38.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 -- 172.21.15.32:0/3178448947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 msgr2=0x7f961c0cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 --2- 172.21.15.32:0/3178448947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c0cc090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f961c0b41e0 tx=0x7f961400b330 comp rx=0 tx=0).stop 2023-10-14T12:19:38.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 -- 172.21.15.32:0/3178448947 shutdown_connections 2023-10-14T12:19:38.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 --2- 172.21.15.32:0/3178448947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c0cc090 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 --2- 172.21.15.32:0/3178448947 >> v2:172.21.15.92:3300/0 conn(0x7f961c15e0c0 0x7f961c0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 -- 172.21.15.32:0/3178448947 >> 172.21.15.32:0/3178448947 conn(0x7f961c0d15f0 msgr2=0x7f961c0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:38.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 -- 172.21.15.32:0/3178448947 shutdown_connections 2023-10-14T12:19:38.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.280+0000 7f9622147700 1 -- 172.21.15.32:0/3178448947 wait complete. 2023-10-14T12:19:38.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.281+0000 7f9622147700 1 Processor -- start 2023-10-14T12:19:38.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 -- start start 2023-10-14T12:19:38.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c15dce0 0x7f961c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f961c15e0c0 0x7f961c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0b2ee0 con 0x7f961c0cfc00 2023-10-14T12:19:38.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0b2920 con 0x7f961c15dce0 2023-10-14T12:19:38.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f9622147700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0b2c00 con 0x7f961c15e0c0 2023-10-14T12:19:38.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f961b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f961b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c1592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39674/0 (socket says 172.21.15.32:39674) 2023-10-14T12:19:38.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.282+0000 7f961b7fe700 1 -- 172.21.15.32:0/1360552251 learned_addr learned my addr 172.21.15.32:0/1360552251 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:38.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961affd700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c15dce0 0x7f961c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961bfff700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f961c15e0c0 0x7f961c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961b7fe700 1 -- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f961c15e0c0 msgr2=0x7f961c15f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961b7fe700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f961c15e0c0 0x7f961c15f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961b7fe700 1 -- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c15dce0 msgr2=0x7f961c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961b7fe700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c15dce0 0x7f961c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961b7fe700 1 -- 172.21.15.32:0/1360552251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009a70 con 0x7f961c0cfc00 2023-10-14T12:19:38.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961bfff700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f961c15e0c0 0x7f961c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:38.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f961b7fe700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c1592e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f960c0011e0 tx=0x7f960c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:38.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c004c80 con 0x7f961c0cfc00 2023-10-14T12:19:38.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c004de0 con 0x7f961c0cfc00 2023-10-14T12:19:38.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c159bc0 con 0x7f961c0cfc00 2023-10-14T12:19:38.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c007310 con 0x7f961c0cfc00 2023-10-14T12:19:38.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.283+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c159820 con 0x7f961c0cfc00 2023-10-14T12:19:38.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.284+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c15a0e0 con 0x7f961c0cfc00 2023-10-14T12:19:38.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.285+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f960c007470 con 0x7f961c0cfc00 2023-10-14T12:19:38.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.285+0000 7f9613fff700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95fc06af30 0x7f95fc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.285+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f960c088f50 con 0x7f961c0cfc00 2023-10-14T12:19:38.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.285+0000 7f961affd700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95fc06af30 0x7f95fc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.286+0000 7f961affd700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95fc06af30 0x7f95fc06d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f961c0c8dc0 tx=0x7f9604008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:38.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.290+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f960c054350 con 0x7f961c0cfc00 2023-10-14T12:19:38.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.578+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f961c067d20 con 0x7f961c0cfc00 2023-10-14T12:19:38.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.580+0000 7f9613fff700 1 -- 172.21.15.32:0/1360552251 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f960c057970 con 0x7f961c0cfc00 2023-10-14T12:19:38.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95fc06af30 msgr2=0x7f95fc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95fc06af30 0x7f95fc06d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f961c0c8dc0 tx=0x7f9604008040 comp rx=0 tx=0).stop 2023-10-14T12:19:38.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 msgr2=0x7f961c1592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c1592e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f960c0011e0 tx=0x7f960c00ca30 comp rx=0 tx=0).stop 2023-10-14T12:19:38.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 shutdown_connections 2023-10-14T12:19:38.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f961c15e0c0 0x7f961c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f961c0cfc00 0x7f961c1592e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f95fc06af30 0x7f95fc06d3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 --2- 172.21.15.32:0/1360552251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c15dce0 0x7f961c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 >> 172.21.15.32:0/1360552251 conn(0x7f961c0d15f0 msgr2=0x7f961c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:38.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 shutdown_connections 2023-10-14T12:19:38.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.582+0000 7f9622147700 1 -- 172.21.15.32:0/1360552251 wait complete. 2023-10-14T12:19:38.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T12:19:38.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.720+0000 7f382466c700 1 Processor -- start 2023-10-14T12:19:38.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.720+0000 7f382466c700 1 -- start start 2023-10-14T12:19:38.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f382466c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f381c15de00 0x7f381c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f382466c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f381c06d8d0 0x7f381c071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f382466c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c071a60 0x7f381c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f382466c700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c06dd50 con 0x7f381c06d8d0 2023-10-14T12:19:38.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f382466c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c162520 con 0x7f381c15de00 2023-10-14T12:19:38.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f382466c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c161950 con 0x7f381c071a60 2023-10-14T12:19:38.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f3821c07700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f381c06d8d0 0x7f381c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f3821c07700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f381c06d8d0 0x7f381c071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39682/0 (socket says 172.21.15.32:39682) 2023-10-14T12:19:38.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f3821c07700 1 -- 172.21.15.32:0/4239538209 learned_addr learned my addr 172.21.15.32:0/4239538209 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:38.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f3822408700 1 --2- 172.21.15.32:0/4239538209 >> v2:172.21.15.92:3300/0 conn(0x7f381c15de00 0x7f381c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.721+0000 7f3822c09700 1 --2- 172.21.15.32:0/4239538209 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c071a60 0x7f381c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821c07700 1 -- 172.21.15.32:0/4239538209 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c071a60 msgr2=0x7f381c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:38.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821c07700 1 --2- 172.21.15.32:0/4239538209 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c071a60 0x7f381c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821c07700 1 -- 172.21.15.32:0/4239538209 >> v2:172.21.15.92:3300/0 conn(0x7f381c15de00 msgr2=0x7f381c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:38.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821c07700 1 --2- 172.21.15.32:0/4239538209 >> v2:172.21.15.92:3300/0 conn(0x7f381c15de00 0x7f381c06d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821c07700 1 -- 172.21.15.32:0/4239538209 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c161bf0 con 0x7f381c06d8d0 2023-10-14T12:19:38.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821c07700 1 --2- 172.21.15.32:0/4239538209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c071520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f381c0b2850 tx=0x7f380c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9005722f6b03af81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:38.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821406700 1 -- 172.21.15.32:0/4239538209 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00b870 con 0x7f381c06d8d0 2023-10-14T12:19:38.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821406700 1 -- 172.21.15.32:0/4239538209 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c00b9d0 con 0x7f381c06d8d0 2023-10-14T12:19:38.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f3821406700 1 -- 172.21.15.32:0/4239538209 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00bd60 con 0x7f381c06d8d0 2023-10-14T12:19:38.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 -- 172.21.15.32:0/4239538209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 msgr2=0x7f381c071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 --2- 172.21.15.32:0/4239538209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c071520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f381c0b2850 tx=0x7f380c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 -- 172.21.15.32:0/4239538209 shutdown_connections 2023-10-14T12:19:38.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 --2- 172.21.15.32:0/4239538209 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c071a60 0x7f381c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 --2- 172.21.15.32:0/4239538209 >> v2:172.21.15.92:3300/0 conn(0x7f381c15de00 0x7f381c06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 --2- 172.21.15.32:0/4239538209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c071520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.722+0000 7f382466c700 1 -- 172.21.15.32:0/4239538209 >> 172.21.15.32:0/4239538209 conn(0x7f381c0cfc40 msgr2=0x7f381c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:38.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.723+0000 7f382466c700 1 -- 172.21.15.32:0/4239538209 shutdown_connections 2023-10-14T12:19:38.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.723+0000 7f382466c700 1 -- 172.21.15.32:0/4239538209 wait complete. 2023-10-14T12:19:38.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.724+0000 7f382466c700 1 Processor -- start 2023-10-14T12:19:38.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.724+0000 7f382466c700 1 -- start start 2023-10-14T12:19:38.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f382466c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f382466c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381c071a60 0x7f381c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f382466c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c15de00 0x7f381c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f382466c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b5280 con 0x7f381c06d8d0 2023-10-14T12:19:38.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f382466c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c15b200 con 0x7f381c071a60 2023-10-14T12:19:38.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f382466c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b54b0 con 0x7f381c15de00 2023-10-14T12:19:38.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f3822408700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f3822408700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c15a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39688/0 (socket says 172.21.15.32:39688) 2023-10-14T12:19:38.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.725+0000 7f3822408700 1 -- 172.21.15.32:0/2893042365 learned_addr learned my addr 172.21.15.32:0/2893042365 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:38.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3821c07700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381c071a60 0x7f381c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3822408700 1 -- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c15de00 msgr2=0x7f381c15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3822408700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c15de00 0x7f381c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3822408700 1 -- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381c071a60 msgr2=0x7f381c0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:38.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3822408700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381c071a60 0x7f381c0b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:38.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3822408700 1 -- 172.21.15.32:0/2893042365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c009550 con 0x7f381c06d8d0 2023-10-14T12:19:38.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3822408700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c15a980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f381800d800 tx=0x7f381800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:38.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180125f0 con 0x7f381c06d8d0 2023-10-14T12:19:38.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818012750 con 0x7f381c06d8d0 2023-10-14T12:19:38.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0b5790 con 0x7f381c06d8d0 2023-10-14T12:19:38.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818012b00 con 0x7f381c06d8d0 2023-10-14T12:19:38.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.726+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0b3570 con 0x7f381c06d8d0 2023-10-14T12:19:38.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.727+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c067d20 con 0x7f381c06d8d0 2023-10-14T12:19:38.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.727+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3818012c60 con 0x7f381c06d8d0 2023-10-14T12:19:38.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.728+0000 7f3812ffd700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f380006af00 0x7f380006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:38.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.728+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3818089660 con 0x7f381c06d8d0 2023-10-14T12:19:38.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.728+0000 7f3821c07700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f380006af00 0x7f380006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:38.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.728+0000 7f3821c07700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f380006af00 0x7f380006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f381c0c9d10 tx=0x7f380c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:38.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:38.732+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3818054a60 con 0x7f381c06d8d0 2023-10-14T12:19:39.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.012+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f381c0665a0 con 0x7f381c06d8d0 2023-10-14T12:19:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.016+0000 7f3812ffd700 1 -- 172.21.15.32:0/2893042365 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3818058080 con 0x7f381c06d8d0 2023-10-14T12:19:39.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f380006af00 msgr2=0x7f380006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f380006af00 0x7f380006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f381c0c9d10 tx=0x7f380c008030 comp rx=0 tx=0).stop 2023-10-14T12:19:39.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 msgr2=0x7f381c15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c15a980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f381800d800 tx=0x7f381800dbc0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 shutdown_connections 2023-10-14T12:19:39.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f381c15de00 0x7f381c15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f381c06d8d0 0x7f381c15a980 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f380006af00 0x7f380006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 --2- 172.21.15.32:0/2893042365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381c071a60 0x7f381c0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 >> 172.21.15.32:0/2893042365 conn(0x7f381c0cfc40 msgr2=0x7f381c15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:39.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 shutdown_connections 2023-10-14T12:19:39.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.018+0000 7f382466c700 1 -- 172.21.15.32:0/2893042365 wait complete. 2023-10-14T12:19:39.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T12:19:39.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.156+0000 7f187647d700 1 Processor -- start 2023-10-14T12:19:39.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.156+0000 7f187647d700 1 -- start start 2023-10-14T12:19:39.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.156+0000 7f187647d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 0x7f18700cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.156+0000 7f187647d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 0x7f1870071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f187647d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1870071ab0 con 0x7f1870161670 2023-10-14T12:19:39.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f187647d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870161bc0 con 0x7f187006af50 2023-10-14T12:19:39.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f187647d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1870161ea0 con 0x7f18700cc3f0 2023-10-14T12:19:39.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 0x7f18700cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f1874a1a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 0x7f1870071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1870161670 0x7f187006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:55596/0 (socket says 172.21.15.32:55596) 2023-10-14T12:19:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 0x7f18700cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:45386/0 (socket says 172.21.15.32:45386) 2023-10-14T12:19:39.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f1874a1a700 1 --2- 172.21.15.32:0/4204494923 >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 0x7f1870071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:43966/0 (socket says 172.21.15.32:43966) 2023-10-14T12:19:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186f7fe700 1 -- 172.21.15.32:0/4204494923 learned_addr learned my addr 172.21.15.32:0/4204494923 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 -- 172.21.15.32:0/4204494923 >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 msgr2=0x7f1870071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 --2- 172.21.15.32:0/4204494923 >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 0x7f1870071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 -- 172.21.15.32:0/4204494923 >> v1:172.21.15.92:6789/0 conn(0x7f1870161670 legacy=0x7f187006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 -- 172.21.15.32:0/4204494923 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870162180 con 0x7f18700cc3f0 2023-10-14T12:19:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f1874a1a700 1 --2- 172.21.15.32:0/4204494923 >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 0x7f1870071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.157+0000 7f186ffff700 1 --2- 172.21.15.32:0/4204494923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 0x7f18700cc7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1860009840 tx=0x7f1860009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6760fa0481fac87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f186effd700 1 -- 172.21.15.32:0/4204494923 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011830 con 0x7f18700cc3f0 2023-10-14T12:19:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f186effd700 1 -- 172.21.15.32:0/4204494923 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860011990 con 0x7f18700cc3f0 2023-10-14T12:19:39.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f186effd700 1 -- 172.21.15.32:0/4204494923 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011d20 con 0x7f18700cc3f0 2023-10-14T12:19:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 -- 172.21.15.32:0/4204494923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 msgr2=0x7f18700cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 --2- 172.21.15.32:0/4204494923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 0x7f18700cc7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1860009840 tx=0x7f1860009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 -- 172.21.15.32:0/4204494923 shutdown_connections 2023-10-14T12:19:39.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 --2- 172.21.15.32:0/4204494923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f18700cc3f0 0x7f18700cc7d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 --2- 172.21.15.32:0/4204494923 >> v2:172.21.15.92:3300/0 conn(0x7f187006af50 0x7f1870071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 -- 172.21.15.32:0/4204494923 >> 172.21.15.32:0/4204494923 conn(0x7f187006dac0 msgr2=0x7f187006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:39.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 -- 172.21.15.32:0/4204494923 shutdown_connections 2023-10-14T12:19:39.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.158+0000 7f187647d700 1 -- 172.21.15.32:0/4204494923 wait complete. 2023-10-14T12:19:39.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.159+0000 7f187647d700 1 Processor -- start 2023-10-14T12:19:39.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 -- start start 2023-10-14T12:19:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f187006af50 0x7f18700c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 0x7f18700ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1870161670 0x7f18700afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700c6c40 con 0x7f18700cc3f0 2023-10-14T12:19:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700c6680 con 0x7f1870161670 2023-10-14T12:19:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f187647d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700c6960 con 0x7f187006af50 2023-10-14T12:19:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f186f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 0x7f18700ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f186f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 0x7f18700ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39702/0 (socket says 172.21.15.32:39702) 2023-10-14T12:19:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.160+0000 7f186f7fe700 1 -- 172.21.15.32:0/3589645973 learned_addr learned my addr 172.21.15.32:0/3589645973 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f1874a1a700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1870161670 0x7f18700afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186ffff700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f187006af50 0x7f18700c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186f7fe700 1 -- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f187006af50 msgr2=0x7f18700c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186f7fe700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f187006af50 0x7f18700c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186f7fe700 1 -- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1870161670 msgr2=0x7f18700afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186f7fe700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1870161670 0x7f18700afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186f7fe700 1 -- 172.21.15.32:0/3589645973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868009a70 con 0x7f18700cc3f0 2023-10-14T12:19:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186f7fe700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 0x7f18700ae230 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f186400c500 tx=0x7f186400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864005d70 con 0x7f18700cc3f0 2023-10-14T12:19:39.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18640070d0 con 0x7f18700cc3f0 2023-10-14T12:19:39.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18600094a0 con 0x7f18700cc3f0 2023-10-14T12:19:39.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864007440 con 0x7f18700cc3f0 2023-10-14T12:19:39.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.161+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18700add10 con 0x7f18700cc3f0 2023-10-14T12:19:39.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.162+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18700adf00 con 0x7f18700cc3f0 2023-10-14T12:19:39.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.163+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f18640075a0 con 0x7f18700cc3f0 2023-10-14T12:19:39.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.163+0000 7f186cff9700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f185c06af00 0x7f185c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.163+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1864088450 con 0x7f18700cc3f0 2023-10-14T12:19:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.163+0000 7f186ffff700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f185c06af00 0x7f185c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.164+0000 7f186ffff700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f185c06af00 0x7f185c06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1860000c00 tx=0x7f1860008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.167+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1864053990 con 0x7f18700cc3f0 2023-10-14T12:19:39.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.449+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1870067d20 con 0x7f18700cc3f0 2023-10-14T12:19:39.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.451+0000 7f186cff9700 1 -- 172.21.15.32:0/3589645973 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1864056fb0 con 0x7f18700cc3f0 2023-10-14T12:19:39.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.453+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f185c06af00 msgr2=0x7f185c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.453+0000 7f187647d700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f185c06af00 0x7f185c06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1860000c00 tx=0x7f1860008030 comp rx=0 tx=0).stop 2023-10-14T12:19:39.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.453+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 msgr2=0x7f18700ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.453+0000 7f187647d700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 0x7f18700ae230 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f186400c500 tx=0x7f186400c810 comp rx=0 tx=0).stop 2023-10-14T12:19:39.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 shutdown_connections 2023-10-14T12:19:39.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f185c06af00 0x7f185c06d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1870161670 0x7f18700afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f187006af50 0x7f18700c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 --2- 172.21.15.32:0/3589645973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18700cc3f0 0x7f18700ae230 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 >> 172.21.15.32:0/3589645973 conn(0x7f187006dac0 msgr2=0x7f18700b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 shutdown_connections 2023-10-14T12:19:39.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.454+0000 7f187647d700 1 -- 172.21.15.32:0/3589645973 wait complete. 2023-10-14T12:19:39.467 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:39.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.591+0000 7f40c30a7700 1 Processor -- start 2023-10-14T12:19:39.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.591+0000 7f40c30a7700 1 -- start start 2023-10-14T12:19:39.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c30a7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc0cd950 0x7f40bc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c30a7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40bc0cede0 0x7f40bc15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c30a7700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0cf260 con 0x7f40bc06a840 2023-10-14T12:19:39.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c30a7700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc1619a0 con 0x7f40bc0cede0 2023-10-14T12:19:39.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c30a7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b2d60 con 0x7f40bc0cd950 2023-10-14T12:19:39.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40bbfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40bc0cede0 0x7f40bc15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c1644700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f40bc06a840 0x7f40bc161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56734/0 (socket says 172.21.15.32:56734) 2023-10-14T12:19:39.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40bbfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40bc0cede0 0x7f40bc15f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39710/0 (socket says 172.21.15.32:39710) 2023-10-14T12:19:39.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.592+0000 7f40c1644700 1 -- 172.21.15.32:0/3512039147 learned_addr learned my addr 172.21.15.32:0/3512039147 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:39.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40c0e43700 1 --2- 172.21.15.32:0/3512039147 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc0cd950 0x7f40bc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bbfff700 1 -- 172.21.15.32:0/3512039147 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc0cd950 msgr2=0x7f40bc15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:39.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bbfff700 1 --2- 172.21.15.32:0/3512039147 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc0cd950 0x7f40bc15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bbfff700 1 -- 172.21.15.32:0/3512039147 >> v1:172.21.15.32:6789/0 conn(0x7f40bc06a840 legacy=0x7f40bc161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bbfff700 1 -- 172.21.15.32:0/3512039147 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0cdd30 con 0x7f40bc0cede0 2023-10-14T12:19:39.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bbfff700 1 --2- 172.21.15.32:0/3512039147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cede0 0x7f40bc15f570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009820 tx=0x7f40a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356ad3c69b4084f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bb7fe700 1 -- 172.21.15.32:0/3512039147 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8005e30 con 0x7f40bc0cede0 2023-10-14T12:19:39.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bb7fe700 1 -- 172.21.15.32:0/3512039147 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8006030 con 0x7f40bc0cede0 2023-10-14T12:19:39.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.593+0000 7f40bb7fe700 1 -- 172.21.15.32:0/3512039147 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80063e0 con 0x7f40bc0cede0 2023-10-14T12:19:39.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 -- 172.21.15.32:0/3512039147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cede0 msgr2=0x7f40bc15f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 --2- 172.21.15.32:0/3512039147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cede0 0x7f40bc15f570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009820 tx=0x7f40a8009b30 comp rx=0 tx=0).stop 2023-10-14T12:19:39.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 -- 172.21.15.32:0/3512039147 shutdown_connections 2023-10-14T12:19:39.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 --2- 172.21.15.32:0/3512039147 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc0cd950 0x7f40bc15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 --2- 172.21.15.32:0/3512039147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cede0 0x7f40bc15f570 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 -- 172.21.15.32:0/3512039147 >> 172.21.15.32:0/3512039147 conn(0x7f40bc06dae0 msgr2=0x7f40bc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:39.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 -- 172.21.15.32:0/3512039147 shutdown_connections 2023-10-14T12:19:39.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.594+0000 7f40c30a7700 1 -- 172.21.15.32:0/3512039147 wait complete. 2023-10-14T12:19:39.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.595+0000 7f40c30a7700 1 Processor -- start 2023-10-14T12:19:39.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.595+0000 7f40c30a7700 1 -- start start 2023-10-14T12:19:39.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c30a7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc06a840 0x7f40bc15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c30a7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 0x7f40bc0b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c30a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40bc0cede0 0x7f40bc0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c30a7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b3590 con 0x7f40bc0cd950 2023-10-14T12:19:39.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c30a7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0c6230 con 0x7f40bc0cede0 2023-10-14T12:19:39.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c30a7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0c6510 con 0x7f40bc06a840 2023-10-14T12:19:39.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 0x7f40bc0b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 0x7f40bc0b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39716/0 (socket says 172.21.15.32:39716) 2023-10-14T12:19:39.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 -- 172.21.15.32:0/4072541326 learned_addr learned my addr 172.21.15.32:0/4072541326 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:39.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c0e43700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc06a840 0x7f40bc15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c1644700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40bc0cede0 0x7f40bc0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 -- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc06a840 msgr2=0x7f40bc15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc06a840 0x7f40bc15cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 -- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40bc0cede0 msgr2=0x7f40bc0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40bc0cede0 0x7f40bc0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 -- 172.21.15.32:0/4072541326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8009430 con 0x7f40bc0cd950 2023-10-14T12:19:39.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40c1644700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40bc0cede0 0x7f40bc0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:39.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.596+0000 7f40bbfff700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 0x7f40bc0b5590 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009b70 tx=0x7f40a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.597+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8004240 con 0x7f40bc0cd950 2023-10-14T12:19:39.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.597+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a80043c0 con 0x7f40bc0cd950 2023-10-14T12:19:39.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.597+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc0c67f0 con 0x7f40bc0cd950 2023-10-14T12:19:39.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.597+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8006960 con 0x7f40bc0cd950 2023-10-14T12:19:39.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.597+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc1f48f0 con 0x7f40bc0cd950 2023-10-14T12:19:39.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.598+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc067d20 con 0x7f40bc0cd950 2023-10-14T12:19:39.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.598+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40a8022070 con 0x7f40bc0cd950 2023-10-14T12:19:39.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.599+0000 7f40b97fa700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f40a006aef0 0x7f40a006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.599+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40a808aa40 con 0x7f40bc0cd950 2023-10-14T12:19:39.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.599+0000 7f40c0e43700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f40a006aef0 0x7f40a006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.599+0000 7f40c0e43700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f40a006aef0 0x7f40a006d3b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0caa20 tx=0x7f40b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.603+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40a808ce60 con 0x7f40bc0cd950 2023-10-14T12:19:39.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.804+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40bc0b2100 con 0x7f40bc0cd950 2023-10-14T12:19:39.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.805+0000 7f40b97fa700 1 -- 172.21.15.32:0/4072541326 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f40a802a020 con 0x7f40bc0cd950 2023-10-14T12:19:39.806 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:39.807 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":28,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:19:36.350379+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f40a006aef0 msgr2=0x7f40a006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f40a006aef0 0x7f40a006d3b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0caa20 tx=0x7f40b0008040 comp rx=0 tx=0).stop 2023-10-14T12:19:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 msgr2=0x7f40bc0b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 0x7f40bc0b5590 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009b70 tx=0x7f40a8004750 comp rx=0 tx=0).stop 2023-10-14T12:19:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 shutdown_connections 2023-10-14T12:19:39.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f40a006aef0 0x7f40a006d3b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40bc0cede0 0x7f40bc0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40bc06a840 0x7f40bc15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 --2- 172.21.15.32:0/4072541326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40bc0cd950 0x7f40bc0b5590 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 >> 172.21.15.32:0/4072541326 conn(0x7f40bc06dae0 msgr2=0x7f40bc0b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:39.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 shutdown_connections 2023-10-14T12:19:39.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.807+0000 7f40c30a7700 1 -- 172.21.15.32:0/4072541326 wait complete. 2023-10-14T12:19:39.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:18:41.151000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:19:39.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:19:39.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.948+0000 7f16e5e7f700 1 Processor -- start 2023-10-14T12:19:39.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.948+0000 7f16e5e7f700 1 -- start start 2023-10-14T12:19:39.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16e5e7f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 0x7f16e00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16e5e7f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e015e7a0 con 0x7f16e015ab10 2023-10-14T12:19:39.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16e5e7f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e00b29a0 con 0x7f16e015f1f0 2023-10-14T12:19:39.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16e5e7f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00b2c80 con 0x7f16e00cfe30 2023-10-14T12:19:39.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16df7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f16e015ab10 0x7f16e00b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56746/0 (socket says 172.21.15.32:56746) 2023-10-14T12:19:39.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16df7fe700 1 -- 172.21.15.32:0/4133076490 learned_addr learned my addr 172.21.15.32:0/4133076490 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:39.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16dffff700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 0x7f16e00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534717616 0 0) 0x7f16e015e7a0 con 0x7f16e015ab10 2023-10-14T12:19:39.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c80035b0 con 0x7f16e015ab10 2023-10-14T12:19:39.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 302730679 0 0) 0x7f16c80035b0 con 0x7f16e015ab10 2023-10-14T12:19:39.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 msgr2=0x7f16e00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:39.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 0x7f16e00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 >> v1:172.21.15.92:6789/0 conn(0x7f16e015f1f0 legacy=0x7f16e00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e015e9f0 con 0x7f16e015ab10 2023-10-14T12:19:39.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f16d0001670 con 0x7f16e015ab10 2023-10-14T12:19:39.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 >> v1:172.21.15.32:6789/0 conn(0x7f16e015ab10 legacy=0x7f16e00b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8003a30 0x7f16c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c80043e0 0x7f16c80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 0x7f16c8005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00b2c80 con 0x7f16c80043e0 2023-10-14T12:19:39.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800ba40 con 0x7f16c8003a30 2023-10-14T12:19:39.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.949+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800bc00 con 0x7f16e00cfe30 2023-10-14T12:19:39.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c80043e0 0x7f16c80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16df7fe700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8003a30 0x7f16c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16dffff700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 0x7f16c8005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 -- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 msgr2=0x7f16c8005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:39.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e00cfe30 0x7f16c8005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 -- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8003a30 msgr2=0x7f16c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:39.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8003a30 0x7f16c8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 -- 172.21.15.32:0/4133076490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80035b0 con 0x7f16c80043e0 2023-10-14T12:19:39.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16deffd700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c80043e0 0x7f16c80048b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001930 tx=0x7f16c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd385cdf2c41f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40013a0 con 0x7f16c80043e0 2023-10-14T12:19:39.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400c6b0 con 0x7f16c80043e0 2023-10-14T12:19:39.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.950+0000 7f16de7fc700 1 -- 172.21.15.32:0/4133076490 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400ca60 con 0x7f16c80043e0 2023-10-14T12:19:39.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16e5e7f700 1 -- 172.21.15.32:0/4133076490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c80043e0 msgr2=0x7f16c80048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/4133076490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c80043e0 0x7f16c80048b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001930 tx=0x7f16c8005880 comp rx=0 tx=0).stop 2023-10-14T12:19:39.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16dffff700 1 -- 172.21.15.32:0/4133076490 reap_dead start 2023-10-14T12:19:39.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16e5e7f700 1 -- 172.21.15.32:0/4133076490 shutdown_connections 2023-10-14T12:19:39.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16e5e7f700 1 -- 172.21.15.32:0/4133076490 >> 172.21.15.32:0/4133076490 conn(0x7f16e006dae0 msgr2=0x7f16e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:39.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16e5e7f700 1 -- 172.21.15.32:0/4133076490 shutdown_connections 2023-10-14T12:19:39.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.951+0000 7f16e5e7f700 1 -- 172.21.15.32:0/4133076490 wait complete. 2023-10-14T12:19:39.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.952+0000 7f16e5e7f700 1 Processor -- start 2023-10-14T12:19:39.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.953+0000 7f16e5e7f700 1 -- start start 2023-10-14T12:19:39.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.953+0000 7f16e5e7f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c80043e0 0x7f16e01f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.953+0000 7f16e5e7f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 0x7f16e014c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.953+0000 7f16e5e7f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e015d100 0x7f16e015d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.953+0000 7f16e5e7f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e015dac0 con 0x7f16e00c8a30 2023-10-14T12:19:39.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16e5e7f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00c5370 con 0x7f16c80043e0 2023-10-14T12:19:39.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16e5e7f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01f53a0 con 0x7f16e015d100 2023-10-14T12:19:39.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 0x7f16e014c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 0x7f16e014c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39736/0 (socket says 172.21.15.32:39736) 2023-10-14T12:19:39.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 -- 172.21.15.32:0/1849229059 learned_addr learned my addr 172.21.15.32:0/1849229059 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:39.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16dffff700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e015d100 0x7f16e015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16df7fe700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c80043e0 0x7f16e01f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 -- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e015d100 msgr2=0x7f16e015d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e015d100 0x7f16e015d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 -- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c80043e0 msgr2=0x7f16e01f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:39.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c80043e0 0x7f16e01f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:39.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 -- 172.21.15.32:0/1849229059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e01f5680 con 0x7f16e00c8a30 2023-10-14T12:19:39.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16deffd700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 0x7f16e014c040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f16c800ba10 tx=0x7f16d4001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400cec0 con 0x7f16e00c8a30 2023-10-14T12:19:39.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4020070 con 0x7f16e00c8a30 2023-10-14T12:19:39.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e01f5960 con 0x7f16e00c8a30 2023-10-14T12:19:39.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4003910 con 0x7f16e00c8a30 2023-10-14T12:19:39.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.954+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e01f5090 con 0x7f16e00c8a30 2023-10-14T12:19:39.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.955+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e00ca970 con 0x7f16e00c8a30 2023-10-14T12:19:39.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.956+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16d4003a70 con 0x7f16e00c8a30 2023-10-14T12:19:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.956+0000 7f16c7fff700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16cc06af30 0x7f16cc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.957+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f16d4022070 con 0x7f16e00c8a30 2023-10-14T12:19:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.957+0000 7f16df7fe700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16cc06af30 0x7f16cc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.957+0000 7f16df7fe700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16cc06af30 0x7f16cc06d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16d0001050 tx=0x7f16d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:39.960+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16d4055fe0 con 0x7f16e00c8a30 2023-10-14T12:19:40.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.162+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16e00c5870 con 0x7f16e00c8a30 2023-10-14T12:19:40.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.162+0000 7f16c7fff700 1 -- 172.21.15.32:0/1849229059 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16e00c5870 con 0x7f16e00c8a30 2023-10-14T12:19:40.164 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-14T12:19:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16cc06af30 msgr2=0x7f16cc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16cc06af30 0x7f16cc06d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16d0001050 tx=0x7f16d0009040 comp rx=0 tx=0).stop 2023-10-14T12:19:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 msgr2=0x7f16e014c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 0x7f16e014c040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f16c800ba10 tx=0x7f16d4001280 comp rx=0 tx=0).stop 2023-10-14T12:19:40.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 shutdown_connections 2023-10-14T12:19:40.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16e015d100 0x7f16e015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f16cc06af30 0x7f16cc06d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c80043e0 0x7f16e01f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 --2- 172.21.15.32:0/1849229059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e00c8a30 0x7f16e014c040 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 >> 172.21.15.32:0/1849229059 conn(0x7f16e006dae0 msgr2=0x7f16e00cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:40.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 shutdown_connections 2023-10-14T12:19:40.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.164+0000 7f16e5e7f700 1 -- 172.21.15.32:0/1849229059 wait complete. 2023-10-14T12:19:40.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T12:19:40.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.301+0000 7f99159d2700 1 Processor -- start 2023-10-14T12:19:40.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.301+0000 7f99159d2700 1 -- start start 2023-10-14T12:19:40.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f99159d2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f991015b740 0x7f99100d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f99159d2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f99100d0c70 0x7f99100cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f99159d2700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100cf190 con 0x7f99100c5110 2023-10-14T12:19:40.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f99159d2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991015bb20 con 0x7f991015b740 2023-10-14T12:19:40.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f99159d2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99100cbd40 con 0x7f99100d0c70 2023-10-14T12:19:40.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f990effd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f991015b740 0x7f99100d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f990f7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f99100c5110 0x7f99100cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56770/0 (socket says 172.21.15.32:56770) 2023-10-14T12:19:40.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f990f7fe700 1 -- 172.21.15.32:0/146899862 learned_addr learned my addr 172.21.15.32:0/146899862 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:40.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.302+0000 7f990e7fc700 1 --2- 172.21.15.32:0/146899862 >> v2:172.21.15.92:3300/0 conn(0x7f99100d0c70 0x7f99100cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990effd700 1 -- 172.21.15.32:0/146899862 >> v2:172.21.15.92:3300/0 conn(0x7f99100d0c70 msgr2=0x7f99100cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:40.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990effd700 1 --2- 172.21.15.32:0/146899862 >> v2:172.21.15.92:3300/0 conn(0x7f99100d0c70 0x7f99100cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990effd700 1 -- 172.21.15.32:0/146899862 >> v1:172.21.15.32:6789/0 conn(0x7f99100c5110 legacy=0x7f99100cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990dffb700 1 -- 172.21.15.32:0/146899862 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501729101 0 0) 0x7f99100cf190 con 0x7f99100c5110 2023-10-14T12:19:40.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990effd700 1 -- 172.21.15.32:0/146899862 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100cc020 con 0x7f991015b740 2023-10-14T12:19:40.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990effd700 1 --2- 172.21.15.32:0/146899862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f991015b740 0x7f99100d1cd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99100cec30 tx=0x7f9904009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6135cb99a0be12d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:40.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990dffb700 1 -- 172.21.15.32:0/146899862 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904011830 con 0x7f991015b740 2023-10-14T12:19:40.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990dffb700 1 -- 172.21.15.32:0/146899862 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904011990 con 0x7f991015b740 2023-10-14T12:19:40.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.303+0000 7f990dffb700 1 -- 172.21.15.32:0/146899862 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904011d20 con 0x7f991015b740 2023-10-14T12:19:40.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 -- 172.21.15.32:0/146899862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f991015b740 msgr2=0x7f99100d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 --2- 172.21.15.32:0/146899862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f991015b740 0x7f99100d1cd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99100cec30 tx=0x7f9904009b20 comp rx=0 tx=0).stop 2023-10-14T12:19:40.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 -- 172.21.15.32:0/146899862 shutdown_connections 2023-10-14T12:19:40.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 --2- 172.21.15.32:0/146899862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f991015b740 0x7f99100d1cd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 --2- 172.21.15.32:0/146899862 >> v2:172.21.15.92:3300/0 conn(0x7f99100d0c70 0x7f99100cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 -- 172.21.15.32:0/146899862 >> 172.21.15.32:0/146899862 conn(0x7f99100665a0 msgr2=0x7f9910066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:40.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 -- 172.21.15.32:0/146899862 shutdown_connections 2023-10-14T12:19:40.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.304+0000 7f99159d2700 1 -- 172.21.15.32:0/146899862 wait complete. 2023-10-14T12:19:40.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.305+0000 7f99159d2700 1 Processor -- start 2023-10-14T12:19:40.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.305+0000 7f99159d2700 1 -- start start 2023-10-14T12:19:40.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99100c5110 0x7f9910156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 0x7f99100c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f991015b740 0x7f991015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b5030 con 0x7f99100d0c70 2023-10-14T12:19:40.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b5310 con 0x7f99100c5110 2023-10-14T12:19:40.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b55f0 con 0x7f991015b740 2023-10-14T12:19:40.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 0x7f99100c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 0x7f99100c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39750/0 (socket says 172.21.15.32:39750) 2023-10-14T12:19:40.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 -- 172.21.15.32:0/98151333 learned_addr learned my addr 172.21.15.32:0/98151333 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:40.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990effd700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99100c5110 0x7f9910156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990f7fe700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f991015b740 0x7f991015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 -- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f991015b740 msgr2=0x7f991015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f991015b740 0x7f991015cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 -- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99100c5110 msgr2=0x7f9910156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99100c5110 0x7f9910156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 -- 172.21.15.32:0/98151333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040094a0 con 0x7f99100d0c70 2023-10-14T12:19:40.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990f7fe700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f991015b740 0x7f991015cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:40.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f990e7fc700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 0x7f99100c8690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f990000e9d0 tx=0x7f990000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:40.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900009730 con 0x7f99100d0c70 2023-10-14T12:19:40.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990000c850 con 0x7f99100d0c70 2023-10-14T12:19:40.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990000cbe0 con 0x7f99100d0c70 2023-10-14T12:19:40.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.306+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100b58d0 con 0x7f99100d0c70 2023-10-14T12:19:40.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.307+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9910157280 con 0x7f99100d0c70 2023-10-14T12:19:40.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.307+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910067d20 con 0x7f99100d0c70 2023-10-14T12:19:40.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.308+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f990000cd40 con 0x7f99100d0c70 2023-10-14T12:19:40.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.308+0000 7f98f7fff700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f98fc06af00 0x7f98fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.308+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9900089320 con 0x7f99100d0c70 2023-10-14T12:19:40.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.309+0000 7f990effd700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f98fc06af00 0x7f98fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.309+0000 7f990effd700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f98fc06af00 0x7f98fc06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99040090b0 tx=0x7f990401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:40.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.313+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9900054720 con 0x7f99100d0c70 2023-10-14T12:19:40.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.516+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f99100c6380 con 0x7f99100d0c70 2023-10-14T12:19:40.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.516+0000 7f98f7fff700 1 -- 172.21.15.32:0/98151333 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9900057d40 con 0x7f99100d0c70 2023-10-14T12:19:40.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:40.519 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2023-10-14T12:19:40.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-14T12:19:40.519 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2023-10-14T12:19:40.519 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2023-10-14T12:19:40.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-14T12:19:40.520 INFO:teuthology.orchestra.run.smithi032.stdout:] 2023-10-14T12:19:40.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f98fc06af00 msgr2=0x7f98fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f98fc06af00 0x7f98fc06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99040090b0 tx=0x7f990401c040 comp rx=0 tx=0).stop 2023-10-14T12:19:40.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 msgr2=0x7f99100c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 0x7f99100c8690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f990000e9d0 tx=0x7f990000ece0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 shutdown_connections 2023-10-14T12:19:40.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f991015b740 0x7f991015cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f98fc06af00 0x7f98fc06d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99100c5110 0x7f9910156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 --2- 172.21.15.32:0/98151333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99100d0c70 0x7f99100c8690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 >> 172.21.15.32:0/98151333 conn(0x7f99100665a0 msgr2=0x7f99100cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:40.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 shutdown_connections 2023-10-14T12:19:40.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.518+0000 7f99159d2700 1 -- 172.21.15.32:0/98151333 wait complete. 2023-10-14T12:19:40.532 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T12:19:40.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T12:19:40.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.659+0000 7fc427747700 1 Processor -- start 2023-10-14T12:19:40.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.659+0000 7fc427747700 1 -- start start 2023-10-14T12:19:40.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc427747700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc42015db10 0x7fc4200cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc427747700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc42006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc427747700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc420161a00 con 0x7fc420071210 2023-10-14T12:19:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc427747700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42006dd10 con 0x7fc42015db10 2023-10-14T12:19:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc427747700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42015def0 con 0x7fc42006d320 2023-10-14T12:19:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc4254e3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc42015db10 0x7fc4200cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc424ce2700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc420071210 0x7fc420161e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56780/0 (socket says 172.21.15.32:56780) 2023-10-14T12:19:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc424ce2700 1 -- 172.21.15.32:0/2863230402 learned_addr learned my addr 172.21.15.32:0/2863230402 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc4254e3700 1 -- 172.21.15.32:0/2863230402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 msgr2=0x7fc42006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc425ce4700 1 --2- 172.21.15.32:0/2863230402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc42006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc4254e3700 1 --2- 172.21.15.32:0/2863230402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc42006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc4254e3700 1 -- 172.21.15.32:0/2863230402 >> v1:172.21.15.32:6789/0 conn(0x7fc420071210 legacy=0x7fc420161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc417fff700 1 -- 172.21.15.32:0/2863230402 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997494326 0 0) 0x7fc420161a00 con 0x7fc420071210 2023-10-14T12:19:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc4254e3700 1 -- 172.21.15.32:0/2863230402 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4200ce540 con 0x7fc42015db10 2023-10-14T12:19:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.660+0000 7fc4254e3700 1 --2- 172.21.15.32:0/2863230402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc42015db10 0x7fc4200cbf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009840 tx=0x7fc41c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fef09bdad32366 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc417fff700 1 -- 172.21.15.32:0/2863230402 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c011830 con 0x7fc42015db10 2023-10-14T12:19:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc417fff700 1 -- 172.21.15.32:0/2863230402 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c011990 con 0x7fc42015db10 2023-10-14T12:19:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc417fff700 1 -- 172.21.15.32:0/2863230402 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c011d20 con 0x7fc42015db10 2023-10-14T12:19:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 -- 172.21.15.32:0/2863230402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc42015db10 msgr2=0x7fc4200cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 --2- 172.21.15.32:0/2863230402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc42015db10 0x7fc4200cbf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009840 tx=0x7fc41c009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 -- 172.21.15.32:0/2863230402 shutdown_connections 2023-10-14T12:19:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 --2- 172.21.15.32:0/2863230402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc42015db10 0x7fc4200cbf80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 --2- 172.21.15.32:0/2863230402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc42006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 -- 172.21.15.32:0/2863230402 >> 172.21.15.32:0/2863230402 conn(0x7fc4200cfc10 msgr2=0x7fc4200d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:40.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 -- 172.21.15.32:0/2863230402 shutdown_connections 2023-10-14T12:19:40.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.661+0000 7fc427747700 1 -- 172.21.15.32:0/2863230402 wait complete. 2023-10-14T12:19:40.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.662+0000 7fc427747700 1 Processor -- start 2023-10-14T12:19:40.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 -- start start 2023-10-14T12:19:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc420154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 0x7fc4200c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42015db10 0x7fc42015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4201554a0 con 0x7fc420071210 2023-10-14T12:19:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200c8b80 con 0x7fc42015db10 2023-10-14T12:19:40.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc427747700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42015eab0 con 0x7fc42006d320 2023-10-14T12:19:40.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc424ce2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 0x7fc4200c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc424ce2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 0x7fc4200c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39764/0 (socket says 172.21.15.32:39764) 2023-10-14T12:19:40.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.663+0000 7fc424ce2700 1 -- 172.21.15.32:0/2913203640 learned_addr learned my addr 172.21.15.32:0/2913203640 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:40.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc425ce4700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42015db10 0x7fc42015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc424ce2700 1 -- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 msgr2=0x7fc420154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc4254e3700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc420154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc424ce2700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc420154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc424ce2700 1 -- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42015db10 msgr2=0x7fc42015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:40.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc424ce2700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42015db10 0x7fc42015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc424ce2700 1 -- 172.21.15.32:0/2913203640 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0094a0 con 0x7fc420071210 2023-10-14T12:19:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc425ce4700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42015db10 0x7fc42015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc424ce2700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 0x7fc4200c8640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c540 tx=0x7fc41000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410004c80 con 0x7fc420071210 2023-10-14T12:19:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410004de0 con 0x7fc420071210 2023-10-14T12:19:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42015ed90 con 0x7fc420071210 2023-10-14T12:19:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410007310 con 0x7fc420071210 2023-10-14T12:19:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.664+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42015f350 con 0x7fc420071210 2023-10-14T12:19:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.665+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420067d20 con 0x7fc420071210 2023-10-14T12:19:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.666+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc410007470 con 0x7fc420071210 2023-10-14T12:19:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.666+0000 7fc415ffb700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc40406af00 0x7fc40406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.666+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc410088f90 con 0x7fc420071210 2023-10-14T12:19:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.666+0000 7fc4254e3700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc40406af00 0x7fc40406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.667+0000 7fc4254e3700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc40406af00 0x7fc40406d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.671+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4100bbca0 con 0x7fc420071210 2023-10-14T12:19:40.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:40.871+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc42006e350 con 0x7fc420071210 2023-10-14T12:19:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.350+0000 7fc415ffb700 1 -- 172.21.15.32:0/2913203640 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v29) v1 ==== 148+0+0 (secure 0 0 0) 0x7fc410054420 con 0x7fc420071210 2023-10-14T12:19:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc40406af00 msgr2=0x7fc40406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc40406af00 0x7fc40406d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c008030 comp rx=0 tx=0).stop 2023-10-14T12:19:41.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 msgr2=0x7fc4200c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 0x7fc4200c8640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c540 tx=0x7fc41000c900 comp rx=0 tx=0).stop 2023-10-14T12:19:41.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 shutdown_connections 2023-10-14T12:19:41.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc40406af00 0x7fc40406d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42015db10 0x7fc42015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc42006d320 0x7fc420154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 --2- 172.21.15.32:0/2913203640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc420071210 0x7fc4200c8640 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.354+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 >> 172.21.15.32:0/2913203640 conn(0x7fc4200cfc10 msgr2=0x7fc42015cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.356+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 shutdown_connections 2023-10-14T12:19:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.356+0000 7fc427747700 1 -- 172.21.15.32:0/2913203640 wait complete. 2023-10-14T12:19:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'testcephfs1_metadata' created 2023-10-14T12:19:41.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T12:19:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.506+0000 7ff4a3e29700 1 Processor -- start 2023-10-14T12:19:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.506+0000 7ff4a3e29700 1 -- start start 2023-10-14T12:19:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a3e29700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 0x7ff49c0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a3e29700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c15df90 con 0x7ff49c0cc7d0 2023-10-14T12:19:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a3e29700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c161a60 con 0x7ff49c15dbb0 2023-10-14T12:19:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a3e29700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c161d40 con 0x7ff49c06af50 2023-10-14T12:19:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a23c6700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff49c0cc7d0 0x7ff49c0cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56798/0 (socket says 172.21.15.32:56798) 2023-10-14T12:19:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a23c6700 1 -- 172.21.15.32:0/1053725225 learned_addr learned my addr 172.21.15.32:0/1053725225 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a13c4700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 0x7ff49c0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956482456 0 0) 0x7ff49c15df90 con 0x7ff49c0cc7d0 2023-10-14T12:19:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4880035b0 con 0x7ff49c0cc7d0 2023-10-14T12:19:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219002967 0 0) 0x7ff49c161a60 con 0x7ff49c15dbb0 2023-10-14T12:19:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c15df90 con 0x7ff49c15dbb0 2023-10-14T12:19:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818417935 0 0) 0x7ff4880035b0 con 0x7ff49c0cc7d0 2023-10-14T12:19:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 msgr2=0x7ff49c0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:41.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 0x7ff49c0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 >> v1:172.21.15.92:6789/0 conn(0x7ff49c15dbb0 legacy=0x7ff49c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c162020 con 0x7ff49c0cc7d0 2023-10-14T12:19:41.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.507+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7ff4940019f0 con 0x7ff49c0cc7d0 2023-10-14T12:19:41.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 >> v1:172.21.15.32:6789/0 conn(0x7ff49c0cc7d0 legacy=0x7ff49c0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff488003bc0 0x7ff488003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 0x7ff488004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff488004d90 0x7ff488005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c161d40 con 0x7ff488004d90 2023-10-14T12:19:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48800bb10 con 0x7ff488003bc0 2023-10-14T12:19:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48800bcd0 con 0x7ff49c06af50 2023-10-14T12:19:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff488004d90 0x7ff488005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a13c4700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 0x7ff488004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a1bc5700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff488003bc0 0x7ff488003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 -- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 msgr2=0x7ff488004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c06af50 0x7ff488004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 -- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff488003bc0 msgr2=0x7ff488003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff488003bc0 0x7ff488003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 -- 172.21.15.32:0/1053725225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880035b0 con 0x7ff488004d90 2023-10-14T12:19:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a23c6700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff488004d90 0x7ff488005210 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0ccc10 tx=0x7ff488005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dc305e8068a897 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:41.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940072d0 con 0x7ff488004d90 2023-10-14T12:19:41.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff494007450 con 0x7ff488004d90 2023-10-14T12:19:41.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.508+0000 7ff4a0bc3700 1 -- 172.21.15.32:0/1053725225 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff494007800 con 0x7ff488004d90 2023-10-14T12:19:41.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1053725225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff488004d90 msgr2=0x7ff488005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1053725225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff488004d90 0x7ff488005210 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0ccc10 tx=0x7ff488005880 comp rx=0 tx=0).stop 2023-10-14T12:19:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a23c6700 1 -- 172.21.15.32:0/1053725225 reap_dead start 2023-10-14T12:19:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1053725225 shutdown_connections 2023-10-14T12:19:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1053725225 >> 172.21.15.32:0/1053725225 conn(0x7ff49c06dac0 msgr2=0x7ff49c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1053725225 shutdown_connections 2023-10-14T12:19:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.509+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1053725225 wait complete. 2023-10-14T12:19:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.510+0000 7ff4a3e29700 1 Processor -- start 2023-10-14T12:19:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.510+0000 7ff4a3e29700 1 -- start start 2023-10-14T12:19:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a3e29700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 0x7ff49c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a3e29700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff49c160be0 0x7ff49c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a3e29700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c0b1590 0x7ff49c0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a3e29700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15ef30 con 0x7ff49c160800 2023-10-14T12:19:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a3e29700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b1a40 con 0x7ff49c160be0 2023-10-14T12:19:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a3e29700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15e2b0 con 0x7ff49c0b1590 2023-10-14T12:19:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 0x7ff49c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 0x7ff49c1f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39782/0 (socket says 172.21.15.32:39782) 2023-10-14T12:19:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 -- 172.21.15.32:0/1829487771 learned_addr learned my addr 172.21.15.32:0/1829487771 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a23c6700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c0b1590 0x7ff49c0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a13c4700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff49c160be0 0x7ff49c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 -- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c0b1590 msgr2=0x7ff49c0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c0b1590 0x7ff49c0b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 -- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff49c160be0 msgr2=0x7ff49c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff49c160be0 0x7ff49c0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.511+0000 7ff4a1bc5700 1 -- 172.21.15.32:0/1829487771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c15e590 con 0x7ff49c160800 2023-10-14T12:19:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.512+0000 7ff4a1bc5700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 0x7ff49c1f33b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00f820 tx=0x7ff48c00fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.512+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0052e0 con 0x7ff49c160800 2023-10-14T12:19:41.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.512+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c005440 con 0x7ff49c160800 2023-10-14T12:19:41.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.512+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c15e870 con 0x7ff49c160800 2023-10-14T12:19:41.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.512+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0038c0 con 0x7ff49c160800 2023-10-14T12:19:41.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.512+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0b5030 con 0x7ff49c160800 2023-10-14T12:19:41.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.513+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c067d20 con 0x7ff49c160800 2023-10-14T12:19:41.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.513+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff48c003a20 con 0x7ff49c160800 2023-10-14T12:19:41.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.514+0000 7ff4927fc700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff48006af00 0x7ff48006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:41.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.514+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5232+0+0 (secure 0 0 0) 0x7ff48c0892f0 con 0x7ff49c160800 2023-10-14T12:19:41.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.514+0000 7ff4a13c4700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff48006af00 0x7ff48006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:41.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.515+0000 7ff4a13c4700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff48006af00 0x7ff48006d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0cab50 tx=0x7ff498008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:41.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.519+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff48c054610 con 0x7ff49c160800 2023-10-14T12:19:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:41.720+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff49c0b6430 con 0x7ff49c160800 2023-10-14T12:19:42.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.353+0000 7ff4927fc700 1 -- 172.21.15.32:0/1829487771 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v30) v1 ==== 180+0+0 (secure 0 0 0) 0x7ff48c057c30 con 0x7ff49c160800 2023-10-14T12:19:42.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff48006af00 msgr2=0x7ff48006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:42.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff48006af00 0x7ff48006d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0cab50 tx=0x7ff498008040 comp rx=0 tx=0).stop 2023-10-14T12:19:42.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 msgr2=0x7ff49c1f33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 0x7ff49c1f33b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00f820 tx=0x7ff48c00fbe0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 shutdown_connections 2023-10-14T12:19:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff49c0b1590 0x7ff49c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff49c160800 0x7ff49c1f33b0 secure :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00f820 tx=0x7ff48c00fbe0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff48006af00 0x7ff48006d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 --2- 172.21.15.32:0/1829487771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff49c160be0 0x7ff49c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.357+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 >> 172.21.15.32:0/1829487771 conn(0x7ff49c06dac0 msgr2=0x7ff49c0cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:42.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.359+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 shutdown_connections 2023-10-14T12:19:42.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.359+0000 7ff4a3e29700 1 -- 172.21.15.32:0/1829487771 wait complete. 2023-10-14T12:19:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'testcephfs1_data' created 2023-10-14T12:19:42.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T12:19:42.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.519+0000 7f460ccb1700 1 Processor -- start 2023-10-14T12:19:42.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.519+0000 7f460ccb1700 1 -- start start 2023-10-14T12:19:42.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460ccb1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46080cd950 0x7f460815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:42.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460ccb1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f460806a840 0x7f460806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:42.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460ccb1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080cf290 con 0x7f46080cede0 2023-10-14T12:19:42.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460ccb1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46081619a0 con 0x7f46080cd950 2023-10-14T12:19:42.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460ccb1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460806b1b0 con 0x7f460806a840 2023-10-14T12:19:42.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46080cd950 0x7f460815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:42.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46080cd950 0x7f460815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39790/0 (socket says 172.21.15.32:39790) 2023-10-14T12:19:42.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 -- 172.21.15.32:0/1416156968 learned_addr learned my addr 172.21.15.32:0/1416156968 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:42.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f4606d9d700 1 --2- 172.21.15.32:0/1416156968 >> v2:172.21.15.92:3300/0 conn(0x7f460806a840 0x7f460806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:42.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 -- 172.21.15.32:0/1416156968 >> v2:172.21.15.92:3300/0 conn(0x7f460806a840 msgr2=0x7f460806ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:42.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 --2- 172.21.15.32:0/1416156968 >> v2:172.21.15.92:3300/0 conn(0x7f460806a840 0x7f460806ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 -- 172.21.15.32:0/1416156968 >> v1:172.21.15.92:6789/0 conn(0x7f46080cede0 legacy=0x7f460815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:42.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 -- 172.21.15.32:0/1416156968 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080b2d60 con 0x7f46080cd950 2023-10-14T12:19:42.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f4606d9d700 1 --2- 172.21.15.32:0/1416156968 >> v2:172.21.15.92:3300/0 conn(0x7f460806a840 0x7f460806ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:42.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.520+0000 7f460659c700 1 --2- 172.21.15.32:0/1416156968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f460815e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f460815e830 tx=0x7f45f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaa5c27826788fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:42.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460559a700 1 -- 172.21.15.32:0/1416156968 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8004230 con 0x7f46080cd950 2023-10-14T12:19:42.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460559a700 1 -- 172.21.15.32:0/1416156968 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8004390 con 0x7f46080cd950 2023-10-14T12:19:42.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460559a700 1 -- 172.21.15.32:0/1416156968 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80036a0 con 0x7f46080cd950 2023-10-14T12:19:42.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 -- 172.21.15.32:0/1416156968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 msgr2=0x7f460815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:42.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1416156968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f460815e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f460815e830 tx=0x7f45f8009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 -- 172.21.15.32:0/1416156968 shutdown_connections 2023-10-14T12:19:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1416156968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f460815e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1416156968 >> v2:172.21.15.92:3300/0 conn(0x7f460806a840 0x7f460806ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 -- 172.21.15.32:0/1416156968 >> 172.21.15.32:0/1416156968 conn(0x7f460806dae0 msgr2=0x7f460806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 -- 172.21.15.32:0/1416156968 shutdown_connections 2023-10-14T12:19:42.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.521+0000 7f460ccb1700 1 -- 172.21.15.32:0/1416156968 wait complete. 2023-10-14T12:19:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 Processor -- start 2023-10-14T12:19:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 -- start start 2023-10-14T12:19:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f460806a840 0x7f4608153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f46080ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46080cede0 0x7f46080b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b49e0 con 0x7f46080cd950 2023-10-14T12:19:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b4cc0 con 0x7f460806a840 2023-10-14T12:19:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.523+0000 7f460ccb1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b4fa0 con 0x7f46080cede0 2023-10-14T12:19:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f46080ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f46080ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39798/0 (socket says 172.21.15.32:39798) 2023-10-14T12:19:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 -- 172.21.15.32:0/1182725389 learned_addr learned my addr 172.21.15.32:0/1182725389 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f460659c700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f460806a840 0x7f4608153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:42.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4606d9d700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46080cede0 0x7f46080b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:42.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 -- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46080cede0 msgr2=0x7f46080b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:42.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46080cede0 0x7f46080b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 -- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f460806a840 msgr2=0x7f4608153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:42.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f460806a840 0x7f4608153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:42.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 -- 172.21.15.32:0/1182725389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009550 con 0x7f46080cd950 2023-10-14T12:19:42.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4606d9d700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46080cede0 0x7f46080b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:42.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f4605d9b700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f46080ca070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00b450 tx=0x7f45fc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:42.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc004020 con 0x7f46080cd950 2023-10-14T12:19:42.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc004180 con 0x7f46080cd950 2023-10-14T12:19:42.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46080b5280 con 0x7f46080cd950 2023-10-14T12:19:42.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc004530 con 0x7f46080cd950 2023-10-14T12:19:42.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.524+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46080c9c60 con 0x7f46080cd950 2023-10-14T12:19:42.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.525+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46080b57a0 con 0x7f46080cd950 2023-10-14T12:19:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.526+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45fc0036d0 con 0x7f46080cd950 2023-10-14T12:19:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.527+0000 7f45f6ffd700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45e806af00 0x7f45e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.527+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f45fc088de0 con 0x7f46080cd950 2023-10-14T12:19:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.527+0000 7f460659c700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45e806af00 0x7f45e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.527+0000 7f460659c700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45e806af00 0x7f45e806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009130 tx=0x7f45f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.531+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46080b57a0 con 0x7f46080cd950 2023-10-14T12:19:42.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:42.776+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7f46080b57a0 con 0x7f46080cd950 2023-10-14T12:19:43.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.385+0000 7f45f6ffd700 1 -- 172.21.15.32:0/1182725389 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 187+0+0 (secure 0 0 0) 0x7f46080b57a0 con 0x7f46080cd950 2023-10-14T12:19:43.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45e806af00 msgr2=0x7f45e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45e806af00 0x7f45e806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009130 tx=0x7f45f8008030 comp rx=0 tx=0).stop 2023-10-14T12:19:43.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 msgr2=0x7f46080ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f46080ca070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00b450 tx=0x7f45fc00b810 comp rx=0 tx=0).stop 2023-10-14T12:19:43.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 shutdown_connections 2023-10-14T12:19:43.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46080cede0 0x7f46080b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f45e806af00 0x7f45e806d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f460806a840 0x7f4608153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 --2- 172.21.15.32:0/1182725389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46080cd950 0x7f46080ca070 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 >> 172.21.15.32:0/1182725389 conn(0x7f460806dae0 msgr2=0x7f4608160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:43.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 shutdown_connections 2023-10-14T12:19:43.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.391+0000 7f460ccb1700 1 -- 172.21.15.32:0/1182725389 wait complete. 2023-10-14T12:19:43.400 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T12:19:43.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:43.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.546+0000 7febc7972700 1 Processor -- start 2023-10-14T12:19:43.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.546+0000 7febc7972700 1 -- start start 2023-10-14T12:19:43.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc7972700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 0x7febc015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc7972700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00cf260 con 0x7febc006a840 2023-10-14T12:19:43.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc7972700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00b2d60 con 0x7febc00cede0 2023-10-14T12:19:43.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc7972700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01619a0 con 0x7febc00cd950 2023-10-14T12:19:43.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc5f0f700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7febc006a840 0x7febc0161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56846/0 (socket says 172.21.15.32:56846) 2023-10-14T12:19:43.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc5f0f700 1 -- 172.21.15.32:0/3839331986 learned_addr learned my addr 172.21.15.32:0/3839331986 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:43.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258748442 0 0) 0x7febc00cf260 con 0x7febc006a840 2023-10-14T12:19:43.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febc570e700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 0x7febc015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.547+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febac0035b0 con 0x7febc006a840 2023-10-14T12:19:43.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2528061992 0 0) 0x7febac0035b0 con 0x7febc006a840 2023-10-14T12:19:43.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 msgr2=0x7febc015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:43.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 0x7febc015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 >> v1:172.21.15.92:6789/0 conn(0x7febc00cede0 legacy=0x7febc015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00cdd30 con 0x7febc006a840 2023-10-14T12:19:43.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7febb80019f0 con 0x7febc006a840 2023-10-14T12:19:43.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 >> v1:172.21.15.32:6789/0 conn(0x7febc006a840 legacy=0x7febc0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febac003a30 0x7febac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 0x7febac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac004d90 0x7febac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01619a0 con 0x7febac004d90 2023-10-14T12:19:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac00ba10 con 0x7febac003a30 2023-10-14T12:19:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac00bbd0 con 0x7febc00cd950 2023-10-14T12:19:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac004d90 0x7febac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc570e700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febac003a30 0x7febac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc4f0d700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 0x7febac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 -- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 msgr2=0x7febac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00cd950 0x7febac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 -- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febac003a30 msgr2=0x7febac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febac003a30 0x7febac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 -- 172.21.15.32:0/3839331986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0035b0 con 0x7febac004d90 2023-10-14T12:19:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.548+0000 7febc5f0f700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac004d90 0x7febac005210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7febb800a840 tx=0x7febac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef4ba818e2f8585 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:43.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8012600 con 0x7febac004d90 2023-10-14T12:19:43.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb8012760 con 0x7febac004d90 2023-10-14T12:19:43.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febb7fff700 1 -- 172.21.15.32:0/3839331986 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8012af0 con 0x7febac004d90 2023-10-14T12:19:43.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc7972700 1 -- 172.21.15.32:0/3839331986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac004d90 msgr2=0x7febac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc7972700 1 --2- 172.21.15.32:0/3839331986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febac004d90 0x7febac005210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7febb800a840 tx=0x7febac005880 comp rx=0 tx=0).stop 2023-10-14T12:19:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc5f0f700 1 -- 172.21.15.32:0/3839331986 reap_dead start 2023-10-14T12:19:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc7972700 1 -- 172.21.15.32:0/3839331986 shutdown_connections 2023-10-14T12:19:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc7972700 1 -- 172.21.15.32:0/3839331986 >> 172.21.15.32:0/3839331986 conn(0x7febc006dae0 msgr2=0x7febc006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc7972700 1 -- 172.21.15.32:0/3839331986 shutdown_connections 2023-10-14T12:19:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.549+0000 7febc7972700 1 -- 172.21.15.32:0/3839331986 wait complete. 2023-10-14T12:19:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.550+0000 7febc7972700 1 Processor -- start 2023-10-14T12:19:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 -- start start 2023-10-14T12:19:43.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febc015c3b0 0x7febc00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 0x7febc00ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00ad9e0 0x7febc00b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ca130 con 0x7febc00c9cb0 2023-10-14T12:19:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01f7740 con 0x7febc015c3b0 2023-10-14T12:19:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc7972700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00b4530 con 0x7febc00ad9e0 2023-10-14T12:19:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc4f0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 0x7febc00ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc4f0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 0x7febc00ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39832/0 (socket says 172.21.15.32:39832) 2023-10-14T12:19:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc4f0d700 1 -- 172.21.15.32:0/2588880974 learned_addr learned my addr 172.21.15.32:0/2588880974 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc570e700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febc015c3b0 0x7febc00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.551+0000 7febc5f0f700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00ad9e0 0x7febc00b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc4f0d700 1 -- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00ad9e0 msgr2=0x7febc00b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc4f0d700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00ad9e0 0x7febc00b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc4f0d700 1 -- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febc015c3b0 msgr2=0x7febc00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc4f0d700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febc015c3b0 0x7febc00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc4f0d700 1 -- 172.21.15.32:0/2588880974 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc01f6e50 con 0x7febc00c9cb0 2023-10-14T12:19:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc4f0d700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 0x7febc00ad4a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7febbc00f7f0 tx=0x7febbc00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0052e0 con 0x7febc00c9cb0 2023-10-14T12:19:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc005460 con 0x7febc00c9cb0 2023-10-14T12:19:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc003910 con 0x7febc00c9cb0 2023-10-14T12:19:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc01f7bd0 con 0x7febc00c9cb0 2023-10-14T12:19:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.552+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc01f73d0 con 0x7febc00c9cb0 2023-10-14T12:19:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.553+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc01f7590 con 0x7febc00c9cb0 2023-10-14T12:19:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.554+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7febbc003a70 con 0x7febc00c9cb0 2023-10-14T12:19:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.554+0000 7febb5ffb700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feba406af00 0x7feba406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.554+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7febbc089410 con 0x7febc00c9cb0 2023-10-14T12:19:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.554+0000 7febc570e700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feba406af00 0x7feba406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.555+0000 7febc570e700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feba406af00 0x7feba406d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febc00c3e30 tx=0x7febb0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:43.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.559+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febbc054550 con 0x7febc00c9cb0 2023-10-14T12:19:43.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.759+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febc01f78b0 con 0x7febc00c9cb0 2023-10-14T12:19:43.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.761+0000 7febb5ffb700 1 -- 172.21.15.32:0/2588880974 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16554 (secure 0 0 0) 0x7febbc057b70 con 0x7febc00c9cb0 2023-10-14T12:19:43.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:43.763 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:19:42.779025+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:19:40.903437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:19:41.752188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:43.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feba406af00 msgr2=0x7feba406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feba406af00 0x7feba406d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febc00c3e30 tx=0x7febb0009210 comp rx=0 tx=0).stop 2023-10-14T12:19:43.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 msgr2=0x7febc00ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 0x7febc00ad4a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7febbc00f7f0 tx=0x7febbc00fb00 comp rx=0 tx=0).stop 2023-10-14T12:19:43.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 shutdown_connections 2023-10-14T12:19:43.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7febc00ad9e0 0x7febc00b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7feba406af00 0x7feba406d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7febc015c3b0 0x7febc00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 --2- 172.21.15.32:0/2588880974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febc00c9cb0 0x7febc00ad4a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 >> 172.21.15.32:0/2588880974 conn(0x7febc006dae0 msgr2=0x7febc00ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:43.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 shutdown_connections 2023-10-14T12:19:43.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.763+0000 7febc7972700 1 -- 172.21.15.32:0/2588880974 wait complete. 2023-10-14T12:19:43.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:43.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.900+0000 7f7732f2d700 1 Processor -- start 2023-10-14T12:19:43.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.900+0000 7f7732f2d700 1 -- start start 2023-10-14T12:19:43.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7732f2d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f772c0cee90 0x7f772c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7732f2d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c15e290 0x7f772c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7732f2d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c158120 con 0x7f772c157d40 2023-10-14T12:19:43.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7732f2d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c06e560 con 0x7f772c0cee90 2023-10-14T12:19:43.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7732f2d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c15e720 con 0x7f772c15e290 2023-10-14T12:19:43.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7730cc9700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f772c157d40 0x7f772c06de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56862/0 (socket says 172.21.15.32:56862) 2023-10-14T12:19:43.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f7730cc9700 1 -- 172.21.15.32:0/3060857769 learned_addr learned my addr 172.21.15.32:0/3060857769 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:43.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f77314ca700 1 --2- 172.21.15.32:0/3060857769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c15e290 0x7f772c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.901+0000 7f772bfff700 1 --2- 172.21.15.32:0/3060857769 >> v2:172.21.15.92:3300/0 conn(0x7f772c0cee90 0x7f772c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f772b7fe700 1 -- 172.21.15.32:0/3060857769 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845624691 0 0) 0x7f772c158120 con 0x7f772c157d40 2023-10-14T12:19:43.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f772b7fe700 1 -- 172.21.15.32:0/3060857769 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f771c0035b0 con 0x7f772c157d40 2023-10-14T12:19:43.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f77314ca700 1 -- 172.21.15.32:0/3060857769 >> v2:172.21.15.92:3300/0 conn(0x7f772c0cee90 msgr2=0x7f772c15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:43.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f77314ca700 1 --2- 172.21.15.32:0/3060857769 >> v2:172.21.15.92:3300/0 conn(0x7f772c0cee90 0x7f772c15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f77314ca700 1 -- 172.21.15.32:0/3060857769 >> v1:172.21.15.32:6789/0 conn(0x7f772c157d40 legacy=0x7f772c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f77314ca700 1 -- 172.21.15.32:0/3060857769 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c06a840 con 0x7f772c15e290 2023-10-14T12:19:43.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f77314ca700 1 --2- 172.21.15.32:0/3060857769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c15e290 0x7f772c0cb420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7724008330 tx=0x7f772400a7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d55e4fe8f1e4da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:43.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f772b7fe700 1 -- 172.21.15.32:0/3060857769 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724003c20 con 0x7f772c15e290 2023-10-14T12:19:43.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f772b7fe700 1 -- 172.21.15.32:0/3060857769 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724003d80 con 0x7f772c15e290 2023-10-14T12:19:43.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.902+0000 7f772b7fe700 1 -- 172.21.15.32:0/3060857769 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ba90 con 0x7f772c15e290 2023-10-14T12:19:43.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 -- 172.21.15.32:0/3060857769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c15e290 msgr2=0x7f772c0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3060857769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c15e290 0x7f772c0cb420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7724008330 tx=0x7f772400a7b0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 -- 172.21.15.32:0/3060857769 shutdown_connections 2023-10-14T12:19:43.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3060857769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c15e290 0x7f772c0cb420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3060857769 >> v2:172.21.15.92:3300/0 conn(0x7f772c0cee90 0x7f772c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 -- 172.21.15.32:0/3060857769 >> 172.21.15.32:0/3060857769 conn(0x7f772c0cc6f0 msgr2=0x7f772c0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:43.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 -- 172.21.15.32:0/3060857769 shutdown_connections 2023-10-14T12:19:43.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.903+0000 7f7732f2d700 1 -- 172.21.15.32:0/3060857769 wait complete. 2023-10-14T12:19:43.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.904+0000 7f7732f2d700 1 Processor -- start 2023-10-14T12:19:43.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.904+0000 7f7732f2d700 1 -- start start 2023-10-14T12:19:43.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7732f2d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c0cee90 0x7f772c1f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7732f2d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 0x7f772c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7732f2d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c15e290 0x7f772c0c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7732f2d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c6520 con 0x7f772c157d40 2023-10-14T12:19:43.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7732f2d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1f3780 con 0x7f772c15e290 2023-10-14T12:19:43.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7732f2d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c5910 con 0x7f772c0cee90 2023-10-14T12:19:43.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 0x7f772c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 0x7f772c0c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39846/0 (socket says 172.21.15.32:39846) 2023-10-14T12:19:43.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 -- 172.21.15.32:0/3063937420 learned_addr learned my addr 172.21.15.32:0/3063937420 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:43.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f77314ca700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c15e290 0x7f772c0c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f7730cc9700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c0cee90 0x7f772c1f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 -- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c0cee90 msgr2=0x7f772c1f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c0cee90 0x7f772c1f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 -- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c15e290 msgr2=0x7f772c0c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:43.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c15e290 0x7f772c0c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:43.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.905+0000 7f772bfff700 1 -- 172.21.15.32:0/3063937420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772400aa90 con 0x7f772c157d40 2023-10-14T12:19:43.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.906+0000 7f772bfff700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 0x7f772c0c8e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7718012f50 tx=0x7f77180103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:43.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.906+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180109a0 con 0x7f772c157d40 2023-10-14T12:19:43.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.906+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718013040 con 0x7f772c157d40 2023-10-14T12:19:43.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.906+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c0c5bf0 con 0x7f772c157d40 2023-10-14T12:19:43.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.906+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718010d40 con 0x7f772c157d40 2023-10-14T12:19:43.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.906+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c0c61b0 con 0x7f772c157d40 2023-10-14T12:19:43.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.907+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c0c66d0 con 0x7f772c157d40 2023-10-14T12:19:43.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.907+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f77180070d0 con 0x7f772c157d40 2023-10-14T12:19:43.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.908+0000 7f77297fa700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f771006af00 0x7f771006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:43.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.908+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f771808dd20 con 0x7f772c157d40 2023-10-14T12:19:43.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.908+0000 7f7730cc9700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f771006af00 0x7f771006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:43.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.908+0000 7f7730cc9700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f771006af00 0x7f771006d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7720007fd0 tx=0x7f7720009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:43.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:43.912+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f772c0c66d0 con 0x7f772c157d40 2023-10-14T12:19:44.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.111+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f772c0c6340 con 0x7f772c157d40 2023-10-14T12:19:44.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.112+0000 7f77297fa700 1 -- 172.21.15.32:0/3063937420 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f7718058db0 con 0x7f772c157d40 2023-10-14T12:19:44.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:44.115 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:19:42.779025+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:19:40.903437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:19:41.752188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:44.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f771006af00 msgr2=0x7f771006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f771006af00 0x7f771006d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7720007fd0 tx=0x7f7720009040 comp rx=0 tx=0).stop 2023-10-14T12:19:44.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 msgr2=0x7f772c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 0x7f772c0c8e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7718012f50 tx=0x7f77180103a0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 shutdown_connections 2023-10-14T12:19:44.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f771006af00 0x7f771006d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c15e290 0x7f772c0c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f772c0cee90 0x7f772c1f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 --2- 172.21.15.32:0/3063937420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f772c157d40 0x7f772c0c8e70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.114+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 >> 172.21.15.32:0/3063937420 conn(0x7f772c0cc6f0 msgr2=0x7f772c0711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:44.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.115+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 shutdown_connections 2023-10-14T12:19:44.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.115+0000 7f7732f2d700 1 -- 172.21.15.32:0/3063937420 wait complete. 2023-10-14T12:19:44.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T12:19:44.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.256+0000 7fc1c1c99700 1 Processor -- start 2023-10-14T12:19:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.256+0000 7fc1c1c99700 1 -- start start 2023-10-14T12:19:44.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1c1c99700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc1bc0cfe30 0x7fc1bc0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1c1c99700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc15e7a0 con 0x7fc1bc15f1f0 2023-10-14T12:19:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1c1c99700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc0b29a0 con 0x7fc1bc15ab10 2023-10-14T12:19:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1c1c99700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc0b2c80 con 0x7fc1bc0cfe30 2023-10-14T12:19:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1baffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc1bc15f1f0 0x7fc1bc0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56878/0 (socket says 172.21.15.32:56878) 2023-10-14T12:19:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1baffd700 1 -- 172.21.15.32:0/3853230549 learned_addr learned my addr 172.21.15.32:0/3853230549 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1bbfff700 1 --2- 172.21.15.32:0/3853230549 >> v2:172.21.15.92:3300/0 conn(0x7fc1bc0cfe30 0x7fc1bc0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775845135 0 0) 0x7fc1bc15e7a0 con 0x7fc1bc15f1f0 2023-10-14T12:19:44.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a40035b0 con 0x7fc1bc15f1f0 2023-10-14T12:19:44.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265303304 0 0) 0x7fc1a40035b0 con 0x7fc1bc15f1f0 2023-10-14T12:19:44.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 >> v2:172.21.15.92:3300/0 conn(0x7fc1bc0cfe30 msgr2=0x7fc1bc0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:44.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 --2- 172.21.15.32:0/3853230549 >> v2:172.21.15.92:3300/0 conn(0x7fc1bc0cfe30 0x7fc1bc0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 >> v1:172.21.15.92:6789/0 conn(0x7fc1bc15ab10 legacy=0x7fc1bc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc15e9f0 con 0x7fc1bc15f1f0 2023-10-14T12:19:44.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.257+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7fc1b00017f0 con 0x7fc1bc15f1f0 2023-10-14T12:19:44.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 >> v1:172.21.15.32:6789/0 conn(0x7fc1bc15f1f0 legacy=0x7fc1bc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a4003a00 0x7fc1a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4004850 0x7fc1a4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4005210 0x7fc1a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc0b2c80 con 0x7fc1a4003a00 2023-10-14T12:19:44.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a400c0b0 con 0x7fc1a4004850 2023-10-14T12:19:44.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a400c270 con 0x7fc1a4005210 2023-10-14T12:19:44.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a4003a00 0x7fc1a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1baffd700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4004850 0x7fc1a4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bbfff700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4005210 0x7fc1a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 -- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4005210 msgr2=0x7fc1a400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:44.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4005210 0x7fc1a400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 -- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4004850 msgr2=0x7fc1a4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:44.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4004850 0x7fc1a4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 -- 172.21.15.32:0/3853230549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40035b0 con 0x7fc1a4003a00 2023-10-14T12:19:44.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bbfff700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4005210 0x7fc1a400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:44.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bbfff700 1 -- 172.21.15.32:0/3853230549 reap_dead start 2023-10-14T12:19:44.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a4003a00 0x7fc1a4003e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0017c0 tx=0x7fc1a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc4896b61226fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:44.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0052d0 con 0x7fc1a4003a00 2023-10-14T12:19:44.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac005430 con 0x7fc1a4003a00 2023-10-14T12:19:44.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.258+0000 7fc1ba7fc700 1 -- 172.21.15.32:0/3853230549 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0038c0 con 0x7fc1a4003a00 2023-10-14T12:19:44.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 -- 172.21.15.32:0/3853230549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a4003a00 msgr2=0x7fc1a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a4003a00 0x7fc1a4003e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0017c0 tx=0x7fc1a4005880 comp rx=0 tx=0).stop 2023-10-14T12:19:44.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 -- 172.21.15.32:0/3853230549 shutdown_connections 2023-10-14T12:19:44.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/3853230549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a4003a00 0x7fc1a4003e20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 -- 172.21.15.32:0/3853230549 >> 172.21.15.32:0/3853230549 conn(0x7fc1bc06dae0 msgr2=0x7fc1bc06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:44.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 -- 172.21.15.32:0/3853230549 shutdown_connections 2023-10-14T12:19:44.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.259+0000 7fc1c1c99700 1 -- 172.21.15.32:0/3853230549 wait complete. 2023-10-14T12:19:44.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.260+0000 7fc1c1c99700 1 Processor -- start 2023-10-14T12:19:44.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.261+0000 7fc1c1c99700 1 -- start start 2023-10-14T12:19:44.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4003a00 0x7fc1bc1efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1bc1579e0 0x7fc1bc1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 0x7fc1bc071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc1ef600 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc157e60 con 0x7fc1bc1579e0 2023-10-14T12:19:44.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc1f2fb0 con 0x7fc1a4003a00 2023-10-14T12:19:44.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 0x7fc1bc071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 0x7fc1bc071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39868/0 (socket says 172.21.15.32:39868) 2023-10-14T12:19:44.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 -- 172.21.15.32:0/2524281587 learned_addr learned my addr 172.21.15.32:0/2524281587 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:44.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4003a00 0x7fc1bc1efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1baffd700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1bc1579e0 0x7fc1bc1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 -- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4003a00 msgr2=0x7fc1bc1efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4003a00 0x7fc1bc1efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 -- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1bc1579e0 msgr2=0x7fc1bc1f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:44.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1bc1579e0 0x7fc1bc1f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:44.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 -- 172.21.15.32:0/2524281587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc1f3290 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1bbfff700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 0x7fc1bc071ee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc15e700 tx=0x7fc1b40124a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:44.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4010050 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4011040 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc1ef290 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.262+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4012e60 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.263+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc0c3a80 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.263+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc067d20 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.264+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc1b4017650 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.264+0000 7fc1a3fff700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc1a806af00 0x7fc1a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.264+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc1b408be90 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.265+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc1a806af00 0x7fc1a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.265+0000 7fc1bb7fe700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc1a806af00 0x7fc1a806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000c00 tx=0x7fc1ac009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:44.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.269+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1b4056f20 con 0x7fc1bc1f2a70 2023-10-14T12:19:44.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:44.519+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc1bc0afc10 con 0x7fc1bc1f2a70 2023-10-14T12:19:45.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.394+0000 7fc1a3fff700 1 -- 172.21.15.32:0/2524281587 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc1b405a540 con 0x7fc1bc1f2a70 2023-10-14T12:19:45.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc1a806af00 msgr2=0x7fc1a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:45.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc1a806af00 0x7fc1a806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000c00 tx=0x7fc1ac009030 comp rx=0 tx=0).stop 2023-10-14T12:19:45.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 msgr2=0x7fc1bc071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:45.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 0x7fc1bc071ee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc15e700 tx=0x7fc1b40124a0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 shutdown_connections 2023-10-14T12:19:45.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1bc1f2a70 0x7fc1bc071ee0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1a4003a00 0x7fc1bc1efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc1a806af00 0x7fc1a806d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 --2- 172.21.15.32:0/2524281587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1bc1579e0 0x7fc1bc1f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 >> 172.21.15.32:0/2524281587 conn(0x7fc1bc06dae0 msgr2=0x7fc1bc0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:45.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 shutdown_connections 2023-10-14T12:19:45.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.397+0000 7fc1c1c99700 1 -- 172.21.15.32:0/2524281587 wait complete. 2023-10-14T12:19:45.415 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T12:19:45.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T12:19:45.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 Processor -- start 2023-10-14T12:19:45.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 -- start start 2023-10-14T12:19:45.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62400cf8a0 0x7f62400d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400d1bc0 0x7f62400cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624015ee90 con 0x7f624015eab0 2023-10-14T12:19:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6240158370 con 0x7f62400cf8a0 2023-10-14T12:19:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.551+0000 7f6247181700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400d23b0 con 0x7f62400d1bc0 2023-10-14T12:19:45.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62400cf8a0 0x7f62400d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:45.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62400cf8a0 0x7f62400d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39874/0 (socket says 172.21.15.32:39874) 2023-10-14T12:19:45.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 -- 172.21.15.32:0/149551616 learned_addr learned my addr 172.21.15.32:0/149551616 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:45.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f624571e700 1 --2- 172.21.15.32:0/149551616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400d1bc0 0x7f62400cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:45.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 -- 172.21.15.32:0/149551616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400d1bc0 msgr2=0x7f62400cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:45.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 --2- 172.21.15.32:0/149551616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400d1bc0 0x7f62400cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 -- 172.21.15.32:0/149551616 >> v1:172.21.15.92:6789/0 conn(0x7f624015eab0 legacy=0x7f62400cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:45.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 -- 172.21.15.32:0/149551616 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400cda20 con 0x7f62400cf8a0 2023-10-14T12:19:45.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623ffff700 1 --2- 172.21.15.32:0/149551616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62400cf8a0 0x7f62400d1680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f624015f020 tx=0x7f622c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c3d60da3283115 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:45.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623f7fe700 1 -- 172.21.15.32:0/149551616 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c004230 con 0x7f62400cf8a0 2023-10-14T12:19:45.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623f7fe700 1 -- 172.21.15.32:0/149551616 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c004390 con 0x7f62400cf8a0 2023-10-14T12:19:45.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.552+0000 7f623f7fe700 1 -- 172.21.15.32:0/149551616 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0036a0 con 0x7f62400cf8a0 2023-10-14T12:19:45.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 -- 172.21.15.32:0/149551616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62400cf8a0 msgr2=0x7f62400d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:45.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 --2- 172.21.15.32:0/149551616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62400cf8a0 0x7f62400d1680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f624015f020 tx=0x7f622c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 -- 172.21.15.32:0/149551616 shutdown_connections 2023-10-14T12:19:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 --2- 172.21.15.32:0/149551616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400d1bc0 0x7f62400cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 --2- 172.21.15.32:0/149551616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62400cf8a0 0x7f62400d1680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 -- 172.21.15.32:0/149551616 >> 172.21.15.32:0/149551616 conn(0x7f62400665a0 msgr2=0x7f6240066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 -- 172.21.15.32:0/149551616 shutdown_connections 2023-10-14T12:19:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.553+0000 7f6247181700 1 -- 172.21.15.32:0/149551616 wait complete. 2023-10-14T12:19:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.554+0000 7f6247181700 1 Processor -- start 2023-10-14T12:19:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.554+0000 7f6247181700 1 -- start start 2023-10-14T12:19:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6247181700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400cf8a0 0x7f62401f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6247181700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62400d1bc0 0x7f62400b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6247181700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 0x7f62400b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6247181700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62401f3360 con 0x7f624015eab0 2023-10-14T12:19:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6247181700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6240160790 con 0x7f62400d1bc0 2023-10-14T12:19:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6247181700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6240160a70 con 0x7f62400cf8a0 2023-10-14T12:19:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 0x7f62400b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 0x7f62400b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39882/0 (socket says 172.21.15.32:39882) 2023-10-14T12:19:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 -- 172.21.15.32:0/3084677008 learned_addr learned my addr 172.21.15.32:0/3084677008 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f623ffff700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62400d1bc0 0x7f62400b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6244f1d700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400cf8a0 0x7f62401f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 -- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400cf8a0 msgr2=0x7f62401f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400cf8a0 0x7f62401f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 -- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62400d1bc0 msgr2=0x7f62400b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62400d1bc0 0x7f62400b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f624571e700 1 -- 172.21.15.32:0/3084677008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009550 con 0x7f624015eab0 2023-10-14T12:19:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.555+0000 7f6244f1d700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400cf8a0 0x7f62401f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.556+0000 7f624571e700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 0x7f62400b1fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f623800efc0 tx=0x7f623800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.556+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800cb80 con 0x7f624015eab0 2023-10-14T12:19:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.556+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800f040 con 0x7f624015eab0 2023-10-14T12:19:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.556+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6240160d50 con 0x7f624015eab0 2023-10-14T12:19:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.556+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238014480 con 0x7f624015eab0 2023-10-14T12:19:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.556+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6240161030 con 0x7f624015eab0 2023-10-14T12:19:45.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.557+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400d2010 con 0x7f624015eab0 2023-10-14T12:19:45.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.557+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62380145e0 con 0x7f624015eab0 2023-10-14T12:19:45.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.558+0000 7f623d7fa700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f622406af00 0x7f622406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:45.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.558+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6238089e60 con 0x7f624015eab0 2023-10-14T12:19:45.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.558+0000 7f6244f1d700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f622406af00 0x7f622406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.558+0000 7f6244f1d700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f622406af00 0x7f622406d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6234000f60 tx=0x7f6234009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.562+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6238054e60 con 0x7f624015eab0 2023-10-14T12:19:45.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:45.807+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6240067d20 con 0x7f624015eab0 2023-10-14T12:19:46.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.395+0000 7f623d7fa700 1 -- 172.21.15.32:0/3084677008 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 127+0+0 (secure 0 0 0) 0x7f6238018020 con 0x7f624015eab0 2023-10-14T12:19:46.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.397+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f622406af00 msgr2=0x7f622406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.397+0000 7f6247181700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f622406af00 0x7f622406d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6234000f60 tx=0x7f6234009040 comp rx=0 tx=0).stop 2023-10-14T12:19:46.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 msgr2=0x7f62400b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 0x7f62400b1fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f623800efc0 tx=0x7f623800c0c0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 shutdown_connections 2023-10-14T12:19:46.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f624015eab0 0x7f62400b1fe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62400cf8a0 0x7f62401f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f622406af00 0x7f622406d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 --2- 172.21.15.32:0/3084677008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62400d1bc0 0x7f62400b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 >> 172.21.15.32:0/3084677008 conn(0x7f62400665a0 msgr2=0x7f62400b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:46.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 shutdown_connections 2023-10-14T12:19:46.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.398+0000 7f6247181700 1 -- 172.21.15.32:0/3084677008 wait complete. 2023-10-14T12:19:46.414 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T12:19:46.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:46.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.544+0000 7f115de52700 1 Processor -- start 2023-10-14T12:19:46.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.544+0000 7f115de52700 1 -- start start 2023-10-14T12:19:46.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.544+0000 7f115de52700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f115815f050 0x7f11580cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.544+0000 7f115de52700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11580b0580 0x7f11580ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f115de52700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11580b0a80 con 0x7f11580ce620 2023-10-14T12:19:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f115de52700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580cea50 con 0x7f115815f050 2023-10-14T12:19:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f115de52700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580ccee0 con 0x7f11580b0580 2023-10-14T12:19:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f115815f050 0x7f11580cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f115815f050 0x7f11580cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39886/0 (socket says 172.21.15.32:39886) 2023-10-14T12:19:46.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f1157fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f11580ce620 0x7f11580cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56914/0 (socket says 172.21.15.32:56914) 2023-10-14T12:19:46.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 -- 172.21.15.32:0/4213004023 learned_addr learned my addr 172.21.15.32:0/4213004023 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:46.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f1156ffd700 1 --2- 172.21.15.32:0/4213004023 >> v2:172.21.15.92:3300/0 conn(0x7f11580b0580 0x7f11580ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 -- 172.21.15.32:0/4213004023 >> v2:172.21.15.92:3300/0 conn(0x7f11580b0580 msgr2=0x7f11580ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:46.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 --2- 172.21.15.32:0/4213004023 >> v2:172.21.15.92:3300/0 conn(0x7f11580b0580 0x7f11580ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 -- 172.21.15.32:0/4213004023 >> v1:172.21.15.32:6789/0 conn(0x7f11580ce620 legacy=0x7f11580cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11567fc700 1 -- 172.21.15.32:0/4213004023 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855326797 0 0) 0x7f11580b0a80 con 0x7f11580ce620 2023-10-14T12:19:46.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 -- 172.21.15.32:0/4213004023 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580cd1c0 con 0x7f115815f050 2023-10-14T12:19:46.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11577fe700 1 --2- 172.21.15.32:0/4213004023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f11580cdba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11580b1050 tx=0x7f1148009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eafbfa6ede1950e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:46.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11567fc700 1 -- 172.21.15.32:0/4213004023 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148011830 con 0x7f115815f050 2023-10-14T12:19:46.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11567fc700 1 -- 172.21.15.32:0/4213004023 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1148011990 con 0x7f115815f050 2023-10-14T12:19:46.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.545+0000 7f11567fc700 1 -- 172.21.15.32:0/4213004023 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148011d20 con 0x7f115815f050 2023-10-14T12:19:46.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 -- 172.21.15.32:0/4213004023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 msgr2=0x7f11580cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 --2- 172.21.15.32:0/4213004023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f11580cdba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11580b1050 tx=0x7f1148009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 -- 172.21.15.32:0/4213004023 shutdown_connections 2023-10-14T12:19:46.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 --2- 172.21.15.32:0/4213004023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f11580cdba0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 --2- 172.21.15.32:0/4213004023 >> v2:172.21.15.92:3300/0 conn(0x7f11580b0580 0x7f11580ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 -- 172.21.15.32:0/4213004023 >> 172.21.15.32:0/4213004023 conn(0x7f11580d1620 msgr2=0x7f11580d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:46.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 -- 172.21.15.32:0/4213004023 shutdown_connections 2023-10-14T12:19:46.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.546+0000 7f115de52700 1 -- 172.21.15.32:0/4213004023 wait complete. 2023-10-14T12:19:46.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.547+0000 7f115de52700 1 Processor -- start 2023-10-14T12:19:46.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.547+0000 7f115de52700 1 -- start start 2023-10-14T12:19:46.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f115de52700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11580b0580 0x7f1158151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f115de52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11580ce620 0x7f115815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f115de52700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f115815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f115de52700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158151ea0 con 0x7f115815f050 2023-10-14T12:19:46.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f115de52700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158151980 con 0x7f11580ce620 2023-10-14T12:19:46.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f115de52700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580c8a90 con 0x7f11580b0580 2023-10-14T12:19:46.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f115815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f115815a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39896/0 (socket says 172.21.15.32:39896) 2023-10-14T12:19:46.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 -- 172.21.15.32:0/1876484848 learned_addr learned my addr 172.21.15.32:0/1876484848 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:46.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 -- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11580b0580 msgr2=0x7f1158151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1156ffd700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11580ce620 0x7f115815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11580b0580 0x7f1158151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 -- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11580ce620 msgr2=0x7f115815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.548+0000 7f1157fff700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11580ce620 0x7f115815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f1157fff700 1 -- 172.21.15.32:0/1876484848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148009550 con 0x7f115815f050 2023-10-14T12:19:46.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f1156ffd700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11580ce620 0x7f115815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:46.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f1157fff700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f115815a5b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1150002230 tx=0x7f115000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:46.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000ac20 con 0x7f115815f050 2023-10-14T12:19:46.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000ada0 con 0x7f115815f050 2023-10-14T12:19:46.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11580c8d70 con 0x7f115815f050 2023-10-14T12:19:46.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150007310 con 0x7f115815f050 2023-10-14T12:19:46.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.549+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11580c9330 con 0x7f115815f050 2023-10-14T12:19:46.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.550+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1158067d20 con 0x7f115815f050 2023-10-14T12:19:46.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.550+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1150007470 con 0x7f115815f050 2023-10-14T12:19:46.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.551+0000 7f113ffff700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f114406af00 0x7f114406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.551+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1150089410 con 0x7f115815f050 2023-10-14T12:19:46.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.551+0000 7f11577fe700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f114406af00 0x7f114406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.551+0000 7f11577fe700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f114406af00 0x7f114406d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1148014040 tx=0x7f1148010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:46.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.555+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1150054530 con 0x7f115815f050 2023-10-14T12:19:46.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.803+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11580af560 con 0x7f115815f050 2023-10-14T12:19:46.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.803+0000 7f113ffff700 1 -- 172.21.15.32:0/1876484848 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f1150057b50 con 0x7f115815f050 2023-10-14T12:19:46.806 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:46.807 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2134315383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2134315383},{"type":"v1","addr":"172.21.15.32:6835","nonce":2134315383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6836/2794986339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2794986339},{"type":"v1","addr":"172.21.15.92:6836","nonce":2794986339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4144603594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6835","nonce":4144603594},{"type":"v1","addr":"172.21.15.92:6837","nonce":4144603594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:19:42.779342+0000","modified":"2023-10-14T12:19:45.809455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4915":{"gid":4915,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/2848056951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2848056951},{"type":"v1","addr":"172.21.15.32:6834","nonce":2848056951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:19:46.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.805+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f114406af00 msgr2=0x7f114406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.805+0000 7f115de52700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f114406af00 0x7f114406d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1148014040 tx=0x7f1148010000 comp rx=0 tx=0).stop 2023-10-14T12:19:46.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.805+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 msgr2=0x7f115815a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.805+0000 7f115de52700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f115815a5b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1150002230 tx=0x7f115000a060 comp rx=0 tx=0).stop 2023-10-14T12:19:46.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 shutdown_connections 2023-10-14T12:19:46.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f115815f050 0x7f115815a5b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11580b0580 0x7f1158151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f114406af00 0x7f114406d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 --2- 172.21.15.32:0/1876484848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11580ce620 0x7f115815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 >> 172.21.15.32:0/1876484848 conn(0x7f11580d1620 msgr2=0x7f11580c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:46.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 shutdown_connections 2023-10-14T12:19:46.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.806+0000 7f115de52700 1 -- 172.21.15.32:0/1876484848 wait complete. 2023-10-14T12:19:46.811 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 16 2023-10-14T12:19:46.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.947+0000 7fa6b3ce4700 1 Processor -- start 2023-10-14T12:19:46.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.947+0000 7fa6b3ce4700 1 -- start start 2023-10-14T12:19:46.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b3ce4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 0x7fa6ac15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b3ce4700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac0cf260 con 0x7fa6ac0cede0 2023-10-14T12:19:46.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b3ce4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac0b2d60 con 0x7fa6ac06a840 2023-10-14T12:19:46.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b3ce4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac1619a0 con 0x7fa6ac0cd950 2023-10-14T12:19:46.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b127f700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa6ac0cede0 0x7fa6ac15f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56924/0 (socket says 172.21.15.32:56924) 2023-10-14T12:19:46.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b127f700 1 -- 172.21.15.32:0/1993084370 learned_addr learned my addr 172.21.15.32:0/1993084370 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:46.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b1a80700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 0x7fa6ac15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104002754 0 0) 0x7fa6ac0cf260 con 0x7fa6ac0cede0 2023-10-14T12:19:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.948+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6980035b0 con 0x7fa6ac0cede0 2023-10-14T12:19:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016399011 0 0) 0x7fa6980035b0 con 0x7fa6ac0cede0 2023-10-14T12:19:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 msgr2=0x7fa6ac15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 0x7fa6ac15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 >> v1:172.21.15.92:6789/0 conn(0x7fa6ac06a840 legacy=0x7fa6ac161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac0cdd30 con 0x7fa6ac0cede0 2023-10-14T12:19:46.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7fa6a80017f0 con 0x7fa6ac0cede0 2023-10-14T12:19:46.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 >> v1:172.21.15.32:6789/0 conn(0x7fa6ac0cede0 legacy=0x7fa6ac15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 0x7fa698003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa698003f70 0x7fa698004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698004d90 0x7fa698005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac1619a0 con 0x7fa698003f70 2023-10-14T12:19:46.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69800ba70 con 0x7fa698004d90 2023-10-14T12:19:46.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69800bc30 con 0x7fa6ac0cd950 2023-10-14T12:19:46.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa698003f70 0x7fa698004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b1a80700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 0x7fa698003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b2281700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698004d90 0x7fa698005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 -- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 msgr2=0x7fa698003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:46.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac0cd950 0x7fa698003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 -- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698004d90 msgr2=0x7fa698005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:46.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698004d90 0x7fa698005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 -- 172.21.15.32:0/1993084370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980035b0 con 0x7fa698003f70 2023-10-14T12:19:46.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b2281700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698004d90 0x7fa698005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:46.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b127f700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa698003f70 0x7fa698004850 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c240 tx=0x7fa698005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678798bdd05cd1b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:46.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800ccc0 con 0x7fa698003f70 2023-10-14T12:19:46.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a800ce40 con 0x7fa698003f70 2023-10-14T12:19:46.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.949+0000 7fa6b0a7e700 1 -- 172.21.15.32:0/1993084370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8005a70 con 0x7fa698003f70 2023-10-14T12:19:46.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/1993084370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa698003f70 msgr2=0x7fa698004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/1993084370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa698003f70 0x7fa698004850 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c240 tx=0x7fa698005880 comp rx=0 tx=0).stop 2023-10-14T12:19:46.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b2281700 1 -- 172.21.15.32:0/1993084370 reap_dead start 2023-10-14T12:19:46.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/1993084370 shutdown_connections 2023-10-14T12:19:46.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/1993084370 >> 172.21.15.32:0/1993084370 conn(0x7fa6ac06dae0 msgr2=0x7fa6ac06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:46.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/1993084370 shutdown_connections 2023-10-14T12:19:46.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.950+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/1993084370 wait complete. 2023-10-14T12:19:46.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.951+0000 7fa6b3ce4700 1 Processor -- start 2023-10-14T12:19:46.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.951+0000 7fa6b3ce4700 1 -- start start 2023-10-14T12:19:46.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b3ce4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698003f70 0x7fa6ac0c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b3ce4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac1f6f50 0x7fa6ac0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b3ce4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 0x7fa6ac0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b3ce4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0ac8b0 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b3ce4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0af8a0 con 0x7fa698003f70 2023-10-14T12:19:46.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b3ce4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0b4690 con 0x7fa6ac1f6f50 2023-10-14T12:19:46.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b2281700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 0x7fa6ac0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b2281700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 0x7fa6ac0af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39916/0 (socket says 172.21.15.32:39916) 2023-10-14T12:19:46.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b2281700 1 -- 172.21.15.32:0/2671633461 learned_addr learned my addr 172.21.15.32:0/2671633461 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:46.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.952+0000 7fa6b1a80700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698003f70 0x7fa6ac0c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b127f700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac1f6f50 0x7fa6ac0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b2281700 1 -- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac1f6f50 msgr2=0x7fa6ac0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b2281700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac1f6f50 0x7fa6ac0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b2281700 1 -- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698003f70 msgr2=0x7fa6ac0c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:46.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b2281700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698003f70 0x7fa6ac0c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b2281700 1 -- 172.21.15.32:0/2671633461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac1f77a0 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b1a80700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698003f70 0x7fa6ac0c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b2281700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 0x7fa6ac0af360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0cdfc0 tx=0x7fa6a40021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4003c10 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4003d70 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400c9b0 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ac1f7a80 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.953+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac0b4950 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.954+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ac0b2630 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.954+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6a400cb10 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.955+0000 7fa6a27fc700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa69006af30 0x7fa69006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.955+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa6a40897a0 con 0x7fa6ac0aeeb0 2023-10-14T12:19:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.955+0000 7fa6b1a80700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa69006af30 0x7fa69006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.956+0000 7fa6b1a80700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa69006af30 0x7fa69006d3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009c60 tx=0x7fa69c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:46.959+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa6a4054820 con 0x7fa6ac0aeeb0 2023-10-14T12:19:47.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.161+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6ac0c7030 con 0x7fa6ac0aeeb0 2023-10-14T12:19:47.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.162+0000 7fa6a27fc700 1 -- 172.21.15.32:0/2671633461 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fa6a4057e40 con 0x7fa6ac0aeeb0 2023-10-14T12:19:47.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:47.166 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":32,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:19:44.367373+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:19:40.903437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:19:41.752188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:47.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa69006af30 msgr2=0x7fa69006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa69006af30 0x7fa69006d3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009c60 tx=0x7fa69c008040 comp rx=0 tx=0).stop 2023-10-14T12:19:47.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 msgr2=0x7fa6ac0af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 0x7fa6ac0af360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0cdfc0 tx=0x7fa6a40021e0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 shutdown_connections 2023-10-14T12:19:47.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6ac0aeeb0 0x7fa6ac0af360 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa69006af30 0x7fa69006d3f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa698003f70 0x7fa6ac0c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 --2- 172.21.15.32:0/2671633461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ac1f6f50 0x7fa6ac0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 >> 172.21.15.32:0/2671633461 conn(0x7fa6ac06dae0 msgr2=0x7fa6ac06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:47.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 shutdown_connections 2023-10-14T12:19:47.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.165+0000 7fa6b3ce4700 1 -- 172.21.15.32:0/2671633461 wait complete. 2023-10-14T12:19:47.180 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T12:19:47.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:19:47.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.304+0000 7fe44f1dc700 1 Processor -- start 2023-10-14T12:19:47.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.304+0000 7fe44f1dc700 1 -- start start 2023-10-14T12:19:47.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44f1dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe448157d40 0x7fe4480cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44f1dc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe44806e2b0 0x7fe4480cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44f1dc700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe448158120 con 0x7fe44806de50 2023-10-14T12:19:47.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44f1dc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44806a840 con 0x7fe44806e2b0 2023-10-14T12:19:47.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44f1dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480caef0 con 0x7fe448157d40 2023-10-14T12:19:47.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe447fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe44806de50 0x7fe44815dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56944/0 (socket says 172.21.15.32:56944) 2023-10-14T12:19:47.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe447fff700 1 -- 172.21.15.32:0/1424154882 learned_addr learned my addr 172.21.15.32:0/1424154882 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:47.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44d779700 1 --2- 172.21.15.32:0/1424154882 >> v2:172.21.15.92:3300/0 conn(0x7fe44806e2b0 0x7fe4480cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.305+0000 7fe44cf78700 1 --2- 172.21.15.32:0/1424154882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe448157d40 0x7fe4480cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe4477fe700 1 -- 172.21.15.32:0/1424154882 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856332202 0 0) 0x7fe448158120 con 0x7fe44806de50 2023-10-14T12:19:47.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe4477fe700 1 -- 172.21.15.32:0/1424154882 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4380035b0 con 0x7fe44806de50 2023-10-14T12:19:47.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe4477fe700 1 -- 172.21.15.32:0/1424154882 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261946635 0 0) 0x7fe4380035b0 con 0x7fe44806de50 2023-10-14T12:19:47.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe44cf78700 1 -- 172.21.15.32:0/1424154882 >> v2:172.21.15.92:3300/0 conn(0x7fe44806e2b0 msgr2=0x7fe4480cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:47.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe44cf78700 1 --2- 172.21.15.32:0/1424154882 >> v2:172.21.15.92:3300/0 conn(0x7fe44806e2b0 0x7fe4480cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe44cf78700 1 -- 172.21.15.32:0/1424154882 >> v1:172.21.15.32:6789/0 conn(0x7fe44806de50 legacy=0x7fe44815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe44cf78700 1 -- 172.21.15.32:0/1424154882 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44806e750 con 0x7fe448157d40 2023-10-14T12:19:47.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe44d779700 1 --2- 172.21.15.32:0/1424154882 >> v2:172.21.15.92:3300/0 conn(0x7fe44806e2b0 0x7fe4480cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:47.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe44cf78700 1 --2- 172.21.15.32:0/1424154882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe448157d40 0x7fe4480cee90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009840 tx=0x7fe43c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2525ab91071653 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:47.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe4477fe700 1 -- 172.21.15.32:0/1424154882 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434001670 con 0x7fe448157d40 2023-10-14T12:19:47.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe4477fe700 1 -- 172.21.15.32:0/1424154882 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c004030 con 0x7fe448157d40 2023-10-14T12:19:47.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.306+0000 7fe4477fe700 1 -- 172.21.15.32:0/1424154882 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0043a0 con 0x7fe448157d40 2023-10-14T12:19:47.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 -- 172.21.15.32:0/1424154882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe448157d40 msgr2=0x7fe4480cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/1424154882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe448157d40 0x7fe4480cee90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009840 tx=0x7fe43c009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:47.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 -- 172.21.15.32:0/1424154882 shutdown_connections 2023-10-14T12:19:47.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/1424154882 >> v2:172.21.15.92:3300/0 conn(0x7fe44806e2b0 0x7fe4480cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/1424154882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe448157d40 0x7fe4480cee90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 -- 172.21.15.32:0/1424154882 >> 172.21.15.32:0/1424154882 conn(0x7fe4480cc6f0 msgr2=0x7fe4480ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:47.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 -- 172.21.15.32:0/1424154882 shutdown_connections 2023-10-14T12:19:47.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.307+0000 7fe44f1dc700 1 -- 172.21.15.32:0/1424154882 wait complete. 2023-10-14T12:19:47.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.308+0000 7fe44f1dc700 1 Processor -- start 2023-10-14T12:19:47.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.308+0000 7fe44f1dc700 1 -- start start 2023-10-14T12:19:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44f1dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe44806de50 0x7fe44814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44f1dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 0x7fe4480c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44f1dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe448157d40 0x7fe4481f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44f1dc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480ad7b0 con 0x7fe44806e2b0 2023-10-14T12:19:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44f1dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480ada90 con 0x7fe448157d40 2023-10-14T12:19:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44f1dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480add70 con 0x7fe44806de50 2023-10-14T12:19:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe447fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 0x7fe4480c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe447fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 0x7fe4480c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39930/0 (socket says 172.21.15.32:39930) 2023-10-14T12:19:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe447fff700 1 -- 172.21.15.32:0/138854943 learned_addr learned my addr 172.21.15.32:0/138854943 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44d779700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe448157d40 0x7fe4481f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.309+0000 7fe44cf78700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe44806de50 0x7fe44814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe447fff700 1 -- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe44806de50 msgr2=0x7fe44814dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe447fff700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe44806de50 0x7fe44814dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe447fff700 1 -- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe448157d40 msgr2=0x7fe4481f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe447fff700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe448157d40 0x7fe4481f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe447fff700 1 -- 172.21.15.32:0/138854943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440009a70 con 0x7fe44806e2b0 2023-10-14T12:19:47.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe447fff700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 0x7fe4480c9860 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe4340011e0 tx=0x7fe43400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:47.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434004c80 con 0x7fe44806e2b0 2023-10-14T12:19:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434004de0 con 0x7fe44806e2b0 2023-10-14T12:19:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340072d0 con 0x7fe44806e2b0 2023-10-14T12:19:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c0094a0 con 0x7fe44806e2b0 2023-10-14T12:19:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.310+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4480ae330 con 0x7fe44806e2b0 2023-10-14T12:19:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.311+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4480c8440 con 0x7fe44806e2b0 2023-10-14T12:19:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.312+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe434007430 con 0x7fe44806e2b0 2023-10-14T12:19:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.312+0000 7fe4457fa700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe42c06af00 0x7fe42c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.312+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe4340893f0 con 0x7fe44806e2b0 2023-10-14T12:19:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.312+0000 7fe44cf78700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe42c06af00 0x7fe42c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.313+0000 7fe44cf78700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe42c06af00 0x7fe42c06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0090b0 tx=0x7fe43c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.316+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4480c8440 con 0x7fe44806e2b0 2023-10-14T12:19:47.349 INFO:tasks.ceph.mds.c.smithi032.stderr:2023-10-14T12:19:47.347+0000 7f59efea8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:19:47.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.513+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe44806ed10 con 0x7fe42c06af00 2023-10-14T12:19:47.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.522+0000 7fe4457fa700 1 -- 172.21.15.32:0/138854943 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288859 (secure 0 0 0) 0x7fe43c01f040 con 0x7fe42c06af00 2023-10-14T12:19:47.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:47.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe42c06af00 msgr2=0x7fe42c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe42c06af00 0x7fe42c06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0090b0 tx=0x7fe43c008030 comp rx=0 tx=0).stop 2023-10-14T12:19:47.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 msgr2=0x7fe4480c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 0x7fe4480c9860 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe4340011e0 tx=0x7fe43400ca50 comp rx=0 tx=0).stop 2023-10-14T12:19:47.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 shutdown_connections 2023-10-14T12:19:47.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fe42c06af00 0x7fe42c06d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe448157d40 0x7fe4481f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe44806de50 0x7fe44814dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 --2- 172.21.15.32:0/138854943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe44806e2b0 0x7fe4480c9860 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 >> 172.21.15.32:0/138854943 conn(0x7fe4480cc6f0 msgr2=0x7fe4481599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:47.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 shutdown_connections 2023-10-14T12:19:47.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.525+0000 7fe44f1dc700 1 -- 172.21.15.32:0/138854943 wait complete. 2023-10-14T12:19:47.533 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:19:47.539 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-14T12:19:47.110867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224348,"kb_used_data":3992,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750372,"statfs":{"total":773094113280,"available":772864380928,"internally_reserved":0,"allocated":4087808,"data_stored":2270984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.758010"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392500+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:43.392500+0000","last_peered":"2023-10-14T12:19:43.392500+0000","last_clean":"2023-10-14T12:19:43.392500+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:43.392500+0000","last_undegraded":"2023-10-14T12:19:43.392500+0000","last_fullsized":"2023-10-14T12:19:43.392500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.217413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374519+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:44.374519+0000","last_peered":"2023-10-14T12:19:44.374519+0000","last_clean":"2023-10-14T12:19:44.374519+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:44.374519+0000","last_undegraded":"2023-10-14T12:19:44.374519+0000","last_fullsized":"2023-10-14T12:19:44.374519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374280+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:44.374280+0000","last_peered":"2023-10-14T12:19:44.374280+0000","last_clean":"2023-10-14T12:19:44.374280+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:44.374280+0000","last_undegraded":"2023-10-14T12:19:44.374280+0000","last_fullsized":"2023-10-14T12:19:44.374280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395422+0000","last_change":"2023-10-14T12:19:43.390887+0000","last_active":"2023-10-14T12:19:43.395422+0000","last_peered":"2023-10-14T12:19:43.395422+0000","last_clean":"2023-10-14T12:19:43.395422+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:19:43.395422+0000","last_undegraded":"2023-10-14T12:19:43.395422+0000","last_fullsized":"2023-10-14T12:19:43.395422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:06.970537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370444+0000","last_change":"2023-10-14T12:19:43.379488+0000","last_active":"2023-10-14T12:19:44.370444+0000","last_peered":"2023-10-14T12:19:44.370444+0000","last_clean":"2023-10-14T12:19:44.370444+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:19:44.370444+0000","last_undegraded":"2023-10-14T12:19:44.370444+0000","last_fullsized":"2023-10-14T12:19:44.370444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374228+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:44.374228+0000","last_peered":"2023-10-14T12:19:44.374228+0000","last_clean":"2023-10-14T12:19:44.374228+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:44.374228+0000","last_undegraded":"2023-10-14T12:19:44.374228+0000","last_fullsized":"2023-10-14T12:19:44.374228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950553+0000","last_change":"2023-10-14T12:19:43.381841+0000","last_active":"2023-10-14T12:19:44.950553+0000","last_peered":"2023-10-14T12:19:44.950553+0000","last_clean":"2023-10-14T12:19:44.950553+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:19:44.950553+0000","last_undegraded":"2023-10-14T12:19:44.950553+0000","last_fullsized":"2023-10-14T12:19:44.950553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950418+0000","last_change":"2023-10-14T12:19:43.382639+0000","last_active":"2023-10-14T12:19:44.950418+0000","last_peered":"2023-10-14T12:19:44.950418+0000","last_clean":"2023-10-14T12:19:44.950418+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:19:44.950418+0000","last_undegraded":"2023-10-14T12:19:44.950418+0000","last_fullsized":"2023-10-14T12:19:44.950418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392163+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:43.392163+0000","last_peered":"2023-10-14T12:19:43.392163+0000","last_clean":"2023-10-14T12:19:43.392163+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:43.392163+0000","last_undegraded":"2023-10-14T12:19:43.392163+0000","last_fullsized":"2023-10-14T12:19:43.392163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:18.859040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.387803+0000","last_change":"2023-10-14T12:19:43.382683+0000","last_active":"2023-10-14T12:19:43.387803+0000","last_peered":"2023-10-14T12:19:43.387803+0000","last_clean":"2023-10-14T12:19:43.387803+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:19:43.387803+0000","last_undegraded":"2023-10-14T12:19:43.387803+0000","last_fullsized":"2023-10-14T12:19:43.387803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:18.859040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950759+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:44.950759+0000","last_peered":"2023-10-14T12:19:44.950759+0000","last_clean":"2023-10-14T12:19:44.950759+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:44.950759+0000","last_undegraded":"2023-10-14T12:19:44.950759+0000","last_fullsized":"2023-10-14T12:19:44.950759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374556+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:44.374556+0000","last_peered":"2023-10-14T12:19:44.374556+0000","last_clean":"2023-10-14T12:19:44.374556+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:44.374556+0000","last_undegraded":"2023-10-14T12:19:44.374556+0000","last_fullsized":"2023-10-14T12:19:44.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370587+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:44.370587+0000","last_peered":"2023-10-14T12:19:44.370587+0000","last_clean":"2023-10-14T12:19:44.370587+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:44.370587+0000","last_undegraded":"2023-10-14T12:19:44.370587+0000","last_fullsized":"2023-10-14T12:19:44.370587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374251+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:44.374251+0000","last_peered":"2023-10-14T12:19:44.374251+0000","last_clean":"2023-10-14T12:19:44.374251+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:44.374251+0000","last_undegraded":"2023-10-14T12:19:44.374251+0000","last_fullsized":"2023-10-14T12:19:44.374251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374071+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:44.374071+0000","last_peered":"2023-10-14T12:19:44.374071+0000","last_clean":"2023-10-14T12:19:44.374071+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:44.374071+0000","last_undegraded":"2023-10-14T12:19:44.374071+0000","last_fullsized":"2023-10-14T12:19:44.374071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950717+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:44.950717+0000","last_peered":"2023-10-14T12:19:44.950717+0000","last_clean":"2023-10-14T12:19:44.950717+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:44.950717+0000","last_undegraded":"2023-10-14T12:19:44.950717+0000","last_fullsized":"2023-10-14T12:19:44.950717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.951014+0000","last_change":"2023-10-14T12:19:43.381288+0000","last_active":"2023-10-14T12:19:44.951014+0000","last_peered":"2023-10-14T12:19:44.951014+0000","last_clean":"2023-10-14T12:19:44.951014+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:19:44.951014+0000","last_undegraded":"2023-10-14T12:19:44.951014+0000","last_fullsized":"2023-10-14T12:19:44.951014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374498+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:44.374498+0000","last_peered":"2023-10-14T12:19:44.374498+0000","last_clean":"2023-10-14T12:19:44.374498+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:44.374498+0000","last_undegraded":"2023-10-14T12:19:44.374498+0000","last_fullsized":"2023-10-14T12:19:44.374498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374414+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:44.374414+0000","last_peered":"2023-10-14T12:19:44.374414+0000","last_clean":"2023-10-14T12:19:44.374414+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:44.374414+0000","last_undegraded":"2023-10-14T12:19:44.374414+0000","last_fullsized":"2023-10-14T12:19:44.374414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370717+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:44.370717+0000","last_peered":"2023-10-14T12:19:44.370717+0000","last_clean":"2023-10-14T12:19:44.370717+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:44.370717+0000","last_undegraded":"2023-10-14T12:19:44.370717+0000","last_fullsized":"2023-10-14T12:19:44.370717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.393744+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:43.393744+0000","last_peered":"2023-10-14T12:19:43.393744+0000","last_clean":"2023-10-14T12:19:43.393744+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:43.393744+0000","last_undegraded":"2023-10-14T12:19:43.393744+0000","last_fullsized":"2023-10-14T12:19:43.393744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:06.970537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388328+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:43.388328+0000","last_peered":"2023-10-14T12:19:43.388328+0000","last_clean":"2023-10-14T12:19:43.388328+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:43.388328+0000","last_undegraded":"2023-10-14T12:19:43.388328+0000","last_fullsized":"2023-10-14T12:19:43.388328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388225+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:43.388225+0000","last_peered":"2023-10-14T12:19:43.388225+0000","last_clean":"2023-10-14T12:19:43.388225+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:19:43.388225+0000","last_undegraded":"2023-10-14T12:19:43.388225+0000","last_fullsized":"2023-10-14T12:19:43.388225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374009+0000","last_change":"2023-10-14T12:19:43.381941+0000","last_active":"2023-10-14T12:19:44.374009+0000","last_peered":"2023-10-14T12:19:44.374009+0000","last_clean":"2023-10-14T12:19:44.374009+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:19:44.374009+0000","last_undegraded":"2023-10-14T12:19:44.374009+0000","last_fullsized":"2023-10-14T12:19:44.374009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.387536+0000","last_change":"2023-10-14T12:19:43.382954+0000","last_active":"2023-10-14T12:19:43.387536+0000","last_peered":"2023-10-14T12:19:43.387536+0000","last_clean":"2023-10-14T12:19:43.387536+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:19:43.387536+0000","last_undegraded":"2023-10-14T12:19:43.387536+0000","last_fullsized":"2023-10-14T12:19:43.387536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:49.809505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374673+0000","last_change":"2023-10-14T12:19:43.380761+0000","last_active":"2023-10-14T12:19:44.374673+0000","last_peered":"2023-10-14T12:19:44.374673+0000","last_clean":"2023-10-14T12:19:44.374673+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:44.374673+0000","last_undegraded":"2023-10-14T12:19:44.374673+0000","last_fullsized":"2023-10-14T12:19:44.374673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:17.111399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395587+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:43.395587+0000","last_peered":"2023-10-14T12:19:43.395587+0000","last_clean":"2023-10-14T12:19:43.395587+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:43.395587+0000","last_undegraded":"2023-10-14T12:19:43.395587+0000","last_fullsized":"2023-10-14T12:19:43.395587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:25.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374585+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:44.374585+0000","last_peered":"2023-10-14T12:19:44.374585+0000","last_clean":"2023-10-14T12:19:44.374585+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:44.374585+0000","last_undegraded":"2023-10-14T12:19:44.374585+0000","last_fullsized":"2023-10-14T12:19:44.374585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392376+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:43.392376+0000","last_peered":"2023-10-14T12:19:43.392376+0000","last_clean":"2023-10-14T12:19:43.392376+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:43.392376+0000","last_undegraded":"2023-10-14T12:19:43.392376+0000","last_fullsized":"2023-10-14T12:19:43.392376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950548+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:44.950548+0000","last_peered":"2023-10-14T12:19:44.950548+0000","last_clean":"2023-10-14T12:19:44.950548+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:44.950548+0000","last_undegraded":"2023-10-14T12:19:44.950548+0000","last_fullsized":"2023-10-14T12:19:44.950548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382483+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:43.382483+0000","last_peered":"2023-10-14T12:19:43.382483+0000","last_clean":"2023-10-14T12:19:43.382483+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:43.382483+0000","last_undegraded":"2023-10-14T12:19:43.382483+0000","last_fullsized":"2023-10-14T12:19:43.382483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950873+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:44.950873+0000","last_peered":"2023-10-14T12:19:44.950873+0000","last_clean":"2023-10-14T12:19:44.950873+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:44.950873+0000","last_undegraded":"2023-10-14T12:19:44.950873+0000","last_fullsized":"2023-10-14T12:19:44.950873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395284+0000","last_change":"2023-10-14T12:19:43.393781+0000","last_active":"2023-10-14T12:19:43.395284+0000","last_peered":"2023-10-14T12:19:43.395284+0000","last_clean":"2023-10-14T12:19:43.395284+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:19:43.395284+0000","last_undegraded":"2023-10-14T12:19:43.395284+0000","last_fullsized":"2023-10-14T12:19:43.395284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:15.685211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403974+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:43.403974+0000","last_peered":"2023-10-14T12:19:43.403974+0000","last_clean":"2023-10-14T12:19:43.403974+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:43.403974+0000","last_undegraded":"2023-10-14T12:19:43.403974+0000","last_fullsized":"2023-10-14T12:19:43.403974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:14.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392518+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:43.392518+0000","last_peered":"2023-10-14T12:19:43.392518+0000","last_clean":"2023-10-14T12:19:43.392518+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:43.392518+0000","last_undegraded":"2023-10-14T12:19:43.392518+0000","last_fullsized":"2023-10-14T12:19:43.392518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.401828+0000","last_change":"2023-10-14T12:19:42.374484+0000","last_active":"2023-10-14T12:19:43.401828+0000","last_peered":"2023-10-14T12:19:43.401828+0000","last_clean":"2023-10-14T12:19:43.401828+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:19:43.401828+0000","last_undegraded":"2023-10-14T12:19:43.401828+0000","last_fullsized":"2023-10-14T12:19:43.401828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.393032+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:43.393032+0000","last_peered":"2023-10-14T12:19:43.393032+0000","last_clean":"2023-10-14T12:19:43.393032+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:43.393032+0000","last_undegraded":"2023-10-14T12:19:43.393032+0000","last_fullsized":"2023-10-14T12:19:43.393032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374493+0000","last_change":"2023-10-14T12:19:42.374263+0000","last_active":"2023-10-14T12:19:44.374493+0000","last_peered":"2023-10-14T12:19:44.374493+0000","last_clean":"2023-10-14T12:19:44.374493+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:19:44.374493+0000","last_undegraded":"2023-10-14T12:19:44.374493+0000","last_fullsized":"2023-10-14T12:19:44.374493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:59.390912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395614+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:43.395614+0000","last_peered":"2023-10-14T12:19:43.395614+0000","last_clean":"2023-10-14T12:19:43.395614+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:43.395614+0000","last_undegraded":"2023-10-14T12:19:43.395614+0000","last_fullsized":"2023-10-14T12:19:43.395614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:27.468407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370652+0000","last_change":"2023-10-14T12:19:42.377643+0000","last_active":"2023-10-14T12:19:44.370652+0000","last_peered":"2023-10-14T12:19:44.370652+0000","last_clean":"2023-10-14T12:19:44.370652+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:44.370652+0000","last_undegraded":"2023-10-14T12:19:44.370652+0000","last_fullsized":"2023-10-14T12:19:44.370652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:00.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950565+0000","last_change":"2023-10-14T12:19:43.389426+0000","last_active":"2023-10-14T12:19:44.950565+0000","last_peered":"2023-10-14T12:19:44.950565+0000","last_clean":"2023-10-14T12:19:44.950565+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:19:44.950565+0000","last_undegraded":"2023-10-14T12:19:44.950565+0000","last_fullsized":"2023-10-14T12:19:44.950565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.405197+0000","last_change":"2023-10-14T12:19:42.375646+0000","last_active":"2023-10-14T12:19:43.405197+0000","last_peered":"2023-10-14T12:19:43.405197+0000","last_clean":"2023-10-14T12:19:43.405197+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:19:43.405197+0000","last_undegraded":"2023-10-14T12:19:43.405197+0000","last_fullsized":"2023-10-14T12:19:43.405197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374300+0000","last_change":"2023-10-14T12:19:43.390502+0000","last_active":"2023-10-14T12:19:44.374300+0000","last_peered":"2023-10-14T12:19:44.374300+0000","last_clean":"2023-10-14T12:19:44.374300+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:19:44.374300+0000","last_undegraded":"2023-10-14T12:19:44.374300+0000","last_fullsized":"2023-10-14T12:19:44.374300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.405160+0000","last_change":"2023-10-14T12:19:42.375014+0000","last_active":"2023-10-14T12:19:43.405160+0000","last_peered":"2023-10-14T12:19:43.405160+0000","last_clean":"2023-10-14T12:19:43.405160+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:19:43.405160+0000","last_undegraded":"2023-10-14T12:19:43.405160+0000","last_fullsized":"2023-10-14T12:19:43.405160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:36.593916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388087+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:43.388087+0000","last_peered":"2023-10-14T12:19:43.388087+0000","last_clean":"2023-10-14T12:19:43.388087+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:43.388087+0000","last_undegraded":"2023-10-14T12:19:43.388087+0000","last_fullsized":"2023-10-14T12:19:43.388087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:01.052281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373966+0000","last_change":"2023-10-14T12:19:42.373819+0000","last_active":"2023-10-14T12:19:44.373966+0000","last_peered":"2023-10-14T12:19:44.373966+0000","last_clean":"2023-10-14T12:19:44.373966+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:19:44.373966+0000","last_undegraded":"2023-10-14T12:19:44.373966+0000","last_fullsized":"2023-10-14T12:19:44.373966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388976+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:43.388976+0000","last_peered":"2023-10-14T12:19:43.388976+0000","last_clean":"2023-10-14T12:19:43.388976+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:43.388976+0000","last_undegraded":"2023-10-14T12:19:43.388976+0000","last_fullsized":"2023-10-14T12:19:43.388976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:31.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373952+0000","last_change":"2023-10-14T12:19:42.372089+0000","last_active":"2023-10-14T12:19:43.373952+0000","last_peered":"2023-10-14T12:19:43.373952+0000","last_clean":"2023-10-14T12:19:43.373952+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:19:43.373952+0000","last_undegraded":"2023-10-14T12:19:43.373952+0000","last_fullsized":"2023-10-14T12:19:43.373952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:22.438051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374586+0000","last_change":"2023-10-14T12:19:43.382324+0000","last_active":"2023-10-14T12:19:44.374586+0000","last_peered":"2023-10-14T12:19:44.374586+0000","last_clean":"2023-10-14T12:19:44.374586+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:19:44.374586+0000","last_undegraded":"2023-10-14T12:19:44.374586+0000","last_fullsized":"2023-10-14T12:19:44.374586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374708+0000","last_change":"2023-10-14T12:19:42.372382+0000","last_active":"2023-10-14T12:19:44.374708+0000","last_peered":"2023-10-14T12:19:44.374708+0000","last_clean":"2023-10-14T12:19:44.374708+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:19:44.374708+0000","last_undegraded":"2023-10-14T12:19:44.374708+0000","last_fullsized":"2023-10-14T12:19:44.374708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374844+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:44.374844+0000","last_peered":"2023-10-14T12:19:44.374844+0000","last_clean":"2023-10-14T12:19:44.374844+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:44.374844+0000","last_undegraded":"2023-10-14T12:19:44.374844+0000","last_fullsized":"2023-10-14T12:19:44.374844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:47:38.320770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382584+0000","last_change":"2023-10-14T12:19:42.376458+0000","last_active":"2023-10-14T12:19:43.382584+0000","last_peered":"2023-10-14T12:19:43.382584+0000","last_clean":"2023-10-14T12:19:43.382584+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:19:43.382584+0000","last_undegraded":"2023-10-14T12:19:43.382584+0000","last_fullsized":"2023-10-14T12:19:43.382584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374529+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:44.374529+0000","last_peered":"2023-10-14T12:19:44.374529+0000","last_clean":"2023-10-14T12:19:44.374529+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:44.374529+0000","last_undegraded":"2023-10-14T12:19:44.374529+0000","last_fullsized":"2023-10-14T12:19:44.374529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374572+0000","last_change":"2023-10-14T12:19:42.373797+0000","last_active":"2023-10-14T12:19:44.374572+0000","last_peered":"2023-10-14T12:19:44.374572+0000","last_clean":"2023-10-14T12:19:44.374572+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:19:44.374572+0000","last_undegraded":"2023-10-14T12:19:44.374572+0000","last_fullsized":"2023-10-14T12:19:44.374572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:21.195047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374459+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:44.374459+0000","last_peered":"2023-10-14T12:19:44.374459+0000","last_clean":"2023-10-14T12:19:44.374459+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:44.374459+0000","last_undegraded":"2023-10-14T12:19:44.374459+0000","last_fullsized":"2023-10-14T12:19:44.374459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374488+0000","last_change":"2023-10-14T12:19:42.371158+0000","last_active":"2023-10-14T12:19:44.374488+0000","last_peered":"2023-10-14T12:19:44.374488+0000","last_clean":"2023-10-14T12:19:44.374488+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:19:44.374488+0000","last_undegraded":"2023-10-14T12:19:44.374488+0000","last_fullsized":"2023-10-14T12:19:44.374488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:24.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.386526+0000","last_change":"2023-10-14T12:19:43.380181+0000","last_active":"2023-10-14T12:19:43.386526+0000","last_peered":"2023-10-14T12:19:43.386526+0000","last_clean":"2023-10-14T12:19:43.386526+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:19:43.386526+0000","last_undegraded":"2023-10-14T12:19:43.386526+0000","last_fullsized":"2023-10-14T12:19:43.386526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.217413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.402538+0000","last_change":"2023-10-14T12:19:42.373775+0000","last_active":"2023-10-14T12:19:43.402538+0000","last_peered":"2023-10-14T12:19:43.402538+0000","last_clean":"2023-10-14T12:19:43.402538+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:19:43.402538+0000","last_undegraded":"2023-10-14T12:19:43.402538+0000","last_fullsized":"2023-10-14T12:19:43.402538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374439+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:44.374439+0000","last_peered":"2023-10-14T12:19:44.374439+0000","last_clean":"2023-10-14T12:19:44.374439+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:44.374439+0000","last_undegraded":"2023-10-14T12:19:44.374439+0000","last_fullsized":"2023-10-14T12:19:44.374439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.375458+0000","last_change":"2023-10-14T12:19:42.373838+0000","last_active":"2023-10-14T12:19:43.375458+0000","last_peered":"2023-10-14T12:19:43.375458+0000","last_clean":"2023-10-14T12:19:43.375458+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:19:43.375458+0000","last_undegraded":"2023-10-14T12:19:43.375458+0000","last_fullsized":"2023-10-14T12:19:43.375458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950851+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:44.950851+0000","last_peered":"2023-10-14T12:19:44.950851+0000","last_clean":"2023-10-14T12:19:44.950851+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:44.950851+0000","last_undegraded":"2023-10-14T12:19:44.950851+0000","last_fullsized":"2023-10-14T12:19:44.950851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374044+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:44.374044+0000","last_peered":"2023-10-14T12:19:44.374044+0000","last_clean":"2023-10-14T12:19:44.374044+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:44.374044+0000","last_undegraded":"2023-10-14T12:19:44.374044+0000","last_fullsized":"2023-10-14T12:19:44.374044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.396385+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:43.396385+0000","last_peered":"2023-10-14T12:19:43.396385+0000","last_clean":"2023-10-14T12:19:43.396385+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:43.396385+0000","last_undegraded":"2023-10-14T12:19:43.396385+0000","last_fullsized":"2023-10-14T12:19:43.396385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:49.809505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374022+0000","last_change":"2023-10-14T12:19:42.373204+0000","last_active":"2023-10-14T12:19:44.374022+0000","last_peered":"2023-10-14T12:19:44.374022+0000","last_clean":"2023-10-14T12:19:44.374022+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:19:44.374022+0000","last_undegraded":"2023-10-14T12:19:44.374022+0000","last_fullsized":"2023-10-14T12:19:44.374022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:40.688686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392056+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:43.392056+0000","last_peered":"2023-10-14T12:19:43.392056+0000","last_clean":"2023-10-14T12:19:43.392056+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:43.392056+0000","last_undegraded":"2023-10-14T12:19:43.392056+0000","last_fullsized":"2023-10-14T12:19:43.392056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:15.685211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403326+0000","last_change":"2023-10-14T12:19:42.376646+0000","last_active":"2023-10-14T12:19:43.403326+0000","last_peered":"2023-10-14T12:19:43.403326+0000","last_clean":"2023-10-14T12:19:43.403326+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:19:43.403326+0000","last_undegraded":"2023-10-14T12:19:43.403326+0000","last_fullsized":"2023-10-14T12:19:43.403326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:37.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374521+0000","last_change":"2023-10-14T12:19:43.388112+0000","last_active":"2023-10-14T12:19:44.374521+0000","last_peered":"2023-10-14T12:19:44.374521+0000","last_clean":"2023-10-14T12:19:44.374521+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:19:44.374521+0000","last_undegraded":"2023-10-14T12:19:44.374521+0000","last_fullsized":"2023-10-14T12:19:44.374521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.402624+0000","last_change":"2023-10-14T12:19:42.373858+0000","last_active":"2023-10-14T12:19:43.402624+0000","last_peered":"2023-10-14T12:19:43.402624+0000","last_clean":"2023-10-14T12:19:43.402624+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:19:43.402624+0000","last_undegraded":"2023-10-14T12:19:43.402624+0000","last_fullsized":"2023-10-14T12:19:43.402624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.389999+0000","last_change":"2023-10-14T12:19:43.388334+0000","last_active":"2023-10-14T12:19:43.389999+0000","last_peered":"2023-10-14T12:19:43.389999+0000","last_clean":"2023-10-14T12:19:43.389999+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:19:43.389999+0000","last_undegraded":"2023-10-14T12:19:43.389999+0000","last_fullsized":"2023-10-14T12:19:43.389999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:15.685211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403153+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:43.403153+0000","last_peered":"2023-10-14T12:19:43.403153+0000","last_clean":"2023-10-14T12:19:43.403153+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:43.403153+0000","last_undegraded":"2023-10-14T12:19:43.403153+0000","last_fullsized":"2023-10-14T12:19:43.403153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:12.099355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370543+0000","last_change":"2023-10-14T12:19:43.384205+0000","last_active":"2023-10-14T12:19:44.370543+0000","last_peered":"2023-10-14T12:19:44.370543+0000","last_clean":"2023-10-14T12:19:44.370543+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:19:44.370543+0000","last_undegraded":"2023-10-14T12:19:44.370543+0000","last_fullsized":"2023-10-14T12:19:44.370543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:37.599241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.377385+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:43.377385+0000","last_peered":"2023-10-14T12:19:43.377385+0000","last_clean":"2023-10-14T12:19:43.377385+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:43.377385+0000","last_undegraded":"2023-10-14T12:19:43.377385+0000","last_fullsized":"2023-10-14T12:19:43.377385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:19.606346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370619+0000","last_change":"2023-10-14T12:19:43.388769+0000","last_active":"2023-10-14T12:19:44.370619+0000","last_peered":"2023-10-14T12:19:44.370619+0000","last_clean":"2023-10-14T12:19:44.370619+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:19:44.370619+0000","last_undegraded":"2023-10-14T12:19:44.370619+0000","last_fullsized":"2023-10-14T12:19:44.370619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.402714+0000","last_change":"2023-10-14T12:19:42.378784+0000","last_active":"2023-10-14T12:19:43.402714+0000","last_peered":"2023-10-14T12:19:43.402714+0000","last_clean":"2023-10-14T12:19:43.402714+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:43.402714+0000","last_undegraded":"2023-10-14T12:19:43.402714+0000","last_fullsized":"2023-10-14T12:19:43.402714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370513+0000","last_change":"2023-10-14T12:19:43.390194+0000","last_active":"2023-10-14T12:19:44.370513+0000","last_peered":"2023-10-14T12:19:44.370513+0000","last_clean":"2023-10-14T12:19:44.370513+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:19:44.370513+0000","last_undegraded":"2023-10-14T12:19:44.370513+0000","last_fullsized":"2023-10-14T12:19:44.370513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:13.104681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.375610+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:43.375610+0000","last_peered":"2023-10-14T12:19:43.375610+0000","last_clean":"2023-10-14T12:19:43.375610+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:43.375610+0000","last_undegraded":"2023-10-14T12:19:43.375610+0000","last_fullsized":"2023-10-14T12:19:43.375610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370406+0000","last_change":"2023-10-14T12:19:43.382787+0000","last_active":"2023-10-14T12:19:44.370406+0000","last_peered":"2023-10-14T12:19:44.370406+0000","last_clean":"2023-10-14T12:19:44.370406+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:19:44.370406+0000","last_undegraded":"2023-10-14T12:19:44.370406+0000","last_fullsized":"2023-10-14T12:19:44.370406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.377721+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:43.377721+0000","last_peered":"2023-10-14T12:19:43.377721+0000","last_clean":"2023-10-14T12:19:43.377721+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:43.377721+0000","last_undegraded":"2023-10-14T12:19:43.377721+0000","last_fullsized":"2023-10-14T12:19:43.377721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:17.650999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950643+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:44.950643+0000","last_peered":"2023-10-14T12:19:44.950643+0000","last_clean":"2023-10-14T12:19:44.950643+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:44.950643+0000","last_undegraded":"2023-10-14T12:19:44.950643+0000","last_fullsized":"2023-10-14T12:19:44.950643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373934+0000","last_change":"2023-10-14T12:19:42.377594+0000","last_active":"2023-10-14T12:19:44.373934+0000","last_peered":"2023-10-14T12:19:44.373934+0000","last_clean":"2023-10-14T12:19:44.373934+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:44.373934+0000","last_undegraded":"2023-10-14T12:19:44.373934+0000","last_fullsized":"2023-10-14T12:19:44.373934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370575+0000","last_change":"2023-10-14T12:19:43.388662+0000","last_active":"2023-10-14T12:19:44.370575+0000","last_peered":"2023-10-14T12:19:44.370575+0000","last_clean":"2023-10-14T12:19:44.370575+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:19:44.370575+0000","last_undegraded":"2023-10-14T12:19:44.370575+0000","last_fullsized":"2023-10-14T12:19:44.370575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:20.611672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403001+0000","last_change":"2023-10-14T12:19:42.377243+0000","last_active":"2023-10-14T12:19:43.403001+0000","last_peered":"2023-10-14T12:19:43.403001+0000","last_clean":"2023-10-14T12:19:43.403001+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:19:43.403001+0000","last_undegraded":"2023-10-14T12:19:43.403001+0000","last_fullsized":"2023-10-14T12:19:43.403001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:55.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374463+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:44.374463+0000","last_peered":"2023-10-14T12:19:44.374463+0000","last_clean":"2023-10-14T12:19:44.374463+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:44.374463+0000","last_undegraded":"2023-10-14T12:19:44.374463+0000","last_fullsized":"2023-10-14T12:19:44.374463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382727+0000","last_change":"2023-10-14T12:19:42.378619+0000","last_active":"2023-10-14T12:19:43.382727+0000","last_peered":"2023-10-14T12:19:43.382727+0000","last_clean":"2023-10-14T12:19:43.382727+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:19:43.382727+0000","last_undegraded":"2023-10-14T12:19:43.382727+0000","last_fullsized":"2023-10-14T12:19:43.382727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.391894+0000","last_change":"2023-10-14T12:19:43.389128+0000","last_active":"2023-10-14T12:19:43.391894+0000","last_peered":"2023-10-14T12:19:43.391894+0000","last_clean":"2023-10-14T12:19:43.391894+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:19:43.391894+0000","last_undegraded":"2023-10-14T12:19:43.391894+0000","last_fullsized":"2023-10-14T12:19:43.391894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.376079+0000","last_change":"2023-10-14T12:19:42.371259+0000","last_active":"2023-10-14T12:19:43.376079+0000","last_peered":"2023-10-14T12:19:43.376079+0000","last_clean":"2023-10-14T12:19:43.376079+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:19:43.376079+0000","last_undegraded":"2023-10-14T12:19:43.376079+0000","last_fullsized":"2023-10-14T12:19:43.376079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:34.980122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.391982+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:43.391982+0000","last_peered":"2023-10-14T12:19:43.391982+0000","last_clean":"2023-10-14T12:19:43.391982+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:43.391982+0000","last_undegraded":"2023-10-14T12:19:43.391982+0000","last_fullsized":"2023-10-14T12:19:43.391982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:18.859040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382227+0000","last_change":"2023-10-14T12:19:42.371970+0000","last_active":"2023-10-14T12:19:43.382227+0000","last_peered":"2023-10-14T12:19:43.382227+0000","last_clean":"2023-10-14T12:19:43.382227+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:43.382227+0000","last_undegraded":"2023-10-14T12:19:43.382227+0000","last_fullsized":"2023-10-14T12:19:43.382227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:17.853714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.391480+0000","last_change":"2023-10-14T12:19:43.388360+0000","last_active":"2023-10-14T12:19:43.391480+0000","last_peered":"2023-10-14T12:19:43.391480+0000","last_clean":"2023-10-14T12:19:43.391480+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:19:43.391480+0000","last_undegraded":"2023-10-14T12:19:43.391480+0000","last_fullsized":"2023-10-14T12:19:43.391480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.217413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.375620+0000","last_change":"2023-10-14T12:19:42.376964+0000","last_active":"2023-10-14T12:19:43.375620+0000","last_peered":"2023-10-14T12:19:43.375620+0000","last_clean":"2023-10-14T12:19:43.375620+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:43.375620+0000","last_undegraded":"2023-10-14T12:19:43.375620+0000","last_fullsized":"2023-10-14T12:19:43.375620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:34.064338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374083+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:44.374083+0000","last_peered":"2023-10-14T12:19:44.374083+0000","last_clean":"2023-10-14T12:19:44.374083+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:44.374083+0000","last_undegraded":"2023-10-14T12:19:44.374083+0000","last_fullsized":"2023-10-14T12:19:44.374083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.377874+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:43.377874+0000","last_peered":"2023-10-14T12:19:43.377874+0000","last_clean":"2023-10-14T12:19:43.377874+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:43.377874+0000","last_undegraded":"2023-10-14T12:19:43.377874+0000","last_fullsized":"2023-10-14T12:19:43.377874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:09.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.393730+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:43.393730+0000","last_peered":"2023-10-14T12:19:43.393730+0000","last_clean":"2023-10-14T12:19:43.393730+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:43.393730+0000","last_undegraded":"2023-10-14T12:19:43.393730+0000","last_fullsized":"2023-10-14T12:19:43.393730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373897+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:44.373897+0000","last_peered":"2023-10-14T12:19:44.373897+0000","last_clean":"2023-10-14T12:19:44.373897+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:44.373897+0000","last_undegraded":"2023-10-14T12:19:44.373897+0000","last_fullsized":"2023-10-14T12:19:44.373897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:51.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950724+0000","last_change":"2023-10-14T12:19:43.385662+0000","last_active":"2023-10-14T12:19:44.950724+0000","last_peered":"2023-10-14T12:19:44.950724+0000","last_clean":"2023-10-14T12:19:44.950724+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:19:44.950724+0000","last_undegraded":"2023-10-14T12:19:44.950724+0000","last_fullsized":"2023-10-14T12:19:44.950724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373120+0000","last_change":"2023-10-14T12:19:42.371684+0000","last_active":"2023-10-14T12:19:43.373120+0000","last_peered":"2023-10-14T12:19:43.373120+0000","last_clean":"2023-10-14T12:19:43.373120+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:43.373120+0000","last_undegraded":"2023-10-14T12:19:43.373120+0000","last_fullsized":"2023-10-14T12:19:43.373120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:56.045404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373248+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:19:43.373248+0000","last_peered":"2023-10-14T12:19:43.373248+0000","last_clean":"2023-10-14T12:19:43.373248+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:19:43.373248+0000","last_undegraded":"2023-10-14T12:19:43.373248+0000","last_fullsized":"2023-10-14T12:19:43.373248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.82999999999999996}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64100000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.37}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.42299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.505},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.31}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.379}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.629}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":722884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.312},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39900000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.376},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.37},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36099999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.70899999999999996}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":132620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.371},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.505}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:19:47.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:19:47.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.703+0000 7f1f7ba1e700 1 Processor -- start 2023-10-14T12:19:47.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.703+0000 7f1f7ba1e700 1 -- start start 2023-10-14T12:19:47.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f7ba1e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1f740cd950 0x7f1f7415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f7ba1e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1f740cede0 0x7f1f7415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f7ba1e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f740cf290 con 0x7f1f7406a840 2023-10-14T12:19:47.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f7ba1e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f741619a0 con 0x7f1f740cd950 2023-10-14T12:19:47.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f7ba1e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f740b2d60 con 0x7f1f740cede0 2023-10-14T12:19:47.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1f740cd950 0x7f1f7415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1f740cd950 0x7f1f7415e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39934/0 (socket says 172.21.15.32:39934) 2023-10-14T12:19:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 -- 172.21.15.32:0/1704342004 learned_addr learned my addr 172.21.15.32:0/1704342004 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 -- 172.21.15.32:0/1704342004 >> v2:172.21.15.92:3300/0 conn(0x7f1f740cede0 msgr2=0x7f1f7415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f78fb9700 1 --2- 172.21.15.32:0/1704342004 >> v2:172.21.15.92:3300/0 conn(0x7f1f740cede0 0x7f1f7415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 --2- 172.21.15.32:0/1704342004 >> v2:172.21.15.92:3300/0 conn(0x7f1f740cede0 0x7f1f7415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 -- 172.21.15.32:0/1704342004 >> v1:172.21.15.92:6789/0 conn(0x7f1f7406a840 legacy=0x7f1f74161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:47.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f797ba700 1 -- 172.21.15.32:0/1704342004 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740cdd30 con 0x7f1f740cd950 2023-10-14T12:19:47.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.704+0000 7f1f78fb9700 1 --2- 172.21.15.32:0/1704342004 >> v2:172.21.15.92:3300/0 conn(0x7f1f740cede0 0x7f1f7415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:47.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f797ba700 1 --2- 172.21.15.32:0/1704342004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f7415e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1f74161ae0 tx=0x7f1f70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e4d4f703234eda server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:47.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f6bfff700 1 -- 172.21.15.32:0/1704342004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011830 con 0x7f1f740cd950 2023-10-14T12:19:47.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f6bfff700 1 -- 172.21.15.32:0/1704342004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70011990 con 0x7f1f740cd950 2023-10-14T12:19:47.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f6bfff700 1 -- 172.21.15.32:0/1704342004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011d20 con 0x7f1f740cd950 2023-10-14T12:19:47.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1704342004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 msgr2=0x7f1f7415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1704342004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f7415e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1f74161ae0 tx=0x7f1f70009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1704342004 shutdown_connections 2023-10-14T12:19:47.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1704342004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f7415e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1704342004 >> v2:172.21.15.92:3300/0 conn(0x7f1f740cede0 0x7f1f7415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1704342004 >> 172.21.15.32:0/1704342004 conn(0x7f1f7406dae0 msgr2=0x7f1f7406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1704342004 shutdown_connections 2023-10-14T12:19:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.705+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1704342004 wait complete. 2023-10-14T12:19:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.706+0000 7f1f7ba1e700 1 Processor -- start 2023-10-14T12:19:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 -- start start 2023-10-14T12:19:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f7406a840 0x7f1f741f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f741f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f740cede0 0x7f1f741f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740aeb10 con 0x7f1f740cd950 2023-10-14T12:19:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740aedf0 con 0x7f1f740cede0 2023-10-14T12:19:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f7ba1e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740af0d0 con 0x7f1f7406a840 2023-10-14T12:19:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f78fb9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f741f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f78fb9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f741f6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39942/0 (socket says 172.21.15.32:39942) 2023-10-14T12:19:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.707+0000 7f1f78fb9700 1 -- 172.21.15.32:0/1613383136 learned_addr learned my addr 172.21.15.32:0/1613383136 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f79fbb700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f740cede0 0x7f1f741f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f797ba700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f7406a840 0x7f1f741f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f78fb9700 1 -- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f7406a840 msgr2=0x7f1f741f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f78fb9700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f7406a840 0x7f1f741f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f78fb9700 1 -- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f740cede0 msgr2=0x7f1f741f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f78fb9700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f740cede0 0x7f1f741f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f78fb9700 1 -- 172.21.15.32:0/1613383136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70009550 con 0x7f1f740cd950 2023-10-14T12:19:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f79fbb700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f740cede0 0x7f1f741f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f78fb9700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f741f6b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400c7f0 tx=0x7f1f6400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64005c20 con 0x7f1f740cd950 2023-10-14T12:19:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64005d80 con 0x7f1f740cd950 2023-10-14T12:19:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64011820 con 0x7f1f740cd950 2023-10-14T12:19:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f740ac950 con 0x7f1f740cd950 2023-10-14T12:19:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.708+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f740ae3a0 con 0x7f1f740cd950 2023-10-14T12:19:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.709+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f74067d20 con 0x7f1f740cd950 2023-10-14T12:19:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.709+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1f64011980 con 0x7f1f740cd950 2023-10-14T12:19:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.710+0000 7f1f69ffb700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1f5806af00 0x7f1f5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:47.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.710+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1f64089410 con 0x7f1f740cd950 2023-10-14T12:19:47.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.710+0000 7f1f797ba700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1f5806af00 0x7f1f5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:47.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.711+0000 7f1f797ba700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1f5806af00 0x7f1f5806d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009fd0 tx=0x7f1f70008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:47.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.715+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f640544a0 con 0x7f1f740cd950 2023-10-14T12:19:47.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.911+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f740aef60 con 0x7f1f5806af00 2023-10-14T12:19:47.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.921+0000 7f1f69ffb700 1 -- 172.21.15.32:0/1613383136 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288859 (secure 0 0 0) 0x7f1f740aef60 con 0x7f1f5806af00 2023-10-14T12:19:47.925 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:47.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1f5806af00 msgr2=0x7f1f5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1f5806af00 0x7f1f5806d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009fd0 tx=0x7f1f70008030 comp rx=0 tx=0).stop 2023-10-14T12:19:47.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 msgr2=0x7f1f741f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:47.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f741f6b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400c7f0 tx=0x7f1f6400cbb0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 shutdown_connections 2023-10-14T12:19:47.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1f5806af00 0x7f1f5806d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f740cede0 0x7f1f741f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f7406a840 0x7f1f741f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 --2- 172.21.15.32:0/1613383136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f740cd950 0x7f1f741f6b20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 >> 172.21.15.32:0/1613383136 conn(0x7f1f7406dae0 msgr2=0x7f1f740ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 shutdown_connections 2023-10-14T12:19:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:47.923+0000 7f1f7ba1e700 1 -- 172.21.15.32:0/1613383136 wait complete. 2023-10-14T12:19:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:19:47.937 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-14T12:19:47.110867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224348,"kb_used_data":3992,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750372,"statfs":{"total":773094113280,"available":772864380928,"internally_reserved":0,"allocated":4087808,"data_stored":2270984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.758010"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392500+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:43.392500+0000","last_peered":"2023-10-14T12:19:43.392500+0000","last_clean":"2023-10-14T12:19:43.392500+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:43.392500+0000","last_undegraded":"2023-10-14T12:19:43.392500+0000","last_fullsized":"2023-10-14T12:19:43.392500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.217413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374519+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:44.374519+0000","last_peered":"2023-10-14T12:19:44.374519+0000","last_clean":"2023-10-14T12:19:44.374519+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:44.374519+0000","last_undegraded":"2023-10-14T12:19:44.374519+0000","last_fullsized":"2023-10-14T12:19:44.374519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374280+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:44.374280+0000","last_peered":"2023-10-14T12:19:44.374280+0000","last_clean":"2023-10-14T12:19:44.374280+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:44.374280+0000","last_undegraded":"2023-10-14T12:19:44.374280+0000","last_fullsized":"2023-10-14T12:19:44.374280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395422+0000","last_change":"2023-10-14T12:19:43.390887+0000","last_active":"2023-10-14T12:19:43.395422+0000","last_peered":"2023-10-14T12:19:43.395422+0000","last_clean":"2023-10-14T12:19:43.395422+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:19:43.395422+0000","last_undegraded":"2023-10-14T12:19:43.395422+0000","last_fullsized":"2023-10-14T12:19:43.395422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:06.970537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370444+0000","last_change":"2023-10-14T12:19:43.379488+0000","last_active":"2023-10-14T12:19:44.370444+0000","last_peered":"2023-10-14T12:19:44.370444+0000","last_clean":"2023-10-14T12:19:44.370444+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:19:44.370444+0000","last_undegraded":"2023-10-14T12:19:44.370444+0000","last_fullsized":"2023-10-14T12:19:44.370444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374228+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:44.374228+0000","last_peered":"2023-10-14T12:19:44.374228+0000","last_clean":"2023-10-14T12:19:44.374228+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:44.374228+0000","last_undegraded":"2023-10-14T12:19:44.374228+0000","last_fullsized":"2023-10-14T12:19:44.374228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950553+0000","last_change":"2023-10-14T12:19:43.381841+0000","last_active":"2023-10-14T12:19:44.950553+0000","last_peered":"2023-10-14T12:19:44.950553+0000","last_clean":"2023-10-14T12:19:44.950553+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:19:44.950553+0000","last_undegraded":"2023-10-14T12:19:44.950553+0000","last_fullsized":"2023-10-14T12:19:44.950553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950418+0000","last_change":"2023-10-14T12:19:43.382639+0000","last_active":"2023-10-14T12:19:44.950418+0000","last_peered":"2023-10-14T12:19:44.950418+0000","last_clean":"2023-10-14T12:19:44.950418+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:19:44.950418+0000","last_undegraded":"2023-10-14T12:19:44.950418+0000","last_fullsized":"2023-10-14T12:19:44.950418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392163+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:43.392163+0000","last_peered":"2023-10-14T12:19:43.392163+0000","last_clean":"2023-10-14T12:19:43.392163+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:43.392163+0000","last_undegraded":"2023-10-14T12:19:43.392163+0000","last_fullsized":"2023-10-14T12:19:43.392163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:18.859040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.387803+0000","last_change":"2023-10-14T12:19:43.382683+0000","last_active":"2023-10-14T12:19:43.387803+0000","last_peered":"2023-10-14T12:19:43.387803+0000","last_clean":"2023-10-14T12:19:43.387803+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:19:43.387803+0000","last_undegraded":"2023-10-14T12:19:43.387803+0000","last_fullsized":"2023-10-14T12:19:43.387803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:18.859040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950759+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:44.950759+0000","last_peered":"2023-10-14T12:19:44.950759+0000","last_clean":"2023-10-14T12:19:44.950759+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:44.950759+0000","last_undegraded":"2023-10-14T12:19:44.950759+0000","last_fullsized":"2023-10-14T12:19:44.950759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374556+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:44.374556+0000","last_peered":"2023-10-14T12:19:44.374556+0000","last_clean":"2023-10-14T12:19:44.374556+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:44.374556+0000","last_undegraded":"2023-10-14T12:19:44.374556+0000","last_fullsized":"2023-10-14T12:19:44.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370587+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:44.370587+0000","last_peered":"2023-10-14T12:19:44.370587+0000","last_clean":"2023-10-14T12:19:44.370587+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:44.370587+0000","last_undegraded":"2023-10-14T12:19:44.370587+0000","last_fullsized":"2023-10-14T12:19:44.370587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374251+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:44.374251+0000","last_peered":"2023-10-14T12:19:44.374251+0000","last_clean":"2023-10-14T12:19:44.374251+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:44.374251+0000","last_undegraded":"2023-10-14T12:19:44.374251+0000","last_fullsized":"2023-10-14T12:19:44.374251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374071+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:44.374071+0000","last_peered":"2023-10-14T12:19:44.374071+0000","last_clean":"2023-10-14T12:19:44.374071+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:44.374071+0000","last_undegraded":"2023-10-14T12:19:44.374071+0000","last_fullsized":"2023-10-14T12:19:44.374071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950717+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:44.950717+0000","last_peered":"2023-10-14T12:19:44.950717+0000","last_clean":"2023-10-14T12:19:44.950717+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:44.950717+0000","last_undegraded":"2023-10-14T12:19:44.950717+0000","last_fullsized":"2023-10-14T12:19:44.950717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.951014+0000","last_change":"2023-10-14T12:19:43.381288+0000","last_active":"2023-10-14T12:19:44.951014+0000","last_peered":"2023-10-14T12:19:44.951014+0000","last_clean":"2023-10-14T12:19:44.951014+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:19:44.951014+0000","last_undegraded":"2023-10-14T12:19:44.951014+0000","last_fullsized":"2023-10-14T12:19:44.951014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374498+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:44.374498+0000","last_peered":"2023-10-14T12:19:44.374498+0000","last_clean":"2023-10-14T12:19:44.374498+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:44.374498+0000","last_undegraded":"2023-10-14T12:19:44.374498+0000","last_fullsized":"2023-10-14T12:19:44.374498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374414+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:44.374414+0000","last_peered":"2023-10-14T12:19:44.374414+0000","last_clean":"2023-10-14T12:19:44.374414+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:44.374414+0000","last_undegraded":"2023-10-14T12:19:44.374414+0000","last_fullsized":"2023-10-14T12:19:44.374414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370717+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:44.370717+0000","last_peered":"2023-10-14T12:19:44.370717+0000","last_clean":"2023-10-14T12:19:44.370717+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:44.370717+0000","last_undegraded":"2023-10-14T12:19:44.370717+0000","last_fullsized":"2023-10-14T12:19:44.370717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.393744+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:43.393744+0000","last_peered":"2023-10-14T12:19:43.393744+0000","last_clean":"2023-10-14T12:19:43.393744+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:43.393744+0000","last_undegraded":"2023-10-14T12:19:43.393744+0000","last_fullsized":"2023-10-14T12:19:43.393744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:06.970537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388328+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:43.388328+0000","last_peered":"2023-10-14T12:19:43.388328+0000","last_clean":"2023-10-14T12:19:43.388328+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:43.388328+0000","last_undegraded":"2023-10-14T12:19:43.388328+0000","last_fullsized":"2023-10-14T12:19:43.388328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388225+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:43.388225+0000","last_peered":"2023-10-14T12:19:43.388225+0000","last_clean":"2023-10-14T12:19:43.388225+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:19:43.388225+0000","last_undegraded":"2023-10-14T12:19:43.388225+0000","last_fullsized":"2023-10-14T12:19:43.388225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374009+0000","last_change":"2023-10-14T12:19:43.381941+0000","last_active":"2023-10-14T12:19:44.374009+0000","last_peered":"2023-10-14T12:19:44.374009+0000","last_clean":"2023-10-14T12:19:44.374009+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:19:44.374009+0000","last_undegraded":"2023-10-14T12:19:44.374009+0000","last_fullsized":"2023-10-14T12:19:44.374009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.387536+0000","last_change":"2023-10-14T12:19:43.382954+0000","last_active":"2023-10-14T12:19:43.387536+0000","last_peered":"2023-10-14T12:19:43.387536+0000","last_clean":"2023-10-14T12:19:43.387536+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:19:43.387536+0000","last_undegraded":"2023-10-14T12:19:43.387536+0000","last_fullsized":"2023-10-14T12:19:43.387536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:49.809505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374673+0000","last_change":"2023-10-14T12:19:43.380761+0000","last_active":"2023-10-14T12:19:44.374673+0000","last_peered":"2023-10-14T12:19:44.374673+0000","last_clean":"2023-10-14T12:19:44.374673+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:44.374673+0000","last_undegraded":"2023-10-14T12:19:44.374673+0000","last_fullsized":"2023-10-14T12:19:44.374673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:17.111399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395587+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:43.395587+0000","last_peered":"2023-10-14T12:19:43.395587+0000","last_clean":"2023-10-14T12:19:43.395587+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:43.395587+0000","last_undegraded":"2023-10-14T12:19:43.395587+0000","last_fullsized":"2023-10-14T12:19:43.395587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:25.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374585+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:44.374585+0000","last_peered":"2023-10-14T12:19:44.374585+0000","last_clean":"2023-10-14T12:19:44.374585+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:44.374585+0000","last_undegraded":"2023-10-14T12:19:44.374585+0000","last_fullsized":"2023-10-14T12:19:44.374585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392376+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:43.392376+0000","last_peered":"2023-10-14T12:19:43.392376+0000","last_clean":"2023-10-14T12:19:43.392376+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:43.392376+0000","last_undegraded":"2023-10-14T12:19:43.392376+0000","last_fullsized":"2023-10-14T12:19:43.392376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950548+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:44.950548+0000","last_peered":"2023-10-14T12:19:44.950548+0000","last_clean":"2023-10-14T12:19:44.950548+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:44.950548+0000","last_undegraded":"2023-10-14T12:19:44.950548+0000","last_fullsized":"2023-10-14T12:19:44.950548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382483+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:43.382483+0000","last_peered":"2023-10-14T12:19:43.382483+0000","last_clean":"2023-10-14T12:19:43.382483+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:43.382483+0000","last_undegraded":"2023-10-14T12:19:43.382483+0000","last_fullsized":"2023-10-14T12:19:43.382483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950873+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:44.950873+0000","last_peered":"2023-10-14T12:19:44.950873+0000","last_clean":"2023-10-14T12:19:44.950873+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:44.950873+0000","last_undegraded":"2023-10-14T12:19:44.950873+0000","last_fullsized":"2023-10-14T12:19:44.950873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395284+0000","last_change":"2023-10-14T12:19:43.393781+0000","last_active":"2023-10-14T12:19:43.395284+0000","last_peered":"2023-10-14T12:19:43.395284+0000","last_clean":"2023-10-14T12:19:43.395284+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:19:43.395284+0000","last_undegraded":"2023-10-14T12:19:43.395284+0000","last_fullsized":"2023-10-14T12:19:43.395284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:15.685211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403974+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:43.403974+0000","last_peered":"2023-10-14T12:19:43.403974+0000","last_clean":"2023-10-14T12:19:43.403974+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:43.403974+0000","last_undegraded":"2023-10-14T12:19:43.403974+0000","last_fullsized":"2023-10-14T12:19:43.403974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:14.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392518+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:43.392518+0000","last_peered":"2023-10-14T12:19:43.392518+0000","last_clean":"2023-10-14T12:19:43.392518+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:43.392518+0000","last_undegraded":"2023-10-14T12:19:43.392518+0000","last_fullsized":"2023-10-14T12:19:43.392518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.401828+0000","last_change":"2023-10-14T12:19:42.374484+0000","last_active":"2023-10-14T12:19:43.401828+0000","last_peered":"2023-10-14T12:19:43.401828+0000","last_clean":"2023-10-14T12:19:43.401828+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:19:43.401828+0000","last_undegraded":"2023-10-14T12:19:43.401828+0000","last_fullsized":"2023-10-14T12:19:43.401828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.393032+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:43.393032+0000","last_peered":"2023-10-14T12:19:43.393032+0000","last_clean":"2023-10-14T12:19:43.393032+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:43.393032+0000","last_undegraded":"2023-10-14T12:19:43.393032+0000","last_fullsized":"2023-10-14T12:19:43.393032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374493+0000","last_change":"2023-10-14T12:19:42.374263+0000","last_active":"2023-10-14T12:19:44.374493+0000","last_peered":"2023-10-14T12:19:44.374493+0000","last_clean":"2023-10-14T12:19:44.374493+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:19:44.374493+0000","last_undegraded":"2023-10-14T12:19:44.374493+0000","last_fullsized":"2023-10-14T12:19:44.374493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:59.390912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.395614+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:43.395614+0000","last_peered":"2023-10-14T12:19:43.395614+0000","last_clean":"2023-10-14T12:19:43.395614+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:43.395614+0000","last_undegraded":"2023-10-14T12:19:43.395614+0000","last_fullsized":"2023-10-14T12:19:43.395614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:27.468407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370652+0000","last_change":"2023-10-14T12:19:42.377643+0000","last_active":"2023-10-14T12:19:44.370652+0000","last_peered":"2023-10-14T12:19:44.370652+0000","last_clean":"2023-10-14T12:19:44.370652+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:44.370652+0000","last_undegraded":"2023-10-14T12:19:44.370652+0000","last_fullsized":"2023-10-14T12:19:44.370652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:00.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950565+0000","last_change":"2023-10-14T12:19:43.389426+0000","last_active":"2023-10-14T12:19:44.950565+0000","last_peered":"2023-10-14T12:19:44.950565+0000","last_clean":"2023-10-14T12:19:44.950565+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:19:44.950565+0000","last_undegraded":"2023-10-14T12:19:44.950565+0000","last_fullsized":"2023-10-14T12:19:44.950565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.405197+0000","last_change":"2023-10-14T12:19:42.375646+0000","last_active":"2023-10-14T12:19:43.405197+0000","last_peered":"2023-10-14T12:19:43.405197+0000","last_clean":"2023-10-14T12:19:43.405197+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:19:43.405197+0000","last_undegraded":"2023-10-14T12:19:43.405197+0000","last_fullsized":"2023-10-14T12:19:43.405197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374300+0000","last_change":"2023-10-14T12:19:43.390502+0000","last_active":"2023-10-14T12:19:44.374300+0000","last_peered":"2023-10-14T12:19:44.374300+0000","last_clean":"2023-10-14T12:19:44.374300+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:19:44.374300+0000","last_undegraded":"2023-10-14T12:19:44.374300+0000","last_fullsized":"2023-10-14T12:19:44.374300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.405160+0000","last_change":"2023-10-14T12:19:42.375014+0000","last_active":"2023-10-14T12:19:43.405160+0000","last_peered":"2023-10-14T12:19:43.405160+0000","last_clean":"2023-10-14T12:19:43.405160+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:19:43.405160+0000","last_undegraded":"2023-10-14T12:19:43.405160+0000","last_fullsized":"2023-10-14T12:19:43.405160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:36.593916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388087+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:43.388087+0000","last_peered":"2023-10-14T12:19:43.388087+0000","last_clean":"2023-10-14T12:19:43.388087+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:43.388087+0000","last_undegraded":"2023-10-14T12:19:43.388087+0000","last_fullsized":"2023-10-14T12:19:43.388087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:01.052281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373966+0000","last_change":"2023-10-14T12:19:42.373819+0000","last_active":"2023-10-14T12:19:44.373966+0000","last_peered":"2023-10-14T12:19:44.373966+0000","last_clean":"2023-10-14T12:19:44.373966+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:19:44.373966+0000","last_undegraded":"2023-10-14T12:19:44.373966+0000","last_fullsized":"2023-10-14T12:19:44.373966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.388976+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:43.388976+0000","last_peered":"2023-10-14T12:19:43.388976+0000","last_clean":"2023-10-14T12:19:43.388976+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:43.388976+0000","last_undegraded":"2023-10-14T12:19:43.388976+0000","last_fullsized":"2023-10-14T12:19:43.388976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:31.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373952+0000","last_change":"2023-10-14T12:19:42.372089+0000","last_active":"2023-10-14T12:19:43.373952+0000","last_peered":"2023-10-14T12:19:43.373952+0000","last_clean":"2023-10-14T12:19:43.373952+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:19:43.373952+0000","last_undegraded":"2023-10-14T12:19:43.373952+0000","last_fullsized":"2023-10-14T12:19:43.373952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:22.438051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374586+0000","last_change":"2023-10-14T12:19:43.382324+0000","last_active":"2023-10-14T12:19:44.374586+0000","last_peered":"2023-10-14T12:19:44.374586+0000","last_clean":"2023-10-14T12:19:44.374586+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:19:44.374586+0000","last_undegraded":"2023-10-14T12:19:44.374586+0000","last_fullsized":"2023-10-14T12:19:44.374586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374708+0000","last_change":"2023-10-14T12:19:42.372382+0000","last_active":"2023-10-14T12:19:44.374708+0000","last_peered":"2023-10-14T12:19:44.374708+0000","last_clean":"2023-10-14T12:19:44.374708+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:19:44.374708+0000","last_undegraded":"2023-10-14T12:19:44.374708+0000","last_fullsized":"2023-10-14T12:19:44.374708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374844+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:44.374844+0000","last_peered":"2023-10-14T12:19:44.374844+0000","last_clean":"2023-10-14T12:19:44.374844+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:44.374844+0000","last_undegraded":"2023-10-14T12:19:44.374844+0000","last_fullsized":"2023-10-14T12:19:44.374844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:47:38.320770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382584+0000","last_change":"2023-10-14T12:19:42.376458+0000","last_active":"2023-10-14T12:19:43.382584+0000","last_peered":"2023-10-14T12:19:43.382584+0000","last_clean":"2023-10-14T12:19:43.382584+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:19:43.382584+0000","last_undegraded":"2023-10-14T12:19:43.382584+0000","last_fullsized":"2023-10-14T12:19:43.382584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374529+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:44.374529+0000","last_peered":"2023-10-14T12:19:44.374529+0000","last_clean":"2023-10-14T12:19:44.374529+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:44.374529+0000","last_undegraded":"2023-10-14T12:19:44.374529+0000","last_fullsized":"2023-10-14T12:19:44.374529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374572+0000","last_change":"2023-10-14T12:19:42.373797+0000","last_active":"2023-10-14T12:19:44.374572+0000","last_peered":"2023-10-14T12:19:44.374572+0000","last_clean":"2023-10-14T12:19:44.374572+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:19:44.374572+0000","last_undegraded":"2023-10-14T12:19:44.374572+0000","last_fullsized":"2023-10-14T12:19:44.374572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:21.195047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374459+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:44.374459+0000","last_peered":"2023-10-14T12:19:44.374459+0000","last_clean":"2023-10-14T12:19:44.374459+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:44.374459+0000","last_undegraded":"2023-10-14T12:19:44.374459+0000","last_fullsized":"2023-10-14T12:19:44.374459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374488+0000","last_change":"2023-10-14T12:19:42.371158+0000","last_active":"2023-10-14T12:19:44.374488+0000","last_peered":"2023-10-14T12:19:44.374488+0000","last_clean":"2023-10-14T12:19:44.374488+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:19:44.374488+0000","last_undegraded":"2023-10-14T12:19:44.374488+0000","last_fullsized":"2023-10-14T12:19:44.374488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:24.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.386526+0000","last_change":"2023-10-14T12:19:43.380181+0000","last_active":"2023-10-14T12:19:43.386526+0000","last_peered":"2023-10-14T12:19:43.386526+0000","last_clean":"2023-10-14T12:19:43.386526+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:19:43.386526+0000","last_undegraded":"2023-10-14T12:19:43.386526+0000","last_fullsized":"2023-10-14T12:19:43.386526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.217413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.402538+0000","last_change":"2023-10-14T12:19:42.373775+0000","last_active":"2023-10-14T12:19:43.402538+0000","last_peered":"2023-10-14T12:19:43.402538+0000","last_clean":"2023-10-14T12:19:43.402538+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:19:43.402538+0000","last_undegraded":"2023-10-14T12:19:43.402538+0000","last_fullsized":"2023-10-14T12:19:43.402538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374439+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:44.374439+0000","last_peered":"2023-10-14T12:19:44.374439+0000","last_clean":"2023-10-14T12:19:44.374439+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:44.374439+0000","last_undegraded":"2023-10-14T12:19:44.374439+0000","last_fullsized":"2023-10-14T12:19:44.374439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.375458+0000","last_change":"2023-10-14T12:19:42.373838+0000","last_active":"2023-10-14T12:19:43.375458+0000","last_peered":"2023-10-14T12:19:43.375458+0000","last_clean":"2023-10-14T12:19:43.375458+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:19:43.375458+0000","last_undegraded":"2023-10-14T12:19:43.375458+0000","last_fullsized":"2023-10-14T12:19:43.375458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950851+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:44.950851+0000","last_peered":"2023-10-14T12:19:44.950851+0000","last_clean":"2023-10-14T12:19:44.950851+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:44.950851+0000","last_undegraded":"2023-10-14T12:19:44.950851+0000","last_fullsized":"2023-10-14T12:19:44.950851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374044+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:44.374044+0000","last_peered":"2023-10-14T12:19:44.374044+0000","last_clean":"2023-10-14T12:19:44.374044+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:44.374044+0000","last_undegraded":"2023-10-14T12:19:44.374044+0000","last_fullsized":"2023-10-14T12:19:44.374044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.396385+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:43.396385+0000","last_peered":"2023-10-14T12:19:43.396385+0000","last_clean":"2023-10-14T12:19:43.396385+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:43.396385+0000","last_undegraded":"2023-10-14T12:19:43.396385+0000","last_fullsized":"2023-10-14T12:19:43.396385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:49.809505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374022+0000","last_change":"2023-10-14T12:19:42.373204+0000","last_active":"2023-10-14T12:19:44.374022+0000","last_peered":"2023-10-14T12:19:44.374022+0000","last_clean":"2023-10-14T12:19:44.374022+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:19:44.374022+0000","last_undegraded":"2023-10-14T12:19:44.374022+0000","last_fullsized":"2023-10-14T12:19:44.374022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:40.688686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.392056+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:43.392056+0000","last_peered":"2023-10-14T12:19:43.392056+0000","last_clean":"2023-10-14T12:19:43.392056+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:43.392056+0000","last_undegraded":"2023-10-14T12:19:43.392056+0000","last_fullsized":"2023-10-14T12:19:43.392056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:15.685211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403326+0000","last_change":"2023-10-14T12:19:42.376646+0000","last_active":"2023-10-14T12:19:43.403326+0000","last_peered":"2023-10-14T12:19:43.403326+0000","last_clean":"2023-10-14T12:19:43.403326+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:19:43.403326+0000","last_undegraded":"2023-10-14T12:19:43.403326+0000","last_fullsized":"2023-10-14T12:19:43.403326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:37.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374521+0000","last_change":"2023-10-14T12:19:43.388112+0000","last_active":"2023-10-14T12:19:44.374521+0000","last_peered":"2023-10-14T12:19:44.374521+0000","last_clean":"2023-10-14T12:19:44.374521+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:19:44.374521+0000","last_undegraded":"2023-10-14T12:19:44.374521+0000","last_fullsized":"2023-10-14T12:19:44.374521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.402624+0000","last_change":"2023-10-14T12:19:42.373858+0000","last_active":"2023-10-14T12:19:43.402624+0000","last_peered":"2023-10-14T12:19:43.402624+0000","last_clean":"2023-10-14T12:19:43.402624+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:19:43.402624+0000","last_undegraded":"2023-10-14T12:19:43.402624+0000","last_fullsized":"2023-10-14T12:19:43.402624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.389999+0000","last_change":"2023-10-14T12:19:43.388334+0000","last_active":"2023-10-14T12:19:43.389999+0000","last_peered":"2023-10-14T12:19:43.389999+0000","last_clean":"2023-10-14T12:19:43.389999+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:19:43.389999+0000","last_undegraded":"2023-10-14T12:19:43.389999+0000","last_fullsized":"2023-10-14T12:19:43.389999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:15.685211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403153+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:43.403153+0000","last_peered":"2023-10-14T12:19:43.403153+0000","last_clean":"2023-10-14T12:19:43.403153+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:43.403153+0000","last_undegraded":"2023-10-14T12:19:43.403153+0000","last_fullsized":"2023-10-14T12:19:43.403153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:12.099355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370543+0000","last_change":"2023-10-14T12:19:43.384205+0000","last_active":"2023-10-14T12:19:44.370543+0000","last_peered":"2023-10-14T12:19:44.370543+0000","last_clean":"2023-10-14T12:19:44.370543+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:19:44.370543+0000","last_undegraded":"2023-10-14T12:19:44.370543+0000","last_fullsized":"2023-10-14T12:19:44.370543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:37.599241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.377385+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:43.377385+0000","last_peered":"2023-10-14T12:19:43.377385+0000","last_clean":"2023-10-14T12:19:43.377385+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:43.377385+0000","last_undegraded":"2023-10-14T12:19:43.377385+0000","last_fullsized":"2023-10-14T12:19:43.377385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:19.606346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370619+0000","last_change":"2023-10-14T12:19:43.388769+0000","last_active":"2023-10-14T12:19:44.370619+0000","last_peered":"2023-10-14T12:19:44.370619+0000","last_clean":"2023-10-14T12:19:44.370619+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:19:44.370619+0000","last_undegraded":"2023-10-14T12:19:44.370619+0000","last_fullsized":"2023-10-14T12:19:44.370619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.402714+0000","last_change":"2023-10-14T12:19:42.378784+0000","last_active":"2023-10-14T12:19:43.402714+0000","last_peered":"2023-10-14T12:19:43.402714+0000","last_clean":"2023-10-14T12:19:43.402714+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:43.402714+0000","last_undegraded":"2023-10-14T12:19:43.402714+0000","last_fullsized":"2023-10-14T12:19:43.402714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370513+0000","last_change":"2023-10-14T12:19:43.390194+0000","last_active":"2023-10-14T12:19:44.370513+0000","last_peered":"2023-10-14T12:19:44.370513+0000","last_clean":"2023-10-14T12:19:44.370513+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:19:44.370513+0000","last_undegraded":"2023-10-14T12:19:44.370513+0000","last_fullsized":"2023-10-14T12:19:44.370513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:13.104681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.375610+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:43.375610+0000","last_peered":"2023-10-14T12:19:43.375610+0000","last_clean":"2023-10-14T12:19:43.375610+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:43.375610+0000","last_undegraded":"2023-10-14T12:19:43.375610+0000","last_fullsized":"2023-10-14T12:19:43.375610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370406+0000","last_change":"2023-10-14T12:19:43.382787+0000","last_active":"2023-10-14T12:19:44.370406+0000","last_peered":"2023-10-14T12:19:44.370406+0000","last_clean":"2023-10-14T12:19:44.370406+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:19:44.370406+0000","last_undegraded":"2023-10-14T12:19:44.370406+0000","last_fullsized":"2023-10-14T12:19:44.370406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.377721+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:43.377721+0000","last_peered":"2023-10-14T12:19:43.377721+0000","last_clean":"2023-10-14T12:19:43.377721+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:43.377721+0000","last_undegraded":"2023-10-14T12:19:43.377721+0000","last_fullsized":"2023-10-14T12:19:43.377721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:17.650999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950643+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:44.950643+0000","last_peered":"2023-10-14T12:19:44.950643+0000","last_clean":"2023-10-14T12:19:44.950643+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:44.950643+0000","last_undegraded":"2023-10-14T12:19:44.950643+0000","last_fullsized":"2023-10-14T12:19:44.950643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373934+0000","last_change":"2023-10-14T12:19:42.377594+0000","last_active":"2023-10-14T12:19:44.373934+0000","last_peered":"2023-10-14T12:19:44.373934+0000","last_clean":"2023-10-14T12:19:44.373934+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:44.373934+0000","last_undegraded":"2023-10-14T12:19:44.373934+0000","last_fullsized":"2023-10-14T12:19:44.373934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370575+0000","last_change":"2023-10-14T12:19:43.388662+0000","last_active":"2023-10-14T12:19:44.370575+0000","last_peered":"2023-10-14T12:19:44.370575+0000","last_clean":"2023-10-14T12:19:44.370575+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:19:44.370575+0000","last_undegraded":"2023-10-14T12:19:44.370575+0000","last_fullsized":"2023-10-14T12:19:44.370575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:20.611672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.403001+0000","last_change":"2023-10-14T12:19:42.377243+0000","last_active":"2023-10-14T12:19:43.403001+0000","last_peered":"2023-10-14T12:19:43.403001+0000","last_clean":"2023-10-14T12:19:43.403001+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:19:43.403001+0000","last_undegraded":"2023-10-14T12:19:43.403001+0000","last_fullsized":"2023-10-14T12:19:43.403001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:55.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374463+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:44.374463+0000","last_peered":"2023-10-14T12:19:44.374463+0000","last_clean":"2023-10-14T12:19:44.374463+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:44.374463+0000","last_undegraded":"2023-10-14T12:19:44.374463+0000","last_fullsized":"2023-10-14T12:19:44.374463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382727+0000","last_change":"2023-10-14T12:19:42.378619+0000","last_active":"2023-10-14T12:19:43.382727+0000","last_peered":"2023-10-14T12:19:43.382727+0000","last_clean":"2023-10-14T12:19:43.382727+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:19:43.382727+0000","last_undegraded":"2023-10-14T12:19:43.382727+0000","last_fullsized":"2023-10-14T12:19:43.382727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.391894+0000","last_change":"2023-10-14T12:19:43.389128+0000","last_active":"2023-10-14T12:19:43.391894+0000","last_peered":"2023-10-14T12:19:43.391894+0000","last_clean":"2023-10-14T12:19:43.391894+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:19:43.391894+0000","last_undegraded":"2023-10-14T12:19:43.391894+0000","last_fullsized":"2023-10-14T12:19:43.391894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.376079+0000","last_change":"2023-10-14T12:19:42.371259+0000","last_active":"2023-10-14T12:19:43.376079+0000","last_peered":"2023-10-14T12:19:43.376079+0000","last_clean":"2023-10-14T12:19:43.376079+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:19:43.376079+0000","last_undegraded":"2023-10-14T12:19:43.376079+0000","last_fullsized":"2023-10-14T12:19:43.376079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:34.980122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.391982+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:43.391982+0000","last_peered":"2023-10-14T12:19:43.391982+0000","last_clean":"2023-10-14T12:19:43.391982+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:43.391982+0000","last_undegraded":"2023-10-14T12:19:43.391982+0000","last_fullsized":"2023-10-14T12:19:43.391982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:18.859040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.382227+0000","last_change":"2023-10-14T12:19:42.371970+0000","last_active":"2023-10-14T12:19:43.382227+0000","last_peered":"2023-10-14T12:19:43.382227+0000","last_clean":"2023-10-14T12:19:43.382227+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:43.382227+0000","last_undegraded":"2023-10-14T12:19:43.382227+0000","last_fullsized":"2023-10-14T12:19:43.382227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:17.853714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.391480+0000","last_change":"2023-10-14T12:19:43.388360+0000","last_active":"2023-10-14T12:19:43.391480+0000","last_peered":"2023-10-14T12:19:43.391480+0000","last_clean":"2023-10-14T12:19:43.391480+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:19:43.391480+0000","last_undegraded":"2023-10-14T12:19:43.391480+0000","last_fullsized":"2023-10-14T12:19:43.391480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:10.217413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.375620+0000","last_change":"2023-10-14T12:19:42.376964+0000","last_active":"2023-10-14T12:19:43.375620+0000","last_peered":"2023-10-14T12:19:43.375620+0000","last_clean":"2023-10-14T12:19:43.375620+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:43.375620+0000","last_undegraded":"2023-10-14T12:19:43.375620+0000","last_fullsized":"2023-10-14T12:19:43.375620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:34.064338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374083+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:44.374083+0000","last_peered":"2023-10-14T12:19:44.374083+0000","last_clean":"2023-10-14T12:19:44.374083+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:44.374083+0000","last_undegraded":"2023-10-14T12:19:44.374083+0000","last_fullsized":"2023-10-14T12:19:44.374083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.377874+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:43.377874+0000","last_peered":"2023-10-14T12:19:43.377874+0000","last_clean":"2023-10-14T12:19:43.377874+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:43.377874+0000","last_undegraded":"2023-10-14T12:19:43.377874+0000","last_fullsized":"2023-10-14T12:19:43.377874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:09.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.393730+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:43.393730+0000","last_peered":"2023-10-14T12:19:43.393730+0000","last_clean":"2023-10-14T12:19:43.393730+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:43.393730+0000","last_undegraded":"2023-10-14T12:19:43.393730+0000","last_fullsized":"2023-10-14T12:19:43.393730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373897+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:44.373897+0000","last_peered":"2023-10-14T12:19:44.373897+0000","last_clean":"2023-10-14T12:19:44.373897+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:44.373897+0000","last_undegraded":"2023-10-14T12:19:44.373897+0000","last_fullsized":"2023-10-14T12:19:44.373897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:51.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950724+0000","last_change":"2023-10-14T12:19:43.385662+0000","last_active":"2023-10-14T12:19:44.950724+0000","last_peered":"2023-10-14T12:19:44.950724+0000","last_clean":"2023-10-14T12:19:44.950724+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:19:44.950724+0000","last_undegraded":"2023-10-14T12:19:44.950724+0000","last_fullsized":"2023-10-14T12:19:44.950724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373120+0000","last_change":"2023-10-14T12:19:42.371684+0000","last_active":"2023-10-14T12:19:43.373120+0000","last_peered":"2023-10-14T12:19:43.373120+0000","last_clean":"2023-10-14T12:19:43.373120+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:43.373120+0000","last_undegraded":"2023-10-14T12:19:43.373120+0000","last_fullsized":"2023-10-14T12:19:43.373120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:56.045404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373248+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:19:43.373248+0000","last_peered":"2023-10-14T12:19:43.373248+0000","last_clean":"2023-10-14T12:19:43.373248+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:19:43.373248+0000","last_undegraded":"2023-10-14T12:19:43.373248+0000","last_fullsized":"2023-10-14T12:19:43.373248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.82999999999999996}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64100000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.37}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.42299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.505},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.31}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.379}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.629}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":722884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.312},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39900000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.376},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.37},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36099999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.70899999999999996}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":132620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.371},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.505}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:19:47.943 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T12:19:47.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T12:19:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.109+0000 7ff1c9ad2700 1 Processor -- start 2023-10-14T12:19:48.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.109+0000 7ff1c9ad2700 1 -- start start 2023-10-14T12:19:48.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.109+0000 7ff1c9ad2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff1c406af50 0x7ff1c40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.109+0000 7ff1c9ad2700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c415df90 con 0x7ff1c415dbb0 2023-10-14T12:19:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.109+0000 7ff1c9ad2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c4161a60 con 0x7ff1c40cc7d0 2023-10-14T12:19:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.109+0000 7ff1c9ad2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c4161d40 con 0x7ff1c406af50 2023-10-14T12:19:48.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c2ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff1c406af50 0x7ff1c40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c37fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff1c415dbb0 0x7ff1c406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56972/0 (socket says 172.21.15.32:56972) 2023-10-14T12:19:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c37fe700 1 -- 172.21.15.32:0/2411377518 learned_addr learned my addr 172.21.15.32:0/2411377518 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c2ffd700 1 -- 172.21.15.32:0/2411377518 >> v1:172.21.15.92:6789/0 conn(0x7ff1c40cc7d0 legacy=0x7ff1c40cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c2ffd700 1 -- 172.21.15.32:0/2411377518 >> v1:172.21.15.32:6789/0 conn(0x7ff1c415dbb0 legacy=0x7ff1c406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c2ffd700 1 -- 172.21.15.32:0/2411377518 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4162020 con 0x7ff1c406af50 2023-10-14T12:19:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c27fc700 1 -- 172.21.15.32:0/2411377518 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884431630 0 0) 0x7ff1c415df90 con 0x7ff1c415dbb0 2023-10-14T12:19:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c2ffd700 1 --2- 172.21.15.32:0/2411377518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c406af50 0x7ff1c40b1f30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009840 tx=0x7ff1b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1441d3320a19f8e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c27fc700 1 -- 172.21.15.32:0/2411377518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011830 con 0x7ff1c406af50 2023-10-14T12:19:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c27fc700 1 -- 172.21.15.32:0/2411377518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4011990 con 0x7ff1c406af50 2023-10-14T12:19:48.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.110+0000 7ff1c27fc700 1 -- 172.21.15.32:0/2411377518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011d20 con 0x7ff1c406af50 2023-10-14T12:19:48.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/2411377518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c406af50 msgr2=0x7ff1c40b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/2411377518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c406af50 0x7ff1c40b1f30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009840 tx=0x7ff1b4009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:48.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/2411377518 shutdown_connections 2023-10-14T12:19:48.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/2411377518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c406af50 0x7ff1c40b1f30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/2411377518 >> 172.21.15.32:0/2411377518 conn(0x7ff1c406dac0 msgr2=0x7ff1c406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:48.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/2411377518 shutdown_connections 2023-10-14T12:19:48.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.111+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/2411377518 wait complete. 2023-10-14T12:19:48.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.112+0000 7ff1c9ad2700 1 Processor -- start 2023-10-14T12:19:48.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.112+0000 7ff1c9ad2700 1 -- start start 2023-10-14T12:19:48.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c9ad2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1c406af50 0x7ff1c40ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c9ad2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1c40cc7d0 0x7ff1c40adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c9ad2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 0x7ff1c415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c9ad2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40aec80 con 0x7ff1c415dbb0 2023-10-14T12:19:48.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c9ad2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40ac8b0 con 0x7ff1c406af50 2023-10-14T12:19:48.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c9ad2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40ae9a0 con 0x7ff1c40cc7d0 2023-10-14T12:19:48.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 0x7ff1c415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 0x7ff1c415b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39958/0 (socket says 172.21.15.32:39958) 2023-10-14T12:19:48.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c3fff700 1 -- 172.21.15.32:0/1956441134 learned_addr learned my addr 172.21.15.32:0/1956441134 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:48.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c37fe700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1c406af50 0x7ff1c40ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c2ffd700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1c40cc7d0 0x7ff1c40adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c3fff700 1 -- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1c40cc7d0 msgr2=0x7ff1c40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c3fff700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1c40cc7d0 0x7ff1c40adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.113+0000 7ff1c3fff700 1 -- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1c406af50 msgr2=0x7ff1c40ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1c3fff700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1c406af50 0x7ff1c40ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1c3fff700 1 -- 172.21.15.32:0/1956441134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40094a0 con 0x7ff1c415dbb0 2023-10-14T12:19:48.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1c2ffd700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1c40cc7d0 0x7ff1c40adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:48.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1c3fff700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 0x7ff1c415b9b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00cbc0 tx=0x7ff1bc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:48.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc003c00 con 0x7ff1c415dbb0 2023-10-14T12:19:48.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc003d60 con 0x7ff1c415dbb0 2023-10-14T12:19:48.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c40acac0 con 0x7ff1c415dbb0 2023-10-14T12:19:48.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00ab40 con 0x7ff1c415dbb0 2023-10-14T12:19:48.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.114+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c40ad080 con 0x7ff1c415dbb0 2023-10-14T12:19:48.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.115+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4067d20 con 0x7ff1c415dbb0 2023-10-14T12:19:48.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.115+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff1bc00aca0 con 0x7ff1c415dbb0 2023-10-14T12:19:48.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.116+0000 7ff1bbfff700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff1a406af00 0x7ff1a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.116+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff1bc089650 con 0x7ff1c415dbb0 2023-10-14T12:19:48.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.116+0000 7ff1c37fe700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff1a406af00 0x7ff1a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.116+0000 7ff1c37fe700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff1a406af00 0x7ff1a406d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac007c40 tx=0x7ff1ac007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:48.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.121+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1bc0546e0 con 0x7ff1c415dbb0 2023-10-14T12:19:48.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.403+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7ff1c40af8e0 con 0x7ff1c415dbb0 2023-10-14T12:19:48.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.413+0000 7ff1bbfff700 1 -- 172.21.15.32:0/1956441134 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 195+0+152 (secure 0 0 0) 0x7ff1bc057d00 con 0x7ff1c415dbb0 2023-10-14T12:19:48.414 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2023-10-14T12:19:48.415 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1hiplbLVwNhAA8WYVpBrISyYWaAdxO/MbXg== 2023-10-14T12:19:48.415 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2023-10-14T12:19:48.415 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2023-10-14T12:19:48.415 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T12:19:48.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff1a406af00 msgr2=0x7ff1a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff1a406af00 0x7ff1a406d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac007c40 tx=0x7ff1ac007b90 comp rx=0 tx=0).stop 2023-10-14T12:19:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 msgr2=0x7ff1c415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 0x7ff1c415b9b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00cbc0 tx=0x7ff1bc00ced0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 shutdown_connections 2023-10-14T12:19:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1c415dbb0 0x7ff1c415b9b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7ff1a406af00 0x7ff1a406d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1c406af50 0x7ff1c40ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 --2- 172.21.15.32:0/1956441134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1c40cc7d0 0x7ff1c40adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 >> 172.21.15.32:0/1956441134 conn(0x7ff1c406dac0 msgr2=0x7ff1c40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:48.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 shutdown_connections 2023-10-14T12:19:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.415+0000 7ff1c9ad2700 1 -- 172.21.15.32:0/1956441134 wait complete. 2023-10-14T12:19:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2023-10-14T12:19:48.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:19:48.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.553+0000 7fcf88a9c700 1 Processor -- start 2023-10-14T12:19:48.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.553+0000 7fcf88a9c700 1 -- start start 2023-10-14T12:19:48.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf88a9c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcf840d0c70 0x7fcf840cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf88a9c700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840d23e0 con 0x7fcf8415b740 2023-10-14T12:19:48.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf88a9c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840cf190 con 0x7fcf840c5110 2023-10-14T12:19:48.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf88a9c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8415bb20 con 0x7fcf840d0c70 2023-10-14T12:19:48.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf8259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcf8415b740 0x7fcf840d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56986/0 (socket says 172.21.15.32:56986) 2023-10-14T12:19:48.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf8259c700 1 -- 172.21.15.32:0/2786680990 learned_addr learned my addr 172.21.15.32:0/2786680990 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:48.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf81d9b700 1 --2- 172.21.15.32:0/2786680990 >> v2:172.21.15.92:3300/0 conn(0x7fcf840d0c70 0x7fcf840cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf8159a700 1 -- 172.21.15.32:0/2786680990 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383608202 0 0) 0x7fcf74001110 con 0x7fcf8415b740 2023-10-14T12:19:48.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf8159a700 1 -- 172.21.15.32:0/2786680990 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c0035b0 con 0x7fcf8415b740 2023-10-14T12:19:48.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf81d9b700 1 -- 172.21.15.32:0/2786680990 >> v1:172.21.15.92:6789/0 conn(0x7fcf840c5110 legacy=0x7fcf840cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf81d9b700 1 -- 172.21.15.32:0/2786680990 >> v1:172.21.15.32:6789/0 conn(0x7fcf8415b740 legacy=0x7fcf840d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf81d9b700 1 -- 172.21.15.32:0/2786680990 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840cbd40 con 0x7fcf840d0c70 2023-10-14T12:19:48.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.554+0000 7fcf81d9b700 1 --2- 172.21.15.32:0/2786680990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf840cdfd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009840 tx=0x7fcf78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2bf6d136029eacd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:48.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf8159a700 1 -- 172.21.15.32:0/2786680990 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78011830 con 0x7fcf840d0c70 2023-10-14T12:19:48.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf8159a700 1 -- 172.21.15.32:0/2786680990 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78011990 con 0x7fcf840d0c70 2023-10-14T12:19:48.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf8159a700 1 -- 172.21.15.32:0/2786680990 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78011d20 con 0x7fcf840d0c70 2023-10-14T12:19:48.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 -- 172.21.15.32:0/2786680990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 msgr2=0x7fcf840cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/2786680990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf840cdfd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009840 tx=0x7fcf78009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:48.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 -- 172.21.15.32:0/2786680990 shutdown_connections 2023-10-14T12:19:48.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/2786680990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf840cdfd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 -- 172.21.15.32:0/2786680990 >> 172.21.15.32:0/2786680990 conn(0x7fcf840665a0 msgr2=0x7fcf84066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:48.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 -- 172.21.15.32:0/2786680990 shutdown_connections 2023-10-14T12:19:48.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.555+0000 7fcf88a9c700 1 -- 172.21.15.32:0/2786680990 wait complete. 2023-10-14T12:19:48.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.557+0000 7fcf88a9c700 1 Processor -- start 2023-10-14T12:19:48.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.557+0000 7fcf88a9c700 1 -- start start 2023-10-14T12:19:48.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.557+0000 7fcf88a9c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf840c5110 0x7fcf840b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.557+0000 7fcf88a9c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf841444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.557+0000 7fcf88a9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 0x7fcf840b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.557+0000 7fcf88a9c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406c600 con 0x7fcf8415b740 2023-10-14T12:19:48.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf88a9c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406b9f0 con 0x7fcf840d0c70 2023-10-14T12:19:48.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf88a9c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406bcd0 con 0x7fcf840c5110 2023-10-14T12:19:48.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 0x7fcf840b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 0x7fcf840b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39972/0 (socket says 172.21.15.32:39972) 2023-10-14T12:19:48.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 -- 172.21.15.32:0/4277928364 learned_addr learned my addr 172.21.15.32:0/4277928364 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:48.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf8259c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf840c5110 0x7fcf840b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf81d9b700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf841444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 -- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf840c5110 msgr2=0x7fcf840b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf840c5110 0x7fcf840b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 -- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 msgr2=0x7fcf841444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf841444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 -- 172.21.15.32:0/4277928364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780094a0 con 0x7fcf8415b740 2023-10-14T12:19:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf81d9b700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf841444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf8259c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf840c5110 0x7fcf840b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf82d9d700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 0x7fcf840b3eb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00cc50 tx=0x7fcf7c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:48.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00ad80 con 0x7fcf8415b740 2023-10-14T12:19:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00ce50 con 0x7fcf8415b740 2023-10-14T12:19:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8406bfb0 con 0x7fcf8415b740 2023-10-14T12:19:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c003c40 con 0x7fcf8415b740 2023-10-14T12:19:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.558+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf840b6d40 con 0x7fcf8415b740 2023-10-14T12:19:48.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.559+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf840b6f60 con 0x7fcf8415b740 2023-10-14T12:19:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.560+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf7c0050d0 con 0x7fcf8415b740 2023-10-14T12:19:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.560+0000 7fcf72ffd700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcf6406af00 0x7fcf6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.560+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fcf7c089680 con 0x7fcf8415b740 2023-10-14T12:19:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.560+0000 7fcf8259c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcf6406af00 0x7fcf6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:48.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.561+0000 7fcf8259c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcf6406af00 0x7fcf6406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf74001270 tx=0x7fcf74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:48.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.565+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf7c0547a0 con 0x7fcf8415b740 2023-10-14T12:19:48.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.807+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf8415ad60 con 0x7fcf8415b740 2023-10-14T12:19:48.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.807+0000 7fcf72ffd700 1 -- 172.21.15.32:0/4277928364 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fcf7c057dc0 con 0x7fcf8415b740 2023-10-14T12:19:48.809 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:48.809 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2134315383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2134315383},{"type":"v1","addr":"172.21.15.32:6835","nonce":2134315383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6836/2794986339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2794986339},{"type":"v1","addr":"172.21.15.92:6836","nonce":2794986339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4144603594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6835","nonce":4144603594},{"type":"v1","addr":"172.21.15.92:6837","nonce":4144603594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:19:42.779342+0000","modified":"2023-10-14T12:19:45.809455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4915":{"gid":4915,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/2848056951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2848056951},{"type":"v1","addr":"172.21.15.32:6834","nonce":2848056951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:19:48.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcf6406af00 msgr2=0x7fcf6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcf6406af00 0x7fcf6406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf74001270 tx=0x7fcf74009040 comp rx=0 tx=0).stop 2023-10-14T12:19:48.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 msgr2=0x7fcf840b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:48.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 0x7fcf840b3eb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00cc50 tx=0x7fcf7c00a340 comp rx=0 tx=0).stop 2023-10-14T12:19:48.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 shutdown_connections 2023-10-14T12:19:48.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf8415b740 0x7fcf840b3eb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf840c5110 0x7fcf840b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fcf6406af00 0x7fcf6406d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 --2- 172.21.15.32:0/4277928364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf840d0c70 0x7fcf841444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:48.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 >> 172.21.15.32:0/4277928364 conn(0x7fcf840665a0 msgr2=0x7fcf840b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:48.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 shutdown_connections 2023-10-14T12:19:48.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:48.809+0000 7fcf88a9c700 1 -- 172.21.15.32:0/4277928364 wait complete. 2023-10-14T12:19:48.813 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 16 2023-10-14T12:19:49.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:19:42.779342+0000', 'modified': '2023-10-14T12:19:45.809455+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4915}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4915': {'gid': 4915, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6834/2848056951', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6833', 'nonce': 2848056951}, {'type': 'v1', 'addr': '172.21.15.32:6834', 'nonce': 2848056951}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T12:19:49.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:19:49.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T12:19:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.355+0000 7f2c3ed43700 1 Processor -- start 2023-10-14T12:19:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.355+0000 7f2c3ed43700 1 -- start start 2023-10-14T12:19:49.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.356+0000 7f2c3ed43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.356+0000 7f2c3ed43700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c38071ab0 con 0x7f2c3806af50 2023-10-14T12:19:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.356+0000 7f2c3ed43700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c38161bc0 con 0x7f2c38161670 2023-10-14T12:19:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.356+0000 7f2c3ed43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38161ea0 con 0x7f2c380cc3f0 2023-10-14T12:19:49.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.356+0000 7f2c3d2e0700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2c3806af50 0x7f2c38071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57004/0 (socket says 172.21.15.32:57004) 2023-10-14T12:19:49.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.356+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/3072051600 learned_addr learned my addr 172.21.15.32:0/3072051600 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:49.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3072051600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680602743 0 0) 0x7f2c38071ab0 con 0x7f2c3806af50 2023-10-14T12:19:49.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c280035b0 con 0x7f2c3806af50 2023-10-14T12:19:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870255901 0 0) 0x7f2c38161bc0 con 0x7f2c38161670 2023-10-14T12:19:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c38071ab0 con 0x7f2c38161670 2023-10-14T12:19:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683042267 0 0) 0x7f2c280035b0 con 0x7f2c3806af50 2023-10-14T12:19:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3072051600 >> v1:172.21.15.92:6789/0 conn(0x7f2c38161670 legacy=0x7f2c3806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3072051600 >> v1:172.21.15.32:6789/0 conn(0x7f2c3806af50 legacy=0x7f2c38071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3072051600 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38162180 con 0x7f2c380cc3f0 2023-10-14T12:19:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3072051600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009870 tx=0x7f2c2c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b49e0df716f25d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300019f0 con 0x7f2c380cc3f0 2023-10-14T12:19:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c004030 con 0x7f2c380cc3f0 2023-10-14T12:19:49.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.357+0000 7f2c377fe700 1 -- 172.21.15.32:0/3072051600 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0043c0 con 0x7f2c380cc3f0 2023-10-14T12:19:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3072051600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 msgr2=0x7f2c380cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3072051600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009870 tx=0x7f2c2c009b80 comp rx=0 tx=0).stop 2023-10-14T12:19:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3072051600 shutdown_connections 2023-10-14T12:19:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3072051600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3072051600 >> 172.21.15.32:0/3072051600 conn(0x7f2c3806dac0 msgr2=0x7f2c3806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3072051600 shutdown_connections 2023-10-14T12:19:49.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.358+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3072051600 wait complete. 2023-10-14T12:19:49.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.359+0000 7f2c3ed43700 1 Processor -- start 2023-10-14T12:19:49.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.359+0000 7f2c3ed43700 1 -- start start 2023-10-14T12:19:49.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3ed43700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 0x7f2c380c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3ed43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3ed43700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38161670 0x7f2c380ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3ed43700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380ca100 con 0x7f2c3806af50 2023-10-14T12:19:49.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3ed43700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380c4230 con 0x7f2c38161670 2023-10-14T12:19:49.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3ed43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380c6500 con 0x7f2c380cc3f0 2023-10-14T12:19:49.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 0x7f2c380c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 0x7f2c380c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39982/0 (socket says 172.21.15.32:39982) 2023-10-14T12:19:49.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3566740538 learned_addr learned my addr 172.21.15.32:0/3566740538 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:49.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38161670 0x7f2c380ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c37fff700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 msgr2=0x7f2c380cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38161670 msgr2=0x7f2c380ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38161670 0x7f2c380ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3cadf700 1 -- 172.21.15.32:0/3566740538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0094a0 con 0x7f2c3806af50 2023-10-14T12:19:49.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38161670 0x7f2c380ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:49.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.360+0000 7f2c37fff700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:49.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.361+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 0x7f2c380c3cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c000c00 tx=0x7f2c2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.361+0000 7f2c357fa700 1 -- 172.21.15.32:0/3566740538 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c003e30 con 0x7f2c3806af50 2023-10-14T12:19:49.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.361+0000 7f2c357fa700 1 -- 172.21.15.32:0/3566740538 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c01f070 con 0x7f2c3806af50 2023-10-14T12:19:49.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.361+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c380c81b0 con 0x7f2c3806af50 2023-10-14T12:19:49.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.361+0000 7f2c357fa700 1 -- 172.21.15.32:0/3566740538 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c011870 con 0x7f2c3806af50 2023-10-14T12:19:49.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.361+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c380c5f40 con 0x7f2c3806af50 2023-10-14T12:19:49.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.362+0000 7f2c357fa700 1 -- 172.21.15.32:0/3566740538 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c2c021030 con 0x7f2c3806af50 2023-10-14T12:19:49.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.363+0000 7f2c357fa700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2c1c06af00 0x7f2c1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.363+0000 7f2c357fa700 1 -- 172.21.15.32:0/3566740538 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2c2c08aa30 con 0x7f2c3806af50 2023-10-14T12:19:49.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.363+0000 7f2c37fff700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2c1c06af00 0x7f2c1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.363+0000 7f2c37fff700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2c1c06af00 0x7f2c1c06d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c380c3a70 tx=0x7f2c24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.365+0000 7f2c4af2db80 1 Processor -- start 2023-10-14T12:19:49.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.365+0000 7f2c4af2db80 1 -- start start 2023-10-14T12:19:49.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.365+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e953ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.365+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.365+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e950f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9485c20 con 0x55e7e9539630 2023-10-14T12:19:49.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e946ac10 con 0x55e7e950f010 2023-10-14T12:19:49.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9468530 con 0x55e7e9534220 2023-10-14T12:19:49.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39992/0 (socket says 172.21.15.32:39992) 2023-10-14T12:19:49.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 -- 172.21.15.32:0/2770262451 learned_addr learned my addr 172.21.15.32:0/2770262451 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:49.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e950f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e953ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 -- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 msgr2=0x55e7e953ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e953ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 -- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 msgr2=0x55e7e950f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e950f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 -- 172.21.15.32:0/2770262451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e94213a0 con 0x55e7e9539630 2023-10-14T12:19:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e953ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:49.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e950f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:49.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c37fff700 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953bfb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2c24001ea0 tx=0x7f2c24010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f088ba98ff060417 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c227fc700 1 -- 172.21.15.32:0/2770262451 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014830 con 0x55e7e9539630 2023-10-14T12:19:49.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c227fc700 1 -- 172.21.15.32:0/2770262451 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c24014990 con 0x55e7e9539630 2023-10-14T12:19:49.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.366+0000 7f2c227fc700 1 -- 172.21.15.32:0/2770262451 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014d00 con 0x55e7e9539630 2023-10-14T12:19:49.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 -- 172.21.15.32:0/2770262451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 msgr2=0x55e7e953bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953bfb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2c24001ea0 tx=0x7f2c24010000 comp rx=0 tx=0).stop 2023-10-14T12:19:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 -- 172.21.15.32:0/2770262451 shutdown_connections 2023-10-14T12:19:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e950f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e953ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/2770262451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953bfb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 -- 172.21.15.32:0/2770262451 >> 172.21.15.32:0/2770262451 conn(0x55e7e943ed80 msgr2=0x55e7e9559ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 -- 172.21.15.32:0/2770262451 shutdown_connections 2023-10-14T12:19:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.367+0000 7f2c4af2db80 1 -- 172.21.15.32:0/2770262451 wait complete. 2023-10-14T12:19:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.368+0000 7f2c4af2db80 1 -- start start 2023-10-14T12:19:49.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.368+0000 7f2c4af2db80 1 Processor -- start 2023-10-14T12:19:49.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e950f010 0x55e7e9533540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9536310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9463e20 con 0x55e7e9539630 2023-10-14T12:19:49.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e94006c0 con 0x55e7e9534220 2023-10-14T12:19:49.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9400360 con 0x55e7e950f010 2023-10-14T12:19:49.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c4af2db80 10 client.0 _ll_register_callbacks cb 0x55e7e925d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:19:49.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c3d2e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c3d2e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40000/0 (socket says 172.21.15.32:40000) 2023-10-14T12:19:49.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/3261120598 learned_addr learned my addr 172.21.15.32:0/3261120598 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:49.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.369+0000 7f2c37fff700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9536310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e950f010 0x55e7e9533540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e950f010 msgr2=0x55e7e9533540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e950f010 0x55e7e9533540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 msgr2=0x55e7e9536310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9536310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/3261120598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38071ab0 con 0x55e7e9539630 2023-10-14T12:19:49.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c37fff700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9536310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:49.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953eca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c30007820 tx=0x7f2c3000f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629a0d705569dfc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c177fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-14T12:19:49.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c177fe700 1 -- 172.21.15.32:0/3261120598 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000fb10 con 0x55e7e9539630 2023-10-14T12:19:49.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c177fe700 1 -- 172.21.15.32:0/3261120598 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2c3000fc70 con 0x55e7e9539630 2023-10-14T12:19:49.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7e95045b0 con 0x55e7e9539630 2023-10-14T12:19:49.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c177fe700 1 -- 172.21.15.32:0/3261120598 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c3000fe30 con 0x55e7e9539630 2023-10-14T12:19:49.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 10 client.5226 fetch_fsmap learned FSMap version 16 2023-10-14T12:19:49.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e7e928ed90 con 0x55e7e9539630 2023-10-14T12:19:49.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c177fe700 1 -- 172.21.15.32:0/3261120598 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7e95045b0 con 0x55e7e9539630 2023-10-14T12:19:49.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c177fe700 1 -- 172.21.15.32:0/3261120598 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 16) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f2c30012070 con 0x55e7e9539630 2023-10-14T12:19:49.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 10 client.5226 fetch_fsmap finished waiting for FSMap version 16 2023-10-14T12:19:49.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 10 client.5226 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T12:19:49.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 20 client.5226 populate_metadata read hostname 'smithi032' 2023-10-14T12:19:49.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e953cda0 0x55e7e95695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 4 client.5226 mds_command: new command op to 4915 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:19:49.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.370+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 --> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7e945ce00 con 0x55e7e953cda0 2023-10-14T12:19:49.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.371+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e953cda0 0x55e7e95695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.371+0000 7f2c177fe700 10 client.5226 ms_handle_connect on v2:172.21.15.32:6833/2848056951 2023-10-14T12:19:49.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.371+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e953cda0 0x55e7e95695a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0d5d8f12c2c83 server_cookie=2ff638d5dc42a45b in_seq=0 out_seq=0 2023-10-14T12:19:49.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.371+0000 7f2c177fe700 1 -- 172.21.15.32:0/3261120598 <== mds.0 v2:172.21.15.32:6833/2848056951 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7e945ce00 con 0x55e7e953cda0 2023-10-14T12:19:49.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.371+0000 7f2c177fe700 10 client.5226 handle_command_reply: tid=0 2023-10-14T12:19:49.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 client.5226 shutdown 2023-10-14T12:19:49.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 msgr2=0x55e7e953eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953eca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c30007820 tx=0x7f2c3000f1d0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 shutdown_connections 2023-10-14T12:19:49.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e953cda0 0x55e7e95695a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e953eca0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e950f010 0x55e7e9533540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c177fe700 0 client.5226 ms_handle_reset on v2:172.21.15.32:6833/2848056951 2023-10-14T12:19:49.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/3261120598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9536310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 >> 172.21.15.32:0/3261120598 conn(0x55e7e943ed80 msgr2=0x55e7e95574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 shutdown_connections 2023-10-14T12:19:49.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 1 -- 172.21.15.32:0/3261120598 wait complete. 2023-10-14T12:19:49.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.372+0000 7f2c4af2db80 20 client.5226 trim_cache size 0 max 16384 2023-10-14T12:19:49.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 Processor -- start 2023-10-14T12:19:49.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 -- start start 2023-10-14T12:19:49.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e9511870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e950ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e9565400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e92e48d0 con 0x55e7e9539630 2023-10-14T12:19:49.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e956fba0 con 0x55e7e950f010 2023-10-14T12:19:49.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9532e40 con 0x55e7e9534220 2023-10-14T12:19:49.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c3d2e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e9565400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c3d2e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e9565400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40006/0 (socket says 172.21.15.32:40006) 2023-10-14T12:19:49.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.390+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/4084156266 learned_addr learned my addr 172.21.15.32:0/4084156266 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:49.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e9511870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c37fff700 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e950ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 msgr2=0x55e7e950ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e950ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 msgr2=0x55e7e9511870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e9511870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3d2e0700 1 -- 172.21.15.32:0/4084156266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e950df20 con 0x55e7e9539630 2023-10-14T12:19:49.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c37fff700 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e950ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:49.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e9565400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009010 tx=0x7f2c30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a413fd212851c408 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c22ffd700 1 -- 172.21.15.32:0/4084156266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000f5d0 con 0x55e7e9539630 2023-10-14T12:19:49.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c22ffd700 1 -- 172.21.15.32:0/4084156266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000d050 con 0x55e7e9539630 2023-10-14T12:19:49.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c22ffd700 1 -- 172.21.15.32:0/4084156266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000fd10 con 0x55e7e9539630 2023-10-14T12:19:49.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4084156266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 msgr2=0x55e7e9565400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e9565400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009010 tx=0x7f2c30013000 comp rx=0 tx=0).stop 2023-10-14T12:19:49.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4084156266 shutdown_connections 2023-10-14T12:19:49.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e9539630 0x55e7e9565400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e950f010 0x55e7e9511870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4084156266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9534220 0x55e7e950ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.391+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4084156266 >> 172.21.15.32:0/4084156266 conn(0x55e7e943ed80 msgr2=0x55e7e953ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.392+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4084156266 shutdown_connections 2023-10-14T12:19:49.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.392+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4084156266 wait complete. 2023-10-14T12:19:49.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.392+0000 7f2c4af2db80 1 -- start start 2023-10-14T12:19:49.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.392+0000 7f2c4af2db80 1 Processor -- start 2023-10-14T12:19:49.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 0x55e7e9556450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9505f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9539630 0x55e7e9506480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e953db90 con 0x55e7e950f010 2023-10-14T12:19:49.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9576150 con 0x55e7e9534220 2023-10-14T12:19:49.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7e955a420 con 0x55e7e9539630 2023-10-14T12:19:49.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 0x55e7e9556450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c4af2db80 10 client.0 _ll_register_callbacks cb 0x7f2c30007050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:19:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 0x55e7e9556450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40010/0 (socket says 172.21.15.32:40010) 2023-10-14T12:19:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 -- 172.21.15.32:0/4292772274 learned_addr learned my addr 172.21.15.32:0/4292772274 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c37fff700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9505f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3d2e0700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9539630 0x55e7e9506480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 -- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9539630 msgr2=0x55e7e9506480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9539630 0x55e7e9506480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 -- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 msgr2=0x55e7e9505f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:49.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9505f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.393+0000 7f2c3cadf700 1 -- 172.21.15.32:0/4292772274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7e928ed90 con 0x55e7e950f010 2023-10-14T12:19:49.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c3cadf700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 0x55e7e9556450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c055e30 tx=0x7f2c2c088ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1641f2ac2f7d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c177fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-14T12:19:49.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c177fe700 1 -- 172.21.15.32:0/4292772274 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c056040 con 0x55e7e950f010 2023-10-14T12:19:49.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c177fe700 1 -- 172.21.15.32:0/4292772274 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2c2c0561a0 con 0x55e7e950f010 2023-10-14T12:19:49.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c24014990 con 0x55e7e950f010 2023-10-14T12:19:49.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c177fe700 1 -- 172.21.15.32:0/4292772274 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c2c0710b0 con 0x55e7e950f010 2023-10-14T12:19:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 10 client.5232 fetch_fsmap learned FSMap version 16 2023-10-14T12:19:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e7e9277c10 con 0x55e7e950f010 2023-10-14T12:19:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c177fe700 1 -- 172.21.15.32:0/4292772274 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c24014990 con 0x55e7e950f010 2023-10-14T12:19:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c177fe700 1 -- 172.21.15.32:0/4292772274 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 16) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f2c2c06d240 con 0x55e7e950f010 2023-10-14T12:19:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 10 client.5232 fetch_fsmap finished waiting for FSMap version 16 2023-10-14T12:19:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 10 client.5232 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T12:19:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 20 client.5232 populate_metadata read hostname 'smithi032' 2023-10-14T12:19:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e9535bc0 0x55e7e9535fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 4 client.5232 mds_command: new command op to 4915 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:19:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 --> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e7e945cb20 con 0x55e7e9535bc0 2023-10-14T12:19:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.394+0000 7f2c37fff700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e9535bc0 0x55e7e9535fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c177fe700 10 client.5232 ms_handle_connect on v2:172.21.15.32:6833/2848056951 2023-10-14T12:19:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c37fff700 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e9535bc0 0x55e7e9535fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84b8085089a9363 server_cookie=fbd51fa25acf20ed in_seq=0 out_seq=0 2023-10-14T12:19:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c177fe700 1 -- 172.21.15.32:0/4292772274 <== mds.0 v2:172.21.15.32:6833/2848056951 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55e7e945cb20 con 0x55e7e9535bc0 2023-10-14T12:19:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c177fe700 10 client.5232 handle_command_reply: tid=0 2023-10-14T12:19:49.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 client.5232 shutdown 2023-10-14T12:19:49.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 msgr2=0x55e7e9556450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 0x55e7e9556450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c055e30 tx=0x7f2c2c088ea0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 shutdown_connections 2023-10-14T12:19:49.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e7e9539630 0x55e7e9506480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:6833/2848056951,v1:172.21.15.32:6834/2848056951] conn(0x55e7e9535bc0 0x55e7e9535fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e950f010 0x55e7e9556450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 --2- 172.21.15.32:0/4292772274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7e9534220 0x55e7e9505f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c177fe700 0 client.5232 ms_handle_reset on v2:172.21.15.32:6833/2848056951 2023-10-14T12:19:49.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 >> 172.21.15.32:0/4292772274 conn(0x55e7e943ed80 msgr2=0x55e7e9511650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 shutdown_connections 2023-10-14T12:19:49.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 1 -- 172.21.15.32:0/4292772274 wait complete. 2023-10-14T12:19:49.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.395+0000 7f2c4af2db80 20 client.5232 trim_cache size 0 max 16384 2023-10-14T12:19:49.422 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed", 2023-10-14T12:19:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-10-14T12:19:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4915, 2023-10-14T12:19:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-10-14T12:19:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-10-14T12:19:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "testcephfs1", 2023-10-14T12:19:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 6.0034717540000004, 2023-10-14T12:19:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 16, 2023-10-14T12:19:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 32, 2023-10-14T12:19:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T12:19:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 13.898071934000001 2023-10-14T12:19:49.425 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:49.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2c1c06af00 msgr2=0x7f2c1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2c1c06af00 0x7f2c1c06d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c380c3a70 tx=0x7f2c24009040 comp rx=0 tx=0).stop 2023-10-14T12:19:49.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 msgr2=0x7f2c380c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 0x7f2c380c3cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c000c00 tx=0x7f2c2c004750 comp rx=0 tx=0).stop 2023-10-14T12:19:49.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 shutdown_connections 2023-10-14T12:19:49.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f2c1c06af00 0x7f2c1c06d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38161670 0x7f2c380ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c3806af50 0x7f2c380c3cf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 --2- 172.21.15.32:0/3566740538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c380cc3f0 0x7f2c380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 >> 172.21.15.32:0/3566740538 conn(0x7f2c3806dac0 msgr2=0x7f2c3806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 shutdown_connections 2023-10-14T12:19:49.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.396+0000 7f2c3ed43700 1 -- 172.21.15.32:0/3566740538 wait complete. 2023-10-14T12:19:49.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:19:49.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.553+0000 7fd0b9a6f700 1 Processor -- start 2023-10-14T12:19:49.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.553+0000 7fd0b9a6f700 1 -- start start 2023-10-14T12:19:49.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b9a6f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd0b415e2f0 0x7fd0b40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b9a6f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b40b2d60 con 0x7fd0b406a840 2023-10-14T12:19:49.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b9a6f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b40cdd30 con 0x7fd0b40cd950 2023-10-14T12:19:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b9a6f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b41619a0 con 0x7fd0b415e2f0 2023-10-14T12:19:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd0b406a840 0x7fd0b406ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57046/0 (socket says 172.21.15.32:57046) 2023-10-14T12:19:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b3fff700 1 -- 172.21.15.32:0/298953573 learned_addr learned my addr 172.21.15.32:0/298953573 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b2ffd700 1 --2- 172.21.15.32:0/298953573 >> v2:172.21.15.92:3300/0 conn(0x7fd0b415e2f0 0x7fd0b40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b27fc700 1 -- 172.21.15.32:0/298953573 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176429287 0 0) 0x7fd0b40b2d60 con 0x7fd0b406a840 2023-10-14T12:19:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b27fc700 1 -- 172.21.15.32:0/298953573 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a00035b0 con 0x7fd0b406a840 2023-10-14T12:19:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b2ffd700 1 -- 172.21.15.32:0/298953573 >> v1:172.21.15.92:6789/0 conn(0x7fd0b40cd950 legacy=0x7fd0b415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b2ffd700 1 -- 172.21.15.32:0/298953573 >> v1:172.21.15.32:6789/0 conn(0x7fd0b406a840 legacy=0x7fd0b406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.554+0000 7fd0b2ffd700 1 -- 172.21.15.32:0/298953573 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b415e920 con 0x7fd0b415e2f0 2023-10-14T12:19:49.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b2ffd700 1 --2- 172.21.15.32:0/298953573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b415e2f0 0x7fd0b40cede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009820 tx=0x7fd0a4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76e152542a44cc1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b27fc700 1 -- 172.21.15.32:0/298953573 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4005e30 con 0x7fd0b415e2f0 2023-10-14T12:19:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b27fc700 1 -- 172.21.15.32:0/298953573 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4006030 con 0x7fd0b415e2f0 2023-10-14T12:19:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b27fc700 1 -- 172.21.15.32:0/298953573 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a40063c0 con 0x7fd0b415e2f0 2023-10-14T12:19:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/298953573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b415e2f0 msgr2=0x7fd0b40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/298953573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b415e2f0 0x7fd0b40cede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009820 tx=0x7fd0a4009b30 comp rx=0 tx=0).stop 2023-10-14T12:19:49.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/298953573 shutdown_connections 2023-10-14T12:19:49.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/298953573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b415e2f0 0x7fd0b40cede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/298953573 >> 172.21.15.32:0/298953573 conn(0x7fd0b406dae0 msgr2=0x7fd0b406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/298953573 shutdown_connections 2023-10-14T12:19:49.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.555+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/298953573 wait complete. 2023-10-14T12:19:49.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.557+0000 7fd0b9a6f700 1 Processor -- start 2023-10-14T12:19:49.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.557+0000 7fd0b9a6f700 1 -- start start 2023-10-14T12:19:49.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b9a6f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 0x7fd0b40b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b9a6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b40cd950 0x7fd0b40aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b9a6f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0b415e2f0 0x7fd0b415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b9a6f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40b4f50 con 0x7fd0b406a840 2023-10-14T12:19:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b9a6f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40b5f00 con 0x7fd0b40cd950 2023-10-14T12:19:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b9a6f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40b5c20 con 0x7fd0b415e2f0 2023-10-14T12:19:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 0x7fd0b40b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 0x7fd0b40b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40024/0 (socket says 172.21.15.32:40024) 2023-10-14T12:19:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b37fe700 1 -- 172.21.15.32:0/2870779218 learned_addr learned my addr 172.21.15.32:0/2870779218 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b2ffd700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b40cd950 0x7fd0b40aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.558+0000 7fd0b3fff700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0b415e2f0 0x7fd0b415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b37fe700 1 -- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0b415e2f0 msgr2=0x7fd0b415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b37fe700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0b415e2f0 0x7fd0b415c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b37fe700 1 -- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b40cd950 msgr2=0x7fd0b40aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b37fe700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b40cd950 0x7fd0b40aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b37fe700 1 -- 172.21.15.32:0/2870779218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4009430 con 0x7fd0b406a840 2023-10-14T12:19:49.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b3fff700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0b415e2f0 0x7fd0b415c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b37fe700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 0x7fd0b40b3a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c700 tx=0x7fd09c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0052d0 con 0x7fd0b406a840 2023-10-14T12:19:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c005430 con 0x7fd0b406a840 2023-10-14T12:19:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b40c7640 con 0x7fd0b406a840 2023-10-14T12:19:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c003880 con 0x7fd0b406a840 2023-10-14T12:19:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.559+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b40c79d0 con 0x7fd0b406a840 2023-10-14T12:19:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.560+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b40c7e40 con 0x7fd0b406a840 2023-10-14T12:19:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.560+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd09c0039e0 con 0x7fd0b406a840 2023-10-14T12:19:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.561+0000 7fd0abfff700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.561+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd09c088a30 con 0x7fd0b406a840 2023-10-14T12:19:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.561+0000 7fd0b2ffd700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.561+0000 7fd0b2ffd700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd09406af00 0x7fd09406d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009b70 tx=0x7fd0a4008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.566+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0b40c7e40 con 0x7fd0b406a840 2023-10-14T12:19:49.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.810+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0b40c7e40 con 0x7fd0b406a840 2023-10-14T12:19:49.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.811+0000 7fd0abfff700 1 -- 172.21.15.32:0/2870779218 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd09c017070 con 0x7fd0b406a840 2023-10-14T12:19:49.812 INFO:teuthology.orchestra.run.smithi032.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T12:19:49.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd09406af00 msgr2=0x7fd09406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd09406af00 0x7fd09406d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009b70 tx=0x7fd0a4008070 comp rx=0 tx=0).stop 2023-10-14T12:19:49.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 msgr2=0x7fd0b40b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:49.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 0x7fd0b40b3a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c700 tx=0x7fd09c00ca10 comp rx=0 tx=0).stop 2023-10-14T12:19:49.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 shutdown_connections 2023-10-14T12:19:49.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0b415e2f0 0x7fd0b415c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0b406a840 0x7fd0b40b3a90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 --2- 172.21.15.32:0/2870779218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0b40cd950 0x7fd0b40aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 >> 172.21.15.32:0/2870779218 conn(0x7fd0b406dae0 msgr2=0x7fd0b406ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 shutdown_connections 2023-10-14T12:19:49.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:49.813+0000 7fd0b9a6f700 1 -- 172.21.15.32:0/2870779218 wait complete. 2023-10-14T12:19:49.826 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T12:19:49.830 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:19:49.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-10-14T12:19:49.830 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T12:19:49.831 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:49.831 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T12:19:49.831 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T12:19:49.832 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:19:49.832 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:19:49.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:49.833 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-10-14T12:19:49.852 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:19:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:19:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:19:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-14T12:19:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.853 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:49.853 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:49.854 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:19:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T12:19:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-10-14T12:19:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-10-14T12:19:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.855 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:19:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:49.855 INFO:teuthology.orchestra.run.smithi032.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:19:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 1a:8f:4f:59:0b:85 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:19:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:19:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ec1c:b2ff:feed:fd16/64 scope link 2023-10-14T12:19:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.857 INFO:teuthology.orchestra.run.smithi032.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:19:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 76:d4:34:dc:09:50 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:19:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::74d4:34ff:fedc:950/64 scope link 2023-10-14T12:19:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.857 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:19:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 1a:8f:4f:59:0b:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:19:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::188f:4fff:fe59:b85/64 scope link 2023-10-14T12:19:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:19:49.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:49.859 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:19:49.918 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-10-14T12:19:49.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:49.920 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-10-14T12:19:49.980 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-10-14T12:19:49.980 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:19:49.981 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T12:19:49.981 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T12:19:49.981 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:19:49.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:49.982 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-14T12:19:49.983 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-14T12:19:49.983 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T12:19:49.983 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T12:19:49.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T12:19:49.984 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-14T12:19:50.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.088 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:50.106 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T12:19:50.106 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:19:50.106 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:19:50.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.107 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-10-14T12:19:50.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:50.175 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:19:50.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:19:50.234 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:19:50.289 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T12:19:50.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:50.376 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:50.376 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:50.406 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:50.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:50.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:50.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:50.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:50.407 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:50.408 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:50.408 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:50.463 INFO:teuthology.orchestra.run.smithi032.stderr:mount error 2 = No such file or directory 2023-10-14T12:19:50.464 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:19:50.464 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:19:50.464 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T12:19:50.464 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed.cephfs=/ 2023-10-14T12:19:50.465 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2023-10-14T12:19:50.465 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:19:50.465 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:19:50.466 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:19:50.466 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T12:19:50.466 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T12:19:50.466 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed" will pass to kernel 2023-10-14T12:19:50.467 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-14T12:19:50.468 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-14T12:19:50.469 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ERROR 2023-10-14T12:19:50.469 INFO:tasks.cephfs_test_runner: 2023-10-14T12:19:50.470 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T12:19:50.470 INFO:tasks.cephfs_test_runner:ERROR: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T12:19:50.470 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system 2023-10-14T12:19:50.471 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T12:19:50.471 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T12:19:50.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_volumes.py", line 415, in setUp 2023-10-14T12:19:50.472 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).setUp() 2023-10-14T12:19:50.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T12:19:50.473 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T12:19:50.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T12:19:50.473 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T12:19:50.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T12:19:50.474 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T12:19:50.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T12:19:50.475 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T12:19:50.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T12:19:50.476 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T12:19:50.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T12:19:50.476 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T12:19:50.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T12:19:50.477 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T12:19:50.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T12:19:50.477 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T12:19:50.478 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T12:19:50.478 INFO:tasks.cephfs_test_runner: 2023-10-14T12:19:50.478 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T12:19:50.478 INFO:tasks.cephfs_test_runner:Ran 1 test in 33.642s 2023-10-14T12:19:50.479 INFO:tasks.cephfs_test_runner: 2023-10-14T12:19:50.479 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T12:19:50.479 INFO:tasks.cephfs_test_runner: 2023-10-14T12:19:50.480 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T12:19:50.480 INFO:tasks.cephfs_test_runner:ERROR: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T12:19:50.480 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system 2023-10-14T12:19:50.481 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T12:19:50.481 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T12:19:50.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_volumes.py", line 415, in setUp 2023-10-14T12:19:50.481 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).setUp() 2023-10-14T12:19:50.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T12:19:50.482 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T12:19:50.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T12:19:50.482 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T12:19:50.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T12:19:50.483 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T12:19:50.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T12:19:50.484 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T12:19:50.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T12:19:50.484 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T12:19:50.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T12:19:50.485 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T12:19:50.485 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T12:19:50.486 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T12:19:50.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T12:19:50.486 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T12:19:50.486 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T12:19:50.487 INFO:tasks.cephfs_test_runner: 2023-10-14T12:19:50.487 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T12:19:50.556 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7f2543c12d144660ba7715f058268767 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T12:19:50.558 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T12:19:50.567 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T12:19:50.603 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T12:19:50.603 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:50.604 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:50.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-14T12:19:50.638 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-14T12:19:50.638 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:50.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-14T12:19:50.696 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:50.696 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:50.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19972 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-14T12:19:50.718 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T12:19:50.718 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:19:50.778 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19972 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-14T12:19:50.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.779 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:50.797 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T12:19:50.797 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:19:50.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:19:50.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:19:50.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:50.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-10-14T12:19:51.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.068 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-14T12:19:51.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-10-14T12:19:51.158 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2023-10-14T12:19:51.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:19:51.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.161 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T12:19:51.184 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T12:19:51.185 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T12:19:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.186 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:19:51.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:19:51.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-14T12:19:51.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.453 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T12:19:51.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:19:51.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-14T12:19:51.541 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-14T12:19:51.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:19:51.542 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T12:19:51.554 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T12:19:51.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:19:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.680+0000 7f191915d700 1 Processor -- start 2023-10-14T12:19:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.680+0000 7f191915d700 1 -- start start 2023-10-14T12:19:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f191915d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f191415a580 0x7f19140727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f191915d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1914071aa0 con 0x7f191406c9b0 2023-10-14T12:19:51.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f191915d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191415f140 con 0x7f191415e8d0 2023-10-14T12:19:51.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f191915d700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191415ee60 con 0x7f191415a580 2023-10-14T12:19:51.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f1912d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f191415a580 0x7f19140727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f1912d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f191415a580 0x7f19140727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40034/0 (socket says 172.21.15.32:40034) 2023-10-14T12:19:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f191259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f191406c9b0 0x7f191415e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57058/0 (socket says 172.21.15.32:57058) 2023-10-14T12:19:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f1912d9d700 1 -- 172.21.15.32:0/893861654 learned_addr learned my addr 172.21.15.32:0/893861654 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f1912d9d700 1 -- 172.21.15.32:0/893861654 >> v1:172.21.15.92:6789/0 conn(0x7f191415e8d0 legacy=0x7f19140ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f1912d9d700 1 -- 172.21.15.32:0/893861654 >> v1:172.21.15.32:6789/0 conn(0x7f191406c9b0 legacy=0x7f191415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.681+0000 7f1911d9b700 1 -- 172.21.15.32:0/893861654 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916578729 0 0) 0x7f1914071aa0 con 0x7f191406c9b0 2023-10-14T12:19:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f1912d9d700 1 -- 172.21.15.32:0/893861654 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914071cd0 con 0x7f191415a580 2023-10-14T12:19:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f1912d9d700 1 --2- 172.21.15.32:0/893861654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415a580 0x7f19140727b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f190400bb90 tx=0x7f190400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d007da0a26db8ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f1911d9b700 1 -- 172.21.15.32:0/893861654 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190400dd50 con 0x7f191415a580 2023-10-14T12:19:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f1911d9b700 1 -- 172.21.15.32:0/893861654 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1904010470 con 0x7f191415a580 2023-10-14T12:19:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f1911d9b700 1 -- 172.21.15.32:0/893861654 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904010800 con 0x7f191415a580 2023-10-14T12:19:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 -- 172.21.15.32:0/893861654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415a580 msgr2=0x7f19140727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 --2- 172.21.15.32:0/893861654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415a580 0x7f19140727b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f190400bb90 tx=0x7f190400bea0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 -- 172.21.15.32:0/893861654 shutdown_connections 2023-10-14T12:19:51.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 --2- 172.21.15.32:0/893861654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415a580 0x7f19140727b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 -- 172.21.15.32:0/893861654 >> 172.21.15.32:0/893861654 conn(0x7f191406afb0 msgr2=0x7f19140cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:51.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 -- 172.21.15.32:0/893861654 shutdown_connections 2023-10-14T12:19:51.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.682+0000 7f191915d700 1 -- 172.21.15.32:0/893861654 wait complete. 2023-10-14T12:19:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.684+0000 7f191915d700 1 Processor -- start 2023-10-14T12:19:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.684+0000 7f191915d700 1 -- start start 2023-10-14T12:19:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191915d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f191406c9b0 0x7f19141503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191915d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191415a580 0x7f191414da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191915d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 0x7f19141541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:51.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191915d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19141549a0 con 0x7f191415e8d0 2023-10-14T12:19:51.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191915d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914151fe0 con 0x7f191415a580 2023-10-14T12:19:51.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191915d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1914154700 con 0x7f191406c9b0 2023-10-14T12:19:51.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 0x7f19141541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:51.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 0x7f19141541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40044/0 (socket says 172.21.15.32:40044) 2023-10-14T12:19:51.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 -- 172.21.15.32:0/2771174541 learned_addr learned my addr 172.21.15.32:0/2771174541 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:51.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191259c700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191415a580 0x7f191414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:51.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f1912d9d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f191406c9b0 0x7f19141503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:51.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 -- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f191406c9b0 msgr2=0x7f19141503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f191406c9b0 0x7f19141503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 -- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191415a580 msgr2=0x7f191414da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191415a580 0x7f191414da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 -- 172.21.15.32:0/2771174541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190400b7f0 con 0x7f191415e8d0 2023-10-14T12:19:51.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f1912d9d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f191406c9b0 0x7f19141503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:51.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f191359e700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 0x7f19141541c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f190c00cc50 tx=0x7f190c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:51.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.685+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00ad80 con 0x7f191415e8d0 2023-10-14T12:19:51.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.686+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00ce50 con 0x7f191415e8d0 2023-10-14T12:19:51.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.686+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914152280 con 0x7f191415e8d0 2023-10-14T12:19:51.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.686+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c003c40 con 0x7f191415e8d0 2023-10-14T12:19:51.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.686+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914152840 con 0x7f191415e8d0 2023-10-14T12:19:51.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.686+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191404ebb0 con 0x7f191415e8d0 2023-10-14T12:19:51.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.687+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f190c0050d0 con 0x7f191415e8d0 2023-10-14T12:19:51.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.687+0000 7f190b7fe700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f18f406af00 0x7f18f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:51.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.687+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f190c089680 con 0x7f191415e8d0 2023-10-14T12:19:51.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.688+0000 7f1912d9d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f18f406af00 0x7f18f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:51.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.688+0000 7f1912d9d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f18f406af00 0x7f18f406d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f190400b340 tx=0x7f1904013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:51.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.692+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f190c0547a0 con 0x7f191415e8d0 2023-10-14T12:19:51.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.884+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1914072290 con 0x7f18f406af00 2023-10-14T12:19:51.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.892+0000 7f190b7fe700 1 -- 172.21.15.32:0/2771174541 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288733 (secure 0 0 0) 0x7f190400de30 con 0x7f18f406af00 2023-10-14T12:19:51.899 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:51.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f18f406af00 msgr2=0x7f18f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f18f406af00 0x7f18f406d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f190400b340 tx=0x7f1904013000 comp rx=0 tx=0).stop 2023-10-14T12:19:51.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 msgr2=0x7f19141541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:51.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 0x7f19141541c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f190c00cc50 tx=0x7f190c00a340 comp rx=0 tx=0).stop 2023-10-14T12:19:51.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 shutdown_connections 2023-10-14T12:19:51.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f191415e8d0 0x7f19141541c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f191406c9b0 0x7f19141503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f18f406af00 0x7f18f406d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 --2- 172.21.15.32:0/2771174541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191415a580 0x7f191414da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:51.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 >> 172.21.15.32:0/2771174541 conn(0x7f191406afb0 msgr2=0x7f19140c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:51.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 shutdown_connections 2023-10-14T12:19:51.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:51.896+0000 7f191915d700 1 -- 172.21.15.32:0/2771174541 wait complete. 2023-10-14T12:19:51.906 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:19:51.909 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-14T12:19:51.111907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224368,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750352,"statfs":{"total":773094113280,"available":772864360448,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451175+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:45.451175+0000","last_peered":"2023-10-14T12:19:45.451175+0000","last_clean":"2023-10-14T12:19:45.451175+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:45.451175+0000","last_undegraded":"2023-10-14T12:19:45.451175+0000","last_fullsized":"2023-10-14T12:19:45.451175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:27.468407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374519+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:44.374519+0000","last_peered":"2023-10-14T12:19:44.374519+0000","last_clean":"2023-10-14T12:19:44.374519+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:44.374519+0000","last_undegraded":"2023-10-14T12:19:44.374519+0000","last_fullsized":"2023-10-14T12:19:44.374519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374280+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:44.374280+0000","last_peered":"2023-10-14T12:19:44.374280+0000","last_clean":"2023-10-14T12:19:44.374280+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:44.374280+0000","last_undegraded":"2023-10-14T12:19:44.374280+0000","last_fullsized":"2023-10-14T12:19:44.374280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452113+0000","last_change":"2023-10-14T12:19:43.390887+0000","last_active":"2023-10-14T12:19:45.452113+0000","last_peered":"2023-10-14T12:19:45.452113+0000","last_clean":"2023-10-14T12:19:45.452113+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:19:45.452113+0000","last_undegraded":"2023-10-14T12:19:45.452113+0000","last_fullsized":"2023-10-14T12:19:45.452113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370444+0000","last_change":"2023-10-14T12:19:43.379488+0000","last_active":"2023-10-14T12:19:44.370444+0000","last_peered":"2023-10-14T12:19:44.370444+0000","last_clean":"2023-10-14T12:19:44.370444+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:19:44.370444+0000","last_undegraded":"2023-10-14T12:19:44.370444+0000","last_fullsized":"2023-10-14T12:19:44.370444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374228+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:44.374228+0000","last_peered":"2023-10-14T12:19:44.374228+0000","last_clean":"2023-10-14T12:19:44.374228+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:44.374228+0000","last_undegraded":"2023-10-14T12:19:44.374228+0000","last_fullsized":"2023-10-14T12:19:44.374228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950553+0000","last_change":"2023-10-14T12:19:43.381841+0000","last_active":"2023-10-14T12:19:44.950553+0000","last_peered":"2023-10-14T12:19:44.950553+0000","last_clean":"2023-10-14T12:19:44.950553+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:19:44.950553+0000","last_undegraded":"2023-10-14T12:19:44.950553+0000","last_fullsized":"2023-10-14T12:19:44.950553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950418+0000","last_change":"2023-10-14T12:19:43.382639+0000","last_active":"2023-10-14T12:19:44.950418+0000","last_peered":"2023-10-14T12:19:44.950418+0000","last_clean":"2023-10-14T12:19:44.950418+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:19:44.950418+0000","last_undegraded":"2023-10-14T12:19:44.950418+0000","last_fullsized":"2023-10-14T12:19:44.950418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452065+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:45.452065+0000","last_peered":"2023-10-14T12:19:45.452065+0000","last_clean":"2023-10-14T12:19:45.452065+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:45.452065+0000","last_undegraded":"2023-10-14T12:19:45.452065+0000","last_fullsized":"2023-10-14T12:19:45.452065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452529+0000","last_change":"2023-10-14T12:19:43.382683+0000","last_active":"2023-10-14T12:19:45.452529+0000","last_peered":"2023-10-14T12:19:45.452529+0000","last_clean":"2023-10-14T12:19:45.452529+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:19:45.452529+0000","last_undegraded":"2023-10-14T12:19:45.452529+0000","last_fullsized":"2023-10-14T12:19:45.452529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950759+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:44.950759+0000","last_peered":"2023-10-14T12:19:44.950759+0000","last_clean":"2023-10-14T12:19:44.950759+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:44.950759+0000","last_undegraded":"2023-10-14T12:19:44.950759+0000","last_fullsized":"2023-10-14T12:19:44.950759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374556+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:44.374556+0000","last_peered":"2023-10-14T12:19:44.374556+0000","last_clean":"2023-10-14T12:19:44.374556+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:44.374556+0000","last_undegraded":"2023-10-14T12:19:44.374556+0000","last_fullsized":"2023-10-14T12:19:44.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370587+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:44.370587+0000","last_peered":"2023-10-14T12:19:44.370587+0000","last_clean":"2023-10-14T12:19:44.370587+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:44.370587+0000","last_undegraded":"2023-10-14T12:19:44.370587+0000","last_fullsized":"2023-10-14T12:19:44.370587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374251+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:44.374251+0000","last_peered":"2023-10-14T12:19:44.374251+0000","last_clean":"2023-10-14T12:19:44.374251+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:44.374251+0000","last_undegraded":"2023-10-14T12:19:44.374251+0000","last_fullsized":"2023-10-14T12:19:44.374251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374071+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:44.374071+0000","last_peered":"2023-10-14T12:19:44.374071+0000","last_clean":"2023-10-14T12:19:44.374071+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:44.374071+0000","last_undegraded":"2023-10-14T12:19:44.374071+0000","last_fullsized":"2023-10-14T12:19:44.374071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950717+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:44.950717+0000","last_peered":"2023-10-14T12:19:44.950717+0000","last_clean":"2023-10-14T12:19:44.950717+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:44.950717+0000","last_undegraded":"2023-10-14T12:19:44.950717+0000","last_fullsized":"2023-10-14T12:19:44.950717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.951014+0000","last_change":"2023-10-14T12:19:43.381288+0000","last_active":"2023-10-14T12:19:44.951014+0000","last_peered":"2023-10-14T12:19:44.951014+0000","last_clean":"2023-10-14T12:19:44.951014+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:19:44.951014+0000","last_undegraded":"2023-10-14T12:19:44.951014+0000","last_fullsized":"2023-10-14T12:19:44.951014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374498+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:44.374498+0000","last_peered":"2023-10-14T12:19:44.374498+0000","last_clean":"2023-10-14T12:19:44.374498+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:44.374498+0000","last_undegraded":"2023-10-14T12:19:44.374498+0000","last_fullsized":"2023-10-14T12:19:44.374498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374414+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:44.374414+0000","last_peered":"2023-10-14T12:19:44.374414+0000","last_clean":"2023-10-14T12:19:44.374414+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:44.374414+0000","last_undegraded":"2023-10-14T12:19:44.374414+0000","last_fullsized":"2023-10-14T12:19:44.374414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370717+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:44.370717+0000","last_peered":"2023-10-14T12:19:44.370717+0000","last_clean":"2023-10-14T12:19:44.370717+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:44.370717+0000","last_undegraded":"2023-10-14T12:19:44.370717+0000","last_fullsized":"2023-10-14T12:19:44.370717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451563+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:45.451563+0000","last_peered":"2023-10-14T12:19:45.451563+0000","last_clean":"2023-10-14T12:19:45.451563+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:45.451563+0000","last_undegraded":"2023-10-14T12:19:45.451563+0000","last_fullsized":"2023-10-14T12:19:45.451563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451538+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:45.451538+0000","last_peered":"2023-10-14T12:19:45.451538+0000","last_clean":"2023-10-14T12:19:45.451538+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:45.451538+0000","last_undegraded":"2023-10-14T12:19:45.451538+0000","last_fullsized":"2023-10-14T12:19:45.451538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451481+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:45.451481+0000","last_peered":"2023-10-14T12:19:45.451481+0000","last_clean":"2023-10-14T12:19:45.451481+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:19:45.451481+0000","last_undegraded":"2023-10-14T12:19:45.451481+0000","last_fullsized":"2023-10-14T12:19:45.451481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374009+0000","last_change":"2023-10-14T12:19:43.381941+0000","last_active":"2023-10-14T12:19:44.374009+0000","last_peered":"2023-10-14T12:19:44.374009+0000","last_clean":"2023-10-14T12:19:44.374009+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:19:44.374009+0000","last_undegraded":"2023-10-14T12:19:44.374009+0000","last_fullsized":"2023-10-14T12:19:44.374009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452578+0000","last_change":"2023-10-14T12:19:43.382954+0000","last_active":"2023-10-14T12:19:45.452578+0000","last_peered":"2023-10-14T12:19:45.452578+0000","last_clean":"2023-10-14T12:19:45.452578+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:19:45.452578+0000","last_undegraded":"2023-10-14T12:19:45.452578+0000","last_fullsized":"2023-10-14T12:19:45.452578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374673+0000","last_change":"2023-10-14T12:19:43.380761+0000","last_active":"2023-10-14T12:19:44.374673+0000","last_peered":"2023-10-14T12:19:44.374673+0000","last_clean":"2023-10-14T12:19:44.374673+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:44.374673+0000","last_undegraded":"2023-10-14T12:19:44.374673+0000","last_fullsized":"2023-10-14T12:19:44.374673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:17.111399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452237+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:45.452237+0000","last_peered":"2023-10-14T12:19:45.452237+0000","last_clean":"2023-10-14T12:19:45.452237+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:45.452237+0000","last_undegraded":"2023-10-14T12:19:45.452237+0000","last_fullsized":"2023-10-14T12:19:45.452237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374585+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:44.374585+0000","last_peered":"2023-10-14T12:19:44.374585+0000","last_clean":"2023-10-14T12:19:44.374585+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:44.374585+0000","last_undegraded":"2023-10-14T12:19:44.374585+0000","last_fullsized":"2023-10-14T12:19:44.374585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451575+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:45.451575+0000","last_peered":"2023-10-14T12:19:45.451575+0000","last_clean":"2023-10-14T12:19:45.451575+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:45.451575+0000","last_undegraded":"2023-10-14T12:19:45.451575+0000","last_fullsized":"2023-10-14T12:19:45.451575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:38.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950548+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:44.950548+0000","last_peered":"2023-10-14T12:19:44.950548+0000","last_clean":"2023-10-14T12:19:44.950548+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:44.950548+0000","last_undegraded":"2023-10-14T12:19:44.950548+0000","last_fullsized":"2023-10-14T12:19:44.950548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451213+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:45.451213+0000","last_peered":"2023-10-14T12:19:45.451213+0000","last_clean":"2023-10-14T12:19:45.451213+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:45.451213+0000","last_undegraded":"2023-10-14T12:19:45.451213+0000","last_fullsized":"2023-10-14T12:19:45.451213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:25.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950873+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:44.950873+0000","last_peered":"2023-10-14T12:19:44.950873+0000","last_clean":"2023-10-14T12:19:44.950873+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:44.950873+0000","last_undegraded":"2023-10-14T12:19:44.950873+0000","last_fullsized":"2023-10-14T12:19:44.950873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451526+0000","last_change":"2023-10-14T12:19:43.393781+0000","last_active":"2023-10-14T12:19:45.451526+0000","last_peered":"2023-10-14T12:19:45.451526+0000","last_clean":"2023-10-14T12:19:45.451526+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:19:45.451526+0000","last_undegraded":"2023-10-14T12:19:45.451526+0000","last_fullsized":"2023-10-14T12:19:45.451526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179754+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:45.179754+0000","last_peered":"2023-10-14T12:19:45.179754+0000","last_clean":"2023-10-14T12:19:45.179754+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:45.179754+0000","last_undegraded":"2023-10-14T12:19:45.179754+0000","last_fullsized":"2023-10-14T12:19:45.179754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:14.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451254+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:45.451254+0000","last_peered":"2023-10-14T12:19:45.451254+0000","last_clean":"2023-10-14T12:19:45.451254+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:45.451254+0000","last_undegraded":"2023-10-14T12:19:45.451254+0000","last_fullsized":"2023-10-14T12:19:45.451254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250696+0000","last_change":"2023-10-14T12:19:42.374484+0000","last_active":"2023-10-14T12:19:45.250696+0000","last_peered":"2023-10-14T12:19:45.250696+0000","last_clean":"2023-10-14T12:19:45.250696+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:19:45.250696+0000","last_undegraded":"2023-10-14T12:19:45.250696+0000","last_fullsized":"2023-10-14T12:19:45.250696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451711+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:45.451711+0000","last_peered":"2023-10-14T12:19:45.451711+0000","last_clean":"2023-10-14T12:19:45.451711+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:45.451711+0000","last_undegraded":"2023-10-14T12:19:45.451711+0000","last_fullsized":"2023-10-14T12:19:45.451711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374493+0000","last_change":"2023-10-14T12:19:42.374263+0000","last_active":"2023-10-14T12:19:44.374493+0000","last_peered":"2023-10-14T12:19:44.374493+0000","last_clean":"2023-10-14T12:19:44.374493+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:19:44.374493+0000","last_undegraded":"2023-10-14T12:19:44.374493+0000","last_fullsized":"2023-10-14T12:19:44.374493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:59.390912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452292+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:45.452292+0000","last_peered":"2023-10-14T12:19:45.452292+0000","last_clean":"2023-10-14T12:19:45.452292+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:45.452292+0000","last_undegraded":"2023-10-14T12:19:45.452292+0000","last_fullsized":"2023-10-14T12:19:45.452292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370652+0000","last_change":"2023-10-14T12:19:42.377643+0000","last_active":"2023-10-14T12:19:44.370652+0000","last_peered":"2023-10-14T12:19:44.370652+0000","last_clean":"2023-10-14T12:19:44.370652+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:44.370652+0000","last_undegraded":"2023-10-14T12:19:44.370652+0000","last_fullsized":"2023-10-14T12:19:44.370652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:00.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950565+0000","last_change":"2023-10-14T12:19:43.389426+0000","last_active":"2023-10-14T12:19:44.950565+0000","last_peered":"2023-10-14T12:19:44.950565+0000","last_clean":"2023-10-14T12:19:44.950565+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:19:44.950565+0000","last_undegraded":"2023-10-14T12:19:44.950565+0000","last_fullsized":"2023-10-14T12:19:44.950565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179883+0000","last_change":"2023-10-14T12:19:42.375646+0000","last_active":"2023-10-14T12:19:45.179883+0000","last_peered":"2023-10-14T12:19:45.179883+0000","last_clean":"2023-10-14T12:19:45.179883+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:19:45.179883+0000","last_undegraded":"2023-10-14T12:19:45.179883+0000","last_fullsized":"2023-10-14T12:19:45.179883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374300+0000","last_change":"2023-10-14T12:19:43.390502+0000","last_active":"2023-10-14T12:19:44.374300+0000","last_peered":"2023-10-14T12:19:44.374300+0000","last_clean":"2023-10-14T12:19:44.374300+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:19:44.374300+0000","last_undegraded":"2023-10-14T12:19:44.374300+0000","last_fullsized":"2023-10-14T12:19:44.374300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179837+0000","last_change":"2023-10-14T12:19:42.375014+0000","last_active":"2023-10-14T12:19:45.179837+0000","last_peered":"2023-10-14T12:19:45.179837+0000","last_clean":"2023-10-14T12:19:45.179837+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:19:45.179837+0000","last_undegraded":"2023-10-14T12:19:45.179837+0000","last_fullsized":"2023-10-14T12:19:45.179837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:36.593916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451210+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:45.451210+0000","last_peered":"2023-10-14T12:19:45.451210+0000","last_clean":"2023-10-14T12:19:45.451210+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:45.451210+0000","last_undegraded":"2023-10-14T12:19:45.451210+0000","last_fullsized":"2023-10-14T12:19:45.451210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373966+0000","last_change":"2023-10-14T12:19:42.373819+0000","last_active":"2023-10-14T12:19:44.373966+0000","last_peered":"2023-10-14T12:19:44.373966+0000","last_clean":"2023-10-14T12:19:44.373966+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:19:44.373966+0000","last_undegraded":"2023-10-14T12:19:44.373966+0000","last_fullsized":"2023-10-14T12:19:44.373966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451313+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:45.451313+0000","last_peered":"2023-10-14T12:19:45.451313+0000","last_clean":"2023-10-14T12:19:45.451313+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:45.451313+0000","last_undegraded":"2023-10-14T12:19:45.451313+0000","last_fullsized":"2023-10-14T12:19:45.451313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179741+0000","last_change":"2023-10-14T12:19:42.372089+0000","last_active":"2023-10-14T12:19:45.179741+0000","last_peered":"2023-10-14T12:19:45.179741+0000","last_clean":"2023-10-14T12:19:45.179741+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:19:45.179741+0000","last_undegraded":"2023-10-14T12:19:45.179741+0000","last_fullsized":"2023-10-14T12:19:45.179741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:22.438051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374586+0000","last_change":"2023-10-14T12:19:43.382324+0000","last_active":"2023-10-14T12:19:44.374586+0000","last_peered":"2023-10-14T12:19:44.374586+0000","last_clean":"2023-10-14T12:19:44.374586+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:19:44.374586+0000","last_undegraded":"2023-10-14T12:19:44.374586+0000","last_fullsized":"2023-10-14T12:19:44.374586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374708+0000","last_change":"2023-10-14T12:19:42.372382+0000","last_active":"2023-10-14T12:19:44.374708+0000","last_peered":"2023-10-14T12:19:44.374708+0000","last_clean":"2023-10-14T12:19:44.374708+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:19:44.374708+0000","last_undegraded":"2023-10-14T12:19:44.374708+0000","last_fullsized":"2023-10-14T12:19:44.374708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374844+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:44.374844+0000","last_peered":"2023-10-14T12:19:44.374844+0000","last_clean":"2023-10-14T12:19:44.374844+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:44.374844+0000","last_undegraded":"2023-10-14T12:19:44.374844+0000","last_fullsized":"2023-10-14T12:19:44.374844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:47:38.320770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250724+0000","last_change":"2023-10-14T12:19:42.376458+0000","last_active":"2023-10-14T12:19:45.250724+0000","last_peered":"2023-10-14T12:19:45.250724+0000","last_clean":"2023-10-14T12:19:45.250724+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:19:45.250724+0000","last_undegraded":"2023-10-14T12:19:45.250724+0000","last_fullsized":"2023-10-14T12:19:45.250724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374529+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:44.374529+0000","last_peered":"2023-10-14T12:19:44.374529+0000","last_clean":"2023-10-14T12:19:44.374529+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:44.374529+0000","last_undegraded":"2023-10-14T12:19:44.374529+0000","last_fullsized":"2023-10-14T12:19:44.374529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374572+0000","last_change":"2023-10-14T12:19:42.373797+0000","last_active":"2023-10-14T12:19:44.374572+0000","last_peered":"2023-10-14T12:19:44.374572+0000","last_clean":"2023-10-14T12:19:44.374572+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:19:44.374572+0000","last_undegraded":"2023-10-14T12:19:44.374572+0000","last_fullsized":"2023-10-14T12:19:44.374572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:21.195047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374459+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:44.374459+0000","last_peered":"2023-10-14T12:19:44.374459+0000","last_clean":"2023-10-14T12:19:44.374459+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:44.374459+0000","last_undegraded":"2023-10-14T12:19:44.374459+0000","last_fullsized":"2023-10-14T12:19:44.374459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374488+0000","last_change":"2023-10-14T12:19:42.371158+0000","last_active":"2023-10-14T12:19:44.374488+0000","last_peered":"2023-10-14T12:19:44.374488+0000","last_clean":"2023-10-14T12:19:44.374488+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:19:44.374488+0000","last_undegraded":"2023-10-14T12:19:44.374488+0000","last_fullsized":"2023-10-14T12:19:44.374488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:24.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451638+0000","last_change":"2023-10-14T12:19:43.380181+0000","last_active":"2023-10-14T12:19:45.451638+0000","last_peered":"2023-10-14T12:19:45.451638+0000","last_clean":"2023-10-14T12:19:45.451638+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:19:45.451638+0000","last_undegraded":"2023-10-14T12:19:45.451638+0000","last_fullsized":"2023-10-14T12:19:45.451638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179895+0000","last_change":"2023-10-14T12:19:42.373775+0000","last_active":"2023-10-14T12:19:45.179895+0000","last_peered":"2023-10-14T12:19:45.179895+0000","last_clean":"2023-10-14T12:19:45.179895+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:19:45.179895+0000","last_undegraded":"2023-10-14T12:19:45.179895+0000","last_fullsized":"2023-10-14T12:19:45.179895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374439+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:44.374439+0000","last_peered":"2023-10-14T12:19:44.374439+0000","last_clean":"2023-10-14T12:19:44.374439+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:44.374439+0000","last_undegraded":"2023-10-14T12:19:44.374439+0000","last_fullsized":"2023-10-14T12:19:44.374439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173778+0000","last_change":"2023-10-14T12:19:42.373838+0000","last_active":"2023-10-14T12:19:45.173778+0000","last_peered":"2023-10-14T12:19:45.173778+0000","last_clean":"2023-10-14T12:19:45.173778+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:19:45.173778+0000","last_undegraded":"2023-10-14T12:19:45.173778+0000","last_fullsized":"2023-10-14T12:19:45.173778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950851+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:44.950851+0000","last_peered":"2023-10-14T12:19:44.950851+0000","last_clean":"2023-10-14T12:19:44.950851+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:44.950851+0000","last_undegraded":"2023-10-14T12:19:44.950851+0000","last_fullsized":"2023-10-14T12:19:44.950851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374044+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:44.374044+0000","last_peered":"2023-10-14T12:19:44.374044+0000","last_clean":"2023-10-14T12:19:44.374044+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:44.374044+0000","last_undegraded":"2023-10-14T12:19:44.374044+0000","last_fullsized":"2023-10-14T12:19:44.374044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451127+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:45.451127+0000","last_peered":"2023-10-14T12:19:45.451127+0000","last_clean":"2023-10-14T12:19:45.451127+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:45.451127+0000","last_undegraded":"2023-10-14T12:19:45.451127+0000","last_fullsized":"2023-10-14T12:19:45.451127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:31.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374022+0000","last_change":"2023-10-14T12:19:42.373204+0000","last_active":"2023-10-14T12:19:44.374022+0000","last_peered":"2023-10-14T12:19:44.374022+0000","last_clean":"2023-10-14T12:19:44.374022+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:19:44.374022+0000","last_undegraded":"2023-10-14T12:19:44.374022+0000","last_fullsized":"2023-10-14T12:19:44.374022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:40.688686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451830+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:45.451830+0000","last_peered":"2023-10-14T12:19:45.451830+0000","last_clean":"2023-10-14T12:19:45.451830+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:45.451830+0000","last_undegraded":"2023-10-14T12:19:45.451830+0000","last_fullsized":"2023-10-14T12:19:45.451830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173941+0000","last_change":"2023-10-14T12:19:42.376646+0000","last_active":"2023-10-14T12:19:45.173941+0000","last_peered":"2023-10-14T12:19:45.173941+0000","last_clean":"2023-10-14T12:19:45.173941+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:19:45.173941+0000","last_undegraded":"2023-10-14T12:19:45.173941+0000","last_fullsized":"2023-10-14T12:19:45.173941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:37.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374521+0000","last_change":"2023-10-14T12:19:43.388112+0000","last_active":"2023-10-14T12:19:44.374521+0000","last_peered":"2023-10-14T12:19:44.374521+0000","last_clean":"2023-10-14T12:19:44.374521+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:19:44.374521+0000","last_undegraded":"2023-10-14T12:19:44.374521+0000","last_fullsized":"2023-10-14T12:19:44.374521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179959+0000","last_change":"2023-10-14T12:19:42.373858+0000","last_active":"2023-10-14T12:19:45.179959+0000","last_peered":"2023-10-14T12:19:45.179959+0000","last_clean":"2023-10-14T12:19:45.179959+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:19:45.179959+0000","last_undegraded":"2023-10-14T12:19:45.179959+0000","last_fullsized":"2023-10-14T12:19:45.179959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452035+0000","last_change":"2023-10-14T12:19:43.388334+0000","last_active":"2023-10-14T12:19:45.452035+0000","last_peered":"2023-10-14T12:19:45.452035+0000","last_clean":"2023-10-14T12:19:45.452035+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:19:45.452035+0000","last_undegraded":"2023-10-14T12:19:45.452035+0000","last_fullsized":"2023-10-14T12:19:45.452035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179931+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:45.179931+0000","last_peered":"2023-10-14T12:19:45.179931+0000","last_clean":"2023-10-14T12:19:45.179931+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:45.179931+0000","last_undegraded":"2023-10-14T12:19:45.179931+0000","last_fullsized":"2023-10-14T12:19:45.179931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:12.099355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370543+0000","last_change":"2023-10-14T12:19:43.384205+0000","last_active":"2023-10-14T12:19:44.370543+0000","last_peered":"2023-10-14T12:19:44.370543+0000","last_clean":"2023-10-14T12:19:44.370543+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:19:44.370543+0000","last_undegraded":"2023-10-14T12:19:44.370543+0000","last_fullsized":"2023-10-14T12:19:44.370543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:37.599241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179917+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:45.179917+0000","last_peered":"2023-10-14T12:19:45.179917+0000","last_clean":"2023-10-14T12:19:45.179917+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:45.179917+0000","last_undegraded":"2023-10-14T12:19:45.179917+0000","last_fullsized":"2023-10-14T12:19:45.179917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:19.606346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370619+0000","last_change":"2023-10-14T12:19:43.388769+0000","last_active":"2023-10-14T12:19:44.370619+0000","last_peered":"2023-10-14T12:19:44.370619+0000","last_clean":"2023-10-14T12:19:44.370619+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:19:44.370619+0000","last_undegraded":"2023-10-14T12:19:44.370619+0000","last_fullsized":"2023-10-14T12:19:44.370619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250596+0000","last_change":"2023-10-14T12:19:42.378784+0000","last_active":"2023-10-14T12:19:45.250596+0000","last_peered":"2023-10-14T12:19:45.250596+0000","last_clean":"2023-10-14T12:19:45.250596+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:45.250596+0000","last_undegraded":"2023-10-14T12:19:45.250596+0000","last_fullsized":"2023-10-14T12:19:45.250596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370513+0000","last_change":"2023-10-14T12:19:43.390194+0000","last_active":"2023-10-14T12:19:44.370513+0000","last_peered":"2023-10-14T12:19:44.370513+0000","last_clean":"2023-10-14T12:19:44.370513+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:19:44.370513+0000","last_undegraded":"2023-10-14T12:19:44.370513+0000","last_fullsized":"2023-10-14T12:19:44.370513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:13.104681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179660+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:45.179660+0000","last_peered":"2023-10-14T12:19:45.179660+0000","last_clean":"2023-10-14T12:19:45.179660+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:45.179660+0000","last_undegraded":"2023-10-14T12:19:45.179660+0000","last_fullsized":"2023-10-14T12:19:45.179660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370406+0000","last_change":"2023-10-14T12:19:43.382787+0000","last_active":"2023-10-14T12:19:44.370406+0000","last_peered":"2023-10-14T12:19:44.370406+0000","last_clean":"2023-10-14T12:19:44.370406+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:19:44.370406+0000","last_undegraded":"2023-10-14T12:19:44.370406+0000","last_fullsized":"2023-10-14T12:19:44.370406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179805+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:45.179805+0000","last_peered":"2023-10-14T12:19:45.179805+0000","last_clean":"2023-10-14T12:19:45.179805+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:45.179805+0000","last_undegraded":"2023-10-14T12:19:45.179805+0000","last_fullsized":"2023-10-14T12:19:45.179805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:17.650999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950643+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:44.950643+0000","last_peered":"2023-10-14T12:19:44.950643+0000","last_clean":"2023-10-14T12:19:44.950643+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:44.950643+0000","last_undegraded":"2023-10-14T12:19:44.950643+0000","last_fullsized":"2023-10-14T12:19:44.950643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373934+0000","last_change":"2023-10-14T12:19:42.377594+0000","last_active":"2023-10-14T12:19:44.373934+0000","last_peered":"2023-10-14T12:19:44.373934+0000","last_clean":"2023-10-14T12:19:44.373934+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:44.373934+0000","last_undegraded":"2023-10-14T12:19:44.373934+0000","last_fullsized":"2023-10-14T12:19:44.373934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370575+0000","last_change":"2023-10-14T12:19:43.388662+0000","last_active":"2023-10-14T12:19:44.370575+0000","last_peered":"2023-10-14T12:19:44.370575+0000","last_clean":"2023-10-14T12:19:44.370575+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:19:44.370575+0000","last_undegraded":"2023-10-14T12:19:44.370575+0000","last_fullsized":"2023-10-14T12:19:44.370575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:20.611672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173898+0000","last_change":"2023-10-14T12:19:42.377243+0000","last_active":"2023-10-14T12:19:45.173898+0000","last_peered":"2023-10-14T12:19:45.173898+0000","last_clean":"2023-10-14T12:19:45.173898+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:19:45.173898+0000","last_undegraded":"2023-10-14T12:19:45.173898+0000","last_fullsized":"2023-10-14T12:19:45.173898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:55.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374463+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:44.374463+0000","last_peered":"2023-10-14T12:19:44.374463+0000","last_clean":"2023-10-14T12:19:44.374463+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:44.374463+0000","last_undegraded":"2023-10-14T12:19:44.374463+0000","last_fullsized":"2023-10-14T12:19:44.374463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451670+0000","last_change":"2023-10-14T12:19:42.378619+0000","last_active":"2023-10-14T12:19:45.451670+0000","last_peered":"2023-10-14T12:19:45.451670+0000","last_clean":"2023-10-14T12:19:45.451670+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:19:45.451670+0000","last_undegraded":"2023-10-14T12:19:45.451670+0000","last_fullsized":"2023-10-14T12:19:45.451670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451627+0000","last_change":"2023-10-14T12:19:43.389128+0000","last_active":"2023-10-14T12:19:45.451627+0000","last_peered":"2023-10-14T12:19:45.451627+0000","last_clean":"2023-10-14T12:19:45.451627+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:19:45.451627+0000","last_undegraded":"2023-10-14T12:19:45.451627+0000","last_fullsized":"2023-10-14T12:19:45.451627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173817+0000","last_change":"2023-10-14T12:19:42.371259+0000","last_active":"2023-10-14T12:19:45.173817+0000","last_peered":"2023-10-14T12:19:45.173817+0000","last_clean":"2023-10-14T12:19:45.173817+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:19:45.173817+0000","last_undegraded":"2023-10-14T12:19:45.173817+0000","last_fullsized":"2023-10-14T12:19:45.173817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:34.980122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451233+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:45.451233+0000","last_peered":"2023-10-14T12:19:45.451233+0000","last_clean":"2023-10-14T12:19:45.451233+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:45.451233+0000","last_undegraded":"2023-10-14T12:19:45.451233+0000","last_fullsized":"2023-10-14T12:19:45.451233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250581+0000","last_change":"2023-10-14T12:19:42.371970+0000","last_active":"2023-10-14T12:19:45.250581+0000","last_peered":"2023-10-14T12:19:45.250581+0000","last_clean":"2023-10-14T12:19:45.250581+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:45.250581+0000","last_undegraded":"2023-10-14T12:19:45.250581+0000","last_fullsized":"2023-10-14T12:19:45.250581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:17.853714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451947+0000","last_change":"2023-10-14T12:19:43.388360+0000","last_active":"2023-10-14T12:19:45.451947+0000","last_peered":"2023-10-14T12:19:45.451947+0000","last_clean":"2023-10-14T12:19:45.451947+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:19:45.451947+0000","last_undegraded":"2023-10-14T12:19:45.451947+0000","last_fullsized":"2023-10-14T12:19:45.451947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173792+0000","last_change":"2023-10-14T12:19:42.376964+0000","last_active":"2023-10-14T12:19:45.173792+0000","last_peered":"2023-10-14T12:19:45.173792+0000","last_clean":"2023-10-14T12:19:45.173792+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:45.173792+0000","last_undegraded":"2023-10-14T12:19:45.173792+0000","last_fullsized":"2023-10-14T12:19:45.173792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:34.064338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374083+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:44.374083+0000","last_peered":"2023-10-14T12:19:44.374083+0000","last_clean":"2023-10-14T12:19:44.374083+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:44.374083+0000","last_undegraded":"2023-10-14T12:19:44.374083+0000","last_fullsized":"2023-10-14T12:19:44.374083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179816+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:45.179816+0000","last_peered":"2023-10-14T12:19:45.179816+0000","last_clean":"2023-10-14T12:19:45.179816+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:45.179816+0000","last_undegraded":"2023-10-14T12:19:45.179816+0000","last_fullsized":"2023-10-14T12:19:45.179816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:09.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451226+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:45.451226+0000","last_peered":"2023-10-14T12:19:45.451226+0000","last_clean":"2023-10-14T12:19:45.451226+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:45.451226+0000","last_undegraded":"2023-10-14T12:19:45.451226+0000","last_fullsized":"2023-10-14T12:19:45.451226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373897+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:44.373897+0000","last_peered":"2023-10-14T12:19:44.373897+0000","last_clean":"2023-10-14T12:19:44.373897+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:44.373897+0000","last_undegraded":"2023-10-14T12:19:44.373897+0000","last_fullsized":"2023-10-14T12:19:44.373897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:51.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950724+0000","last_change":"2023-10-14T12:19:43.385662+0000","last_active":"2023-10-14T12:19:44.950724+0000","last_peered":"2023-10-14T12:19:44.950724+0000","last_clean":"2023-10-14T12:19:44.950724+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:19:44.950724+0000","last_undegraded":"2023-10-14T12:19:44.950724+0000","last_fullsized":"2023-10-14T12:19:44.950724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179683+0000","last_change":"2023-10-14T12:19:42.371684+0000","last_active":"2023-10-14T12:19:45.179683+0000","last_peered":"2023-10-14T12:19:45.179683+0000","last_clean":"2023-10-14T12:19:45.179683+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:45.179683+0000","last_undegraded":"2023-10-14T12:19:45.179683+0000","last_fullsized":"2023-10-14T12:19:45.179683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:56.045404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373248+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:19:43.373248+0000","last_peered":"2023-10-14T12:19:43.373248+0000","last_clean":"2023-10-14T12:19:43.373248+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:19:43.373248+0000","last_undegraded":"2023-10-14T12:19:43.373248+0000","last_fullsized":"2023-10-14T12:19:43.373248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.624},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73499999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.629}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29799999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.41199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.376},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.443}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.496},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.375},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.751},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.746},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:19:51.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:19:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.072+0000 7fbd0d9f1700 1 Processor -- start 2023-10-14T12:19:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.072+0000 7fbd0d9f1700 1 -- start start 2023-10-14T12:19:52.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.073+0000 7fbd0d9f1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 0x7fbd080cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.073+0000 7fbd0d9f1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0815e7a0 con 0x7fbd0815ab10 2023-10-14T12:19:52.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.073+0000 7fbd0d9f1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080b29a0 con 0x7fbd0815f1f0 2023-10-14T12:19:52.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.073+0000 7fbd0d9f1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080b2c80 con 0x7fbd080cfe30 2023-10-14T12:19:52.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.073+0000 7fbd06ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbd0815ab10 0x7fbd080b1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57072/0 (socket says 172.21.15.32:57072) 2023-10-14T12:19:52.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.073+0000 7fbd06ffd700 1 -- 172.21.15.32:0/586391427 learned_addr learned my addr 172.21.15.32:0/586391427 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:52.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd077fe700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 0x7fbd080cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694700846 0 0) 0x7fbd0815e7a0 con 0x7fbd0815ab10 2023-10-14T12:19:52.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf00035b0 con 0x7fbd0815ab10 2023-10-14T12:19:52.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077183638 0 0) 0x7fbcf00035b0 con 0x7fbd0815ab10 2023-10-14T12:19:52.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 msgr2=0x7fbd080cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:52.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 0x7fbd080cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 >> v1:172.21.15.92:6789/0 conn(0x7fbd0815f1f0 legacy=0x7fbd080cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0815e9f0 con 0x7fbd0815ab10 2023-10-14T12:19:52.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7fbcf8001670 con 0x7fbd0815ab10 2023-10-14T12:19:52.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 >> v1:172.21.15.32:6789/0 conn(0x7fbd0815ab10 legacy=0x7fbd080b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbcf0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 0x7fbcf0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcf0004d90 0x7fbcf0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080b2c80 con 0x7fbcf0003a30 2023-10-14T12:19:52.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf000ba40 con 0x7fbcf0004d90 2023-10-14T12:19:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf000de10 con 0x7fbd080cfe30 2023-10-14T12:19:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbcf0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd067fc700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 0x7fbcf0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd077fe700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcf0004d90 0x7fbcf0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd06ffd700 1 -- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 msgr2=0x7fbcf0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:52.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd080cfe30 0x7fbcf0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd06ffd700 1 -- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcf0004d90 msgr2=0x7fbcf0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:52.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcf0004d90 0x7fbcf0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.074+0000 7fbd06ffd700 1 -- 172.21.15.32:0/586391427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00035b0 con 0x7fbcf0003a30 2023-10-14T12:19:52.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbcf0003e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c2f0 tx=0x7fbcf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ba223efb5679fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800cd70 con 0x7fbcf0003a30 2023-10-14T12:19:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8005960 con 0x7fbcf0003a30 2023-10-14T12:19:52.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd05ffb700 1 -- 172.21.15.32:0/586391427 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8005cf0 con 0x7fbcf0003a30 2023-10-14T12:19:52.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/586391427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 msgr2=0x7fbcf0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/586391427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbcf0003e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c2f0 tx=0x7fbcf0005880 comp rx=0 tx=0).stop 2023-10-14T12:19:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd077fe700 1 -- 172.21.15.32:0/586391427 reap_dead start 2023-10-14T12:19:52.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/586391427 shutdown_connections 2023-10-14T12:19:52.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/586391427 >> 172.21.15.32:0/586391427 conn(0x7fbd0806dae0 msgr2=0x7fbd0806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/586391427 shutdown_connections 2023-10-14T12:19:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.075+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/586391427 wait complete. 2023-10-14T12:19:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.076+0000 7fbd0d9f1700 1 Processor -- start 2023-10-14T12:19:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 -- start start 2023-10-14T12:19:52.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbd081569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd081f35a0 0x7fbd080cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd080cd670 0x7fbd080c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c92f0 con 0x7fbcf0003a30 2023-10-14T12:19:52.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c72d0 con 0x7fbd080cd670 2023-10-14T12:19:52.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.077+0000 7fbd0d9f1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080cdb00 con 0x7fbd081f35a0 2023-10-14T12:19:52.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbd081569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbd081569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40060/0 (socket says 172.21.15.32:40060) 2023-10-14T12:19:52.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 -- 172.21.15.32:0/1282280477 learned_addr learned my addr 172.21.15.32:0/1282280477 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:52.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd067fc700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd081f35a0 0x7fbd080cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 -- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd081f35a0 msgr2=0x7fbd080cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd081f35a0 0x7fbd080cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 -- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd080cd670 msgr2=0x7fbd080c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd077fe700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd080cd670 0x7fbd080c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd080cd670 0x7fbd080c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 -- 172.21.15.32:0/1282280477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080c8490 con 0x7fbcf0003a30 2023-10-14T12:19:52.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd06ffd700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbd081569d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000ba10 tx=0x7fbcf8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8004a80 con 0x7fbcf0003a30 2023-10-14T12:19:52.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8004c00 con 0x7fbcf0003a30 2023-10-14T12:19:52.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd08156f10 con 0x7fbcf0003a30 2023-10-14T12:19:52.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80070d0 con 0x7fbcf0003a30 2023-10-14T12:19:52.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.078+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd081f2ac0 con 0x7fbcf0003a30 2023-10-14T12:19:52.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.079+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd080afc10 con 0x7fbcf0003a30 2023-10-14T12:19:52.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.080+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbcf8007230 con 0x7fbcf0003a30 2023-10-14T12:19:52.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.080+0000 7fbceffff700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbcf406af00 0x7fbcf406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.080+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbcf808aa80 con 0x7fbcf0003a30 2023-10-14T12:19:52.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.080+0000 7fbd067fc700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbcf406af00 0x7fbcf406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.081+0000 7fbd067fc700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbcf406af00 0x7fbcf406d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc005660 tx=0x7fbcfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.084+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbcf8055d80 con 0x7fbcf0003a30 2023-10-14T12:19:52.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.282+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd0815f6a0 con 0x7fbcf406af00 2023-10-14T12:19:52.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.290+0000 7fbceffff700 1 -- 172.21.15.32:0/1282280477 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288733 (secure 0 0 0) 0x7fbcfc0013a0 con 0x7fbcf406af00 2023-10-14T12:19:52.296 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:52.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbcf406af00 msgr2=0x7fbcf406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbcf406af00 0x7fbcf406d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc005660 tx=0x7fbcfc009040 comp rx=0 tx=0).stop 2023-10-14T12:19:52.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 msgr2=0x7fbd081569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbd081569d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000ba10 tx=0x7fbcf8001a00 comp rx=0 tx=0).stop 2023-10-14T12:19:52.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 shutdown_connections 2023-10-14T12:19:52.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fbcf406af00 0x7fbcf406d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd080cd670 0x7fbd080c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcf0003a30 0x7fbd081569d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 --2- 172.21.15.32:0/1282280477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd081f35a0 0x7fbd080cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.293+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 >> 172.21.15.32:0/1282280477 conn(0x7fbd0806dae0 msgr2=0x7fbd081583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:52.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.294+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 shutdown_connections 2023-10-14T12:19:52.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.294+0000 7fbd0d9f1700 1 -- 172.21.15.32:0/1282280477 wait complete. 2023-10-14T12:19:52.302 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:19:52.307 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-14T12:19:51.111907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224368,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750352,"statfs":{"total":773094113280,"available":772864360448,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451175+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:45.451175+0000","last_peered":"2023-10-14T12:19:45.451175+0000","last_clean":"2023-10-14T12:19:45.451175+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:45.451175+0000","last_undegraded":"2023-10-14T12:19:45.451175+0000","last_fullsized":"2023-10-14T12:19:45.451175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:27.468407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374519+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:44.374519+0000","last_peered":"2023-10-14T12:19:44.374519+0000","last_clean":"2023-10-14T12:19:44.374519+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:44.374519+0000","last_undegraded":"2023-10-14T12:19:44.374519+0000","last_fullsized":"2023-10-14T12:19:44.374519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374280+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:44.374280+0000","last_peered":"2023-10-14T12:19:44.374280+0000","last_clean":"2023-10-14T12:19:44.374280+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:44.374280+0000","last_undegraded":"2023-10-14T12:19:44.374280+0000","last_fullsized":"2023-10-14T12:19:44.374280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452113+0000","last_change":"2023-10-14T12:19:43.390887+0000","last_active":"2023-10-14T12:19:45.452113+0000","last_peered":"2023-10-14T12:19:45.452113+0000","last_clean":"2023-10-14T12:19:45.452113+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:19:45.452113+0000","last_undegraded":"2023-10-14T12:19:45.452113+0000","last_fullsized":"2023-10-14T12:19:45.452113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370444+0000","last_change":"2023-10-14T12:19:43.379488+0000","last_active":"2023-10-14T12:19:44.370444+0000","last_peered":"2023-10-14T12:19:44.370444+0000","last_clean":"2023-10-14T12:19:44.370444+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:19:44.370444+0000","last_undegraded":"2023-10-14T12:19:44.370444+0000","last_fullsized":"2023-10-14T12:19:44.370444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374228+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:44.374228+0000","last_peered":"2023-10-14T12:19:44.374228+0000","last_clean":"2023-10-14T12:19:44.374228+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:44.374228+0000","last_undegraded":"2023-10-14T12:19:44.374228+0000","last_fullsized":"2023-10-14T12:19:44.374228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950553+0000","last_change":"2023-10-14T12:19:43.381841+0000","last_active":"2023-10-14T12:19:44.950553+0000","last_peered":"2023-10-14T12:19:44.950553+0000","last_clean":"2023-10-14T12:19:44.950553+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:19:44.950553+0000","last_undegraded":"2023-10-14T12:19:44.950553+0000","last_fullsized":"2023-10-14T12:19:44.950553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950418+0000","last_change":"2023-10-14T12:19:43.382639+0000","last_active":"2023-10-14T12:19:44.950418+0000","last_peered":"2023-10-14T12:19:44.950418+0000","last_clean":"2023-10-14T12:19:44.950418+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:19:44.950418+0000","last_undegraded":"2023-10-14T12:19:44.950418+0000","last_fullsized":"2023-10-14T12:19:44.950418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452065+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:45.452065+0000","last_peered":"2023-10-14T12:19:45.452065+0000","last_clean":"2023-10-14T12:19:45.452065+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:45.452065+0000","last_undegraded":"2023-10-14T12:19:45.452065+0000","last_fullsized":"2023-10-14T12:19:45.452065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452529+0000","last_change":"2023-10-14T12:19:43.382683+0000","last_active":"2023-10-14T12:19:45.452529+0000","last_peered":"2023-10-14T12:19:45.452529+0000","last_clean":"2023-10-14T12:19:45.452529+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:19:45.452529+0000","last_undegraded":"2023-10-14T12:19:45.452529+0000","last_fullsized":"2023-10-14T12:19:45.452529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950759+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:44.950759+0000","last_peered":"2023-10-14T12:19:44.950759+0000","last_clean":"2023-10-14T12:19:44.950759+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:44.950759+0000","last_undegraded":"2023-10-14T12:19:44.950759+0000","last_fullsized":"2023-10-14T12:19:44.950759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374556+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:44.374556+0000","last_peered":"2023-10-14T12:19:44.374556+0000","last_clean":"2023-10-14T12:19:44.374556+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:44.374556+0000","last_undegraded":"2023-10-14T12:19:44.374556+0000","last_fullsized":"2023-10-14T12:19:44.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370587+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:44.370587+0000","last_peered":"2023-10-14T12:19:44.370587+0000","last_clean":"2023-10-14T12:19:44.370587+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:44.370587+0000","last_undegraded":"2023-10-14T12:19:44.370587+0000","last_fullsized":"2023-10-14T12:19:44.370587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374251+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:44.374251+0000","last_peered":"2023-10-14T12:19:44.374251+0000","last_clean":"2023-10-14T12:19:44.374251+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:44.374251+0000","last_undegraded":"2023-10-14T12:19:44.374251+0000","last_fullsized":"2023-10-14T12:19:44.374251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374071+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:44.374071+0000","last_peered":"2023-10-14T12:19:44.374071+0000","last_clean":"2023-10-14T12:19:44.374071+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:44.374071+0000","last_undegraded":"2023-10-14T12:19:44.374071+0000","last_fullsized":"2023-10-14T12:19:44.374071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950717+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:44.950717+0000","last_peered":"2023-10-14T12:19:44.950717+0000","last_clean":"2023-10-14T12:19:44.950717+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:44.950717+0000","last_undegraded":"2023-10-14T12:19:44.950717+0000","last_fullsized":"2023-10-14T12:19:44.950717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.951014+0000","last_change":"2023-10-14T12:19:43.381288+0000","last_active":"2023-10-14T12:19:44.951014+0000","last_peered":"2023-10-14T12:19:44.951014+0000","last_clean":"2023-10-14T12:19:44.951014+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:19:44.951014+0000","last_undegraded":"2023-10-14T12:19:44.951014+0000","last_fullsized":"2023-10-14T12:19:44.951014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374498+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:44.374498+0000","last_peered":"2023-10-14T12:19:44.374498+0000","last_clean":"2023-10-14T12:19:44.374498+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:44.374498+0000","last_undegraded":"2023-10-14T12:19:44.374498+0000","last_fullsized":"2023-10-14T12:19:44.374498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374414+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:44.374414+0000","last_peered":"2023-10-14T12:19:44.374414+0000","last_clean":"2023-10-14T12:19:44.374414+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:44.374414+0000","last_undegraded":"2023-10-14T12:19:44.374414+0000","last_fullsized":"2023-10-14T12:19:44.374414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370717+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:44.370717+0000","last_peered":"2023-10-14T12:19:44.370717+0000","last_clean":"2023-10-14T12:19:44.370717+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:44.370717+0000","last_undegraded":"2023-10-14T12:19:44.370717+0000","last_fullsized":"2023-10-14T12:19:44.370717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451563+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:45.451563+0000","last_peered":"2023-10-14T12:19:45.451563+0000","last_clean":"2023-10-14T12:19:45.451563+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:45.451563+0000","last_undegraded":"2023-10-14T12:19:45.451563+0000","last_fullsized":"2023-10-14T12:19:45.451563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451538+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:45.451538+0000","last_peered":"2023-10-14T12:19:45.451538+0000","last_clean":"2023-10-14T12:19:45.451538+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:45.451538+0000","last_undegraded":"2023-10-14T12:19:45.451538+0000","last_fullsized":"2023-10-14T12:19:45.451538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451481+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:45.451481+0000","last_peered":"2023-10-14T12:19:45.451481+0000","last_clean":"2023-10-14T12:19:45.451481+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:19:45.451481+0000","last_undegraded":"2023-10-14T12:19:45.451481+0000","last_fullsized":"2023-10-14T12:19:45.451481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374009+0000","last_change":"2023-10-14T12:19:43.381941+0000","last_active":"2023-10-14T12:19:44.374009+0000","last_peered":"2023-10-14T12:19:44.374009+0000","last_clean":"2023-10-14T12:19:44.374009+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:19:44.374009+0000","last_undegraded":"2023-10-14T12:19:44.374009+0000","last_fullsized":"2023-10-14T12:19:44.374009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452578+0000","last_change":"2023-10-14T12:19:43.382954+0000","last_active":"2023-10-14T12:19:45.452578+0000","last_peered":"2023-10-14T12:19:45.452578+0000","last_clean":"2023-10-14T12:19:45.452578+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:19:45.452578+0000","last_undegraded":"2023-10-14T12:19:45.452578+0000","last_fullsized":"2023-10-14T12:19:45.452578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374673+0000","last_change":"2023-10-14T12:19:43.380761+0000","last_active":"2023-10-14T12:19:44.374673+0000","last_peered":"2023-10-14T12:19:44.374673+0000","last_clean":"2023-10-14T12:19:44.374673+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:44.374673+0000","last_undegraded":"2023-10-14T12:19:44.374673+0000","last_fullsized":"2023-10-14T12:19:44.374673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:17.111399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452237+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:45.452237+0000","last_peered":"2023-10-14T12:19:45.452237+0000","last_clean":"2023-10-14T12:19:45.452237+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:45.452237+0000","last_undegraded":"2023-10-14T12:19:45.452237+0000","last_fullsized":"2023-10-14T12:19:45.452237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374585+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:44.374585+0000","last_peered":"2023-10-14T12:19:44.374585+0000","last_clean":"2023-10-14T12:19:44.374585+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:44.374585+0000","last_undegraded":"2023-10-14T12:19:44.374585+0000","last_fullsized":"2023-10-14T12:19:44.374585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451575+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:45.451575+0000","last_peered":"2023-10-14T12:19:45.451575+0000","last_clean":"2023-10-14T12:19:45.451575+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:45.451575+0000","last_undegraded":"2023-10-14T12:19:45.451575+0000","last_fullsized":"2023-10-14T12:19:45.451575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:38.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950548+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:44.950548+0000","last_peered":"2023-10-14T12:19:44.950548+0000","last_clean":"2023-10-14T12:19:44.950548+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:44.950548+0000","last_undegraded":"2023-10-14T12:19:44.950548+0000","last_fullsized":"2023-10-14T12:19:44.950548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451213+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:45.451213+0000","last_peered":"2023-10-14T12:19:45.451213+0000","last_clean":"2023-10-14T12:19:45.451213+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:45.451213+0000","last_undegraded":"2023-10-14T12:19:45.451213+0000","last_fullsized":"2023-10-14T12:19:45.451213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:25.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950873+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:44.950873+0000","last_peered":"2023-10-14T12:19:44.950873+0000","last_clean":"2023-10-14T12:19:44.950873+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:44.950873+0000","last_undegraded":"2023-10-14T12:19:44.950873+0000","last_fullsized":"2023-10-14T12:19:44.950873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451526+0000","last_change":"2023-10-14T12:19:43.393781+0000","last_active":"2023-10-14T12:19:45.451526+0000","last_peered":"2023-10-14T12:19:45.451526+0000","last_clean":"2023-10-14T12:19:45.451526+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:19:45.451526+0000","last_undegraded":"2023-10-14T12:19:45.451526+0000","last_fullsized":"2023-10-14T12:19:45.451526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179754+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:45.179754+0000","last_peered":"2023-10-14T12:19:45.179754+0000","last_clean":"2023-10-14T12:19:45.179754+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:45.179754+0000","last_undegraded":"2023-10-14T12:19:45.179754+0000","last_fullsized":"2023-10-14T12:19:45.179754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:14.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451254+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:45.451254+0000","last_peered":"2023-10-14T12:19:45.451254+0000","last_clean":"2023-10-14T12:19:45.451254+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:45.451254+0000","last_undegraded":"2023-10-14T12:19:45.451254+0000","last_fullsized":"2023-10-14T12:19:45.451254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250696+0000","last_change":"2023-10-14T12:19:42.374484+0000","last_active":"2023-10-14T12:19:45.250696+0000","last_peered":"2023-10-14T12:19:45.250696+0000","last_clean":"2023-10-14T12:19:45.250696+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:19:45.250696+0000","last_undegraded":"2023-10-14T12:19:45.250696+0000","last_fullsized":"2023-10-14T12:19:45.250696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451711+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:45.451711+0000","last_peered":"2023-10-14T12:19:45.451711+0000","last_clean":"2023-10-14T12:19:45.451711+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:45.451711+0000","last_undegraded":"2023-10-14T12:19:45.451711+0000","last_fullsized":"2023-10-14T12:19:45.451711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374493+0000","last_change":"2023-10-14T12:19:42.374263+0000","last_active":"2023-10-14T12:19:44.374493+0000","last_peered":"2023-10-14T12:19:44.374493+0000","last_clean":"2023-10-14T12:19:44.374493+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:19:44.374493+0000","last_undegraded":"2023-10-14T12:19:44.374493+0000","last_fullsized":"2023-10-14T12:19:44.374493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:59.390912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452292+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:45.452292+0000","last_peered":"2023-10-14T12:19:45.452292+0000","last_clean":"2023-10-14T12:19:45.452292+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:45.452292+0000","last_undegraded":"2023-10-14T12:19:45.452292+0000","last_fullsized":"2023-10-14T12:19:45.452292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370652+0000","last_change":"2023-10-14T12:19:42.377643+0000","last_active":"2023-10-14T12:19:44.370652+0000","last_peered":"2023-10-14T12:19:44.370652+0000","last_clean":"2023-10-14T12:19:44.370652+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:44.370652+0000","last_undegraded":"2023-10-14T12:19:44.370652+0000","last_fullsized":"2023-10-14T12:19:44.370652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:00.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950565+0000","last_change":"2023-10-14T12:19:43.389426+0000","last_active":"2023-10-14T12:19:44.950565+0000","last_peered":"2023-10-14T12:19:44.950565+0000","last_clean":"2023-10-14T12:19:44.950565+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:19:44.950565+0000","last_undegraded":"2023-10-14T12:19:44.950565+0000","last_fullsized":"2023-10-14T12:19:44.950565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179883+0000","last_change":"2023-10-14T12:19:42.375646+0000","last_active":"2023-10-14T12:19:45.179883+0000","last_peered":"2023-10-14T12:19:45.179883+0000","last_clean":"2023-10-14T12:19:45.179883+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:19:45.179883+0000","last_undegraded":"2023-10-14T12:19:45.179883+0000","last_fullsized":"2023-10-14T12:19:45.179883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374300+0000","last_change":"2023-10-14T12:19:43.390502+0000","last_active":"2023-10-14T12:19:44.374300+0000","last_peered":"2023-10-14T12:19:44.374300+0000","last_clean":"2023-10-14T12:19:44.374300+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:19:44.374300+0000","last_undegraded":"2023-10-14T12:19:44.374300+0000","last_fullsized":"2023-10-14T12:19:44.374300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179837+0000","last_change":"2023-10-14T12:19:42.375014+0000","last_active":"2023-10-14T12:19:45.179837+0000","last_peered":"2023-10-14T12:19:45.179837+0000","last_clean":"2023-10-14T12:19:45.179837+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:19:45.179837+0000","last_undegraded":"2023-10-14T12:19:45.179837+0000","last_fullsized":"2023-10-14T12:19:45.179837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:36.593916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451210+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:45.451210+0000","last_peered":"2023-10-14T12:19:45.451210+0000","last_clean":"2023-10-14T12:19:45.451210+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:45.451210+0000","last_undegraded":"2023-10-14T12:19:45.451210+0000","last_fullsized":"2023-10-14T12:19:45.451210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373966+0000","last_change":"2023-10-14T12:19:42.373819+0000","last_active":"2023-10-14T12:19:44.373966+0000","last_peered":"2023-10-14T12:19:44.373966+0000","last_clean":"2023-10-14T12:19:44.373966+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:19:44.373966+0000","last_undegraded":"2023-10-14T12:19:44.373966+0000","last_fullsized":"2023-10-14T12:19:44.373966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451313+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:45.451313+0000","last_peered":"2023-10-14T12:19:45.451313+0000","last_clean":"2023-10-14T12:19:45.451313+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:45.451313+0000","last_undegraded":"2023-10-14T12:19:45.451313+0000","last_fullsized":"2023-10-14T12:19:45.451313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179741+0000","last_change":"2023-10-14T12:19:42.372089+0000","last_active":"2023-10-14T12:19:45.179741+0000","last_peered":"2023-10-14T12:19:45.179741+0000","last_clean":"2023-10-14T12:19:45.179741+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:19:45.179741+0000","last_undegraded":"2023-10-14T12:19:45.179741+0000","last_fullsized":"2023-10-14T12:19:45.179741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:22.438051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374586+0000","last_change":"2023-10-14T12:19:43.382324+0000","last_active":"2023-10-14T12:19:44.374586+0000","last_peered":"2023-10-14T12:19:44.374586+0000","last_clean":"2023-10-14T12:19:44.374586+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:19:44.374586+0000","last_undegraded":"2023-10-14T12:19:44.374586+0000","last_fullsized":"2023-10-14T12:19:44.374586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374708+0000","last_change":"2023-10-14T12:19:42.372382+0000","last_active":"2023-10-14T12:19:44.374708+0000","last_peered":"2023-10-14T12:19:44.374708+0000","last_clean":"2023-10-14T12:19:44.374708+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:19:44.374708+0000","last_undegraded":"2023-10-14T12:19:44.374708+0000","last_fullsized":"2023-10-14T12:19:44.374708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374844+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:44.374844+0000","last_peered":"2023-10-14T12:19:44.374844+0000","last_clean":"2023-10-14T12:19:44.374844+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:44.374844+0000","last_undegraded":"2023-10-14T12:19:44.374844+0000","last_fullsized":"2023-10-14T12:19:44.374844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:47:38.320770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250724+0000","last_change":"2023-10-14T12:19:42.376458+0000","last_active":"2023-10-14T12:19:45.250724+0000","last_peered":"2023-10-14T12:19:45.250724+0000","last_clean":"2023-10-14T12:19:45.250724+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:19:45.250724+0000","last_undegraded":"2023-10-14T12:19:45.250724+0000","last_fullsized":"2023-10-14T12:19:45.250724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374529+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:44.374529+0000","last_peered":"2023-10-14T12:19:44.374529+0000","last_clean":"2023-10-14T12:19:44.374529+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:44.374529+0000","last_undegraded":"2023-10-14T12:19:44.374529+0000","last_fullsized":"2023-10-14T12:19:44.374529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374572+0000","last_change":"2023-10-14T12:19:42.373797+0000","last_active":"2023-10-14T12:19:44.374572+0000","last_peered":"2023-10-14T12:19:44.374572+0000","last_clean":"2023-10-14T12:19:44.374572+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:19:44.374572+0000","last_undegraded":"2023-10-14T12:19:44.374572+0000","last_fullsized":"2023-10-14T12:19:44.374572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:21.195047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374459+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:44.374459+0000","last_peered":"2023-10-14T12:19:44.374459+0000","last_clean":"2023-10-14T12:19:44.374459+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:44.374459+0000","last_undegraded":"2023-10-14T12:19:44.374459+0000","last_fullsized":"2023-10-14T12:19:44.374459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374488+0000","last_change":"2023-10-14T12:19:42.371158+0000","last_active":"2023-10-14T12:19:44.374488+0000","last_peered":"2023-10-14T12:19:44.374488+0000","last_clean":"2023-10-14T12:19:44.374488+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:19:44.374488+0000","last_undegraded":"2023-10-14T12:19:44.374488+0000","last_fullsized":"2023-10-14T12:19:44.374488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:24.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451638+0000","last_change":"2023-10-14T12:19:43.380181+0000","last_active":"2023-10-14T12:19:45.451638+0000","last_peered":"2023-10-14T12:19:45.451638+0000","last_clean":"2023-10-14T12:19:45.451638+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:19:45.451638+0000","last_undegraded":"2023-10-14T12:19:45.451638+0000","last_fullsized":"2023-10-14T12:19:45.451638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179895+0000","last_change":"2023-10-14T12:19:42.373775+0000","last_active":"2023-10-14T12:19:45.179895+0000","last_peered":"2023-10-14T12:19:45.179895+0000","last_clean":"2023-10-14T12:19:45.179895+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:19:45.179895+0000","last_undegraded":"2023-10-14T12:19:45.179895+0000","last_fullsized":"2023-10-14T12:19:45.179895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374439+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:44.374439+0000","last_peered":"2023-10-14T12:19:44.374439+0000","last_clean":"2023-10-14T12:19:44.374439+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:44.374439+0000","last_undegraded":"2023-10-14T12:19:44.374439+0000","last_fullsized":"2023-10-14T12:19:44.374439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173778+0000","last_change":"2023-10-14T12:19:42.373838+0000","last_active":"2023-10-14T12:19:45.173778+0000","last_peered":"2023-10-14T12:19:45.173778+0000","last_clean":"2023-10-14T12:19:45.173778+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:19:45.173778+0000","last_undegraded":"2023-10-14T12:19:45.173778+0000","last_fullsized":"2023-10-14T12:19:45.173778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950851+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:44.950851+0000","last_peered":"2023-10-14T12:19:44.950851+0000","last_clean":"2023-10-14T12:19:44.950851+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:44.950851+0000","last_undegraded":"2023-10-14T12:19:44.950851+0000","last_fullsized":"2023-10-14T12:19:44.950851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374044+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:44.374044+0000","last_peered":"2023-10-14T12:19:44.374044+0000","last_clean":"2023-10-14T12:19:44.374044+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:44.374044+0000","last_undegraded":"2023-10-14T12:19:44.374044+0000","last_fullsized":"2023-10-14T12:19:44.374044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451127+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:45.451127+0000","last_peered":"2023-10-14T12:19:45.451127+0000","last_clean":"2023-10-14T12:19:45.451127+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:45.451127+0000","last_undegraded":"2023-10-14T12:19:45.451127+0000","last_fullsized":"2023-10-14T12:19:45.451127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:31.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374022+0000","last_change":"2023-10-14T12:19:42.373204+0000","last_active":"2023-10-14T12:19:44.374022+0000","last_peered":"2023-10-14T12:19:44.374022+0000","last_clean":"2023-10-14T12:19:44.374022+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:19:44.374022+0000","last_undegraded":"2023-10-14T12:19:44.374022+0000","last_fullsized":"2023-10-14T12:19:44.374022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:40.688686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451830+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:45.451830+0000","last_peered":"2023-10-14T12:19:45.451830+0000","last_clean":"2023-10-14T12:19:45.451830+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:45.451830+0000","last_undegraded":"2023-10-14T12:19:45.451830+0000","last_fullsized":"2023-10-14T12:19:45.451830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173941+0000","last_change":"2023-10-14T12:19:42.376646+0000","last_active":"2023-10-14T12:19:45.173941+0000","last_peered":"2023-10-14T12:19:45.173941+0000","last_clean":"2023-10-14T12:19:45.173941+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:19:45.173941+0000","last_undegraded":"2023-10-14T12:19:45.173941+0000","last_fullsized":"2023-10-14T12:19:45.173941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:37.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374521+0000","last_change":"2023-10-14T12:19:43.388112+0000","last_active":"2023-10-14T12:19:44.374521+0000","last_peered":"2023-10-14T12:19:44.374521+0000","last_clean":"2023-10-14T12:19:44.374521+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:19:44.374521+0000","last_undegraded":"2023-10-14T12:19:44.374521+0000","last_fullsized":"2023-10-14T12:19:44.374521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179959+0000","last_change":"2023-10-14T12:19:42.373858+0000","last_active":"2023-10-14T12:19:45.179959+0000","last_peered":"2023-10-14T12:19:45.179959+0000","last_clean":"2023-10-14T12:19:45.179959+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:19:45.179959+0000","last_undegraded":"2023-10-14T12:19:45.179959+0000","last_fullsized":"2023-10-14T12:19:45.179959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452035+0000","last_change":"2023-10-14T12:19:43.388334+0000","last_active":"2023-10-14T12:19:45.452035+0000","last_peered":"2023-10-14T12:19:45.452035+0000","last_clean":"2023-10-14T12:19:45.452035+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:19:45.452035+0000","last_undegraded":"2023-10-14T12:19:45.452035+0000","last_fullsized":"2023-10-14T12:19:45.452035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179931+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:45.179931+0000","last_peered":"2023-10-14T12:19:45.179931+0000","last_clean":"2023-10-14T12:19:45.179931+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:45.179931+0000","last_undegraded":"2023-10-14T12:19:45.179931+0000","last_fullsized":"2023-10-14T12:19:45.179931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:12.099355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370543+0000","last_change":"2023-10-14T12:19:43.384205+0000","last_active":"2023-10-14T12:19:44.370543+0000","last_peered":"2023-10-14T12:19:44.370543+0000","last_clean":"2023-10-14T12:19:44.370543+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:19:44.370543+0000","last_undegraded":"2023-10-14T12:19:44.370543+0000","last_fullsized":"2023-10-14T12:19:44.370543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:37.599241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179917+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:45.179917+0000","last_peered":"2023-10-14T12:19:45.179917+0000","last_clean":"2023-10-14T12:19:45.179917+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:45.179917+0000","last_undegraded":"2023-10-14T12:19:45.179917+0000","last_fullsized":"2023-10-14T12:19:45.179917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:19.606346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370619+0000","last_change":"2023-10-14T12:19:43.388769+0000","last_active":"2023-10-14T12:19:44.370619+0000","last_peered":"2023-10-14T12:19:44.370619+0000","last_clean":"2023-10-14T12:19:44.370619+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:19:44.370619+0000","last_undegraded":"2023-10-14T12:19:44.370619+0000","last_fullsized":"2023-10-14T12:19:44.370619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250596+0000","last_change":"2023-10-14T12:19:42.378784+0000","last_active":"2023-10-14T12:19:45.250596+0000","last_peered":"2023-10-14T12:19:45.250596+0000","last_clean":"2023-10-14T12:19:45.250596+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:45.250596+0000","last_undegraded":"2023-10-14T12:19:45.250596+0000","last_fullsized":"2023-10-14T12:19:45.250596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370513+0000","last_change":"2023-10-14T12:19:43.390194+0000","last_active":"2023-10-14T12:19:44.370513+0000","last_peered":"2023-10-14T12:19:44.370513+0000","last_clean":"2023-10-14T12:19:44.370513+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:19:44.370513+0000","last_undegraded":"2023-10-14T12:19:44.370513+0000","last_fullsized":"2023-10-14T12:19:44.370513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:13.104681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179660+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:45.179660+0000","last_peered":"2023-10-14T12:19:45.179660+0000","last_clean":"2023-10-14T12:19:45.179660+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:45.179660+0000","last_undegraded":"2023-10-14T12:19:45.179660+0000","last_fullsized":"2023-10-14T12:19:45.179660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370406+0000","last_change":"2023-10-14T12:19:43.382787+0000","last_active":"2023-10-14T12:19:44.370406+0000","last_peered":"2023-10-14T12:19:44.370406+0000","last_clean":"2023-10-14T12:19:44.370406+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:19:44.370406+0000","last_undegraded":"2023-10-14T12:19:44.370406+0000","last_fullsized":"2023-10-14T12:19:44.370406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179805+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:45.179805+0000","last_peered":"2023-10-14T12:19:45.179805+0000","last_clean":"2023-10-14T12:19:45.179805+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:45.179805+0000","last_undegraded":"2023-10-14T12:19:45.179805+0000","last_fullsized":"2023-10-14T12:19:45.179805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:17.650999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950643+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:44.950643+0000","last_peered":"2023-10-14T12:19:44.950643+0000","last_clean":"2023-10-14T12:19:44.950643+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:44.950643+0000","last_undegraded":"2023-10-14T12:19:44.950643+0000","last_fullsized":"2023-10-14T12:19:44.950643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373934+0000","last_change":"2023-10-14T12:19:42.377594+0000","last_active":"2023-10-14T12:19:44.373934+0000","last_peered":"2023-10-14T12:19:44.373934+0000","last_clean":"2023-10-14T12:19:44.373934+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:44.373934+0000","last_undegraded":"2023-10-14T12:19:44.373934+0000","last_fullsized":"2023-10-14T12:19:44.373934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370575+0000","last_change":"2023-10-14T12:19:43.388662+0000","last_active":"2023-10-14T12:19:44.370575+0000","last_peered":"2023-10-14T12:19:44.370575+0000","last_clean":"2023-10-14T12:19:44.370575+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:19:44.370575+0000","last_undegraded":"2023-10-14T12:19:44.370575+0000","last_fullsized":"2023-10-14T12:19:44.370575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:20.611672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173898+0000","last_change":"2023-10-14T12:19:42.377243+0000","last_active":"2023-10-14T12:19:45.173898+0000","last_peered":"2023-10-14T12:19:45.173898+0000","last_clean":"2023-10-14T12:19:45.173898+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:19:45.173898+0000","last_undegraded":"2023-10-14T12:19:45.173898+0000","last_fullsized":"2023-10-14T12:19:45.173898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:55.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374463+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:44.374463+0000","last_peered":"2023-10-14T12:19:44.374463+0000","last_clean":"2023-10-14T12:19:44.374463+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:44.374463+0000","last_undegraded":"2023-10-14T12:19:44.374463+0000","last_fullsized":"2023-10-14T12:19:44.374463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451670+0000","last_change":"2023-10-14T12:19:42.378619+0000","last_active":"2023-10-14T12:19:45.451670+0000","last_peered":"2023-10-14T12:19:45.451670+0000","last_clean":"2023-10-14T12:19:45.451670+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:19:45.451670+0000","last_undegraded":"2023-10-14T12:19:45.451670+0000","last_fullsized":"2023-10-14T12:19:45.451670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451627+0000","last_change":"2023-10-14T12:19:43.389128+0000","last_active":"2023-10-14T12:19:45.451627+0000","last_peered":"2023-10-14T12:19:45.451627+0000","last_clean":"2023-10-14T12:19:45.451627+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:19:45.451627+0000","last_undegraded":"2023-10-14T12:19:45.451627+0000","last_fullsized":"2023-10-14T12:19:45.451627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173817+0000","last_change":"2023-10-14T12:19:42.371259+0000","last_active":"2023-10-14T12:19:45.173817+0000","last_peered":"2023-10-14T12:19:45.173817+0000","last_clean":"2023-10-14T12:19:45.173817+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:19:45.173817+0000","last_undegraded":"2023-10-14T12:19:45.173817+0000","last_fullsized":"2023-10-14T12:19:45.173817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:34.980122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451233+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:45.451233+0000","last_peered":"2023-10-14T12:19:45.451233+0000","last_clean":"2023-10-14T12:19:45.451233+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:45.451233+0000","last_undegraded":"2023-10-14T12:19:45.451233+0000","last_fullsized":"2023-10-14T12:19:45.451233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250581+0000","last_change":"2023-10-14T12:19:42.371970+0000","last_active":"2023-10-14T12:19:45.250581+0000","last_peered":"2023-10-14T12:19:45.250581+0000","last_clean":"2023-10-14T12:19:45.250581+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:45.250581+0000","last_undegraded":"2023-10-14T12:19:45.250581+0000","last_fullsized":"2023-10-14T12:19:45.250581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:17.853714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451947+0000","last_change":"2023-10-14T12:19:43.388360+0000","last_active":"2023-10-14T12:19:45.451947+0000","last_peered":"2023-10-14T12:19:45.451947+0000","last_clean":"2023-10-14T12:19:45.451947+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:19:45.451947+0000","last_undegraded":"2023-10-14T12:19:45.451947+0000","last_fullsized":"2023-10-14T12:19:45.451947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173792+0000","last_change":"2023-10-14T12:19:42.376964+0000","last_active":"2023-10-14T12:19:45.173792+0000","last_peered":"2023-10-14T12:19:45.173792+0000","last_clean":"2023-10-14T12:19:45.173792+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:45.173792+0000","last_undegraded":"2023-10-14T12:19:45.173792+0000","last_fullsized":"2023-10-14T12:19:45.173792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:34.064338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374083+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:44.374083+0000","last_peered":"2023-10-14T12:19:44.374083+0000","last_clean":"2023-10-14T12:19:44.374083+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:44.374083+0000","last_undegraded":"2023-10-14T12:19:44.374083+0000","last_fullsized":"2023-10-14T12:19:44.374083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179816+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:45.179816+0000","last_peered":"2023-10-14T12:19:45.179816+0000","last_clean":"2023-10-14T12:19:45.179816+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:45.179816+0000","last_undegraded":"2023-10-14T12:19:45.179816+0000","last_fullsized":"2023-10-14T12:19:45.179816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:09.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451226+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:45.451226+0000","last_peered":"2023-10-14T12:19:45.451226+0000","last_clean":"2023-10-14T12:19:45.451226+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:45.451226+0000","last_undegraded":"2023-10-14T12:19:45.451226+0000","last_fullsized":"2023-10-14T12:19:45.451226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373897+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:44.373897+0000","last_peered":"2023-10-14T12:19:44.373897+0000","last_clean":"2023-10-14T12:19:44.373897+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:44.373897+0000","last_undegraded":"2023-10-14T12:19:44.373897+0000","last_fullsized":"2023-10-14T12:19:44.373897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:51.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950724+0000","last_change":"2023-10-14T12:19:43.385662+0000","last_active":"2023-10-14T12:19:44.950724+0000","last_peered":"2023-10-14T12:19:44.950724+0000","last_clean":"2023-10-14T12:19:44.950724+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:19:44.950724+0000","last_undegraded":"2023-10-14T12:19:44.950724+0000","last_fullsized":"2023-10-14T12:19:44.950724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179683+0000","last_change":"2023-10-14T12:19:42.371684+0000","last_active":"2023-10-14T12:19:45.179683+0000","last_peered":"2023-10-14T12:19:45.179683+0000","last_clean":"2023-10-14T12:19:45.179683+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:45.179683+0000","last_undegraded":"2023-10-14T12:19:45.179683+0000","last_fullsized":"2023-10-14T12:19:45.179683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:56.045404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373248+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:19:43.373248+0000","last_peered":"2023-10-14T12:19:43.373248+0000","last_clean":"2023-10-14T12:19:43.373248+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:19:43.373248+0000","last_undegraded":"2023-10-14T12:19:43.373248+0000","last_fullsized":"2023-10-14T12:19:43.373248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.624},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73499999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.629}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29799999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.41199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.376},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.443}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.496},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.375},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.751},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.746},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:19:52.314 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T12:19:52.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:19:52.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.472+0000 7f3b04d43700 1 Processor -- start 2023-10-14T12:19:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.472+0000 7f3b04d43700 1 -- start start 2023-10-14T12:19:52.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3b04d43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0015e2f0 0x7f3b000cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3b04d43700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b0006a840 0x7f3b0006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3b04d43700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b2d60 con 0x7f3b000cd950 2023-10-14T12:19:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3b04d43700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b001619a0 con 0x7f3b0006a840 2023-10-14T12:19:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3b04d43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0006b1f0 con 0x7f3b0015e2f0 2023-10-14T12:19:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b0006a840 0x7f3b0006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b0006a840 0x7f3b0006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40072/0 (socket says 172.21.15.32:40072) 2023-10-14T12:19:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 -- 172.21.15.32:0/91040849 learned_addr learned my addr 172.21.15.32:0/91040849 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afdd9b700 1 --2- 172.21.15.32:0/91040849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0015e2f0 0x7f3b000cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 -- 172.21.15.32:0/91040849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0015e2f0 msgr2=0x7f3b000cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 --2- 172.21.15.32:0/91040849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0015e2f0 0x7f3b000cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 -- 172.21.15.32:0/91040849 >> v1:172.21.15.92:6789/0 conn(0x7f3b000cd950 legacy=0x7f3b0015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 -- 172.21.15.32:0/91040849 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000cdd30 con 0x7f3b0006a840 2023-10-14T12:19:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.473+0000 7f3afed9d700 1 --2- 172.21.15.32:0/91040849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0006a840 0x7f3b0006acb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009e50 tx=0x7f3af800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be45b72eace6d0f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3afd59a700 1 -- 172.21.15.32:0/91040849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800e070 con 0x7f3b0006a840 2023-10-14T12:19:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3afd59a700 1 -- 172.21.15.32:0/91040849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800b9c0 con 0x7f3b0006a840 2023-10-14T12:19:52.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3afd59a700 1 -- 172.21.15.32:0/91040849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800bd70 con 0x7f3b0006a840 2023-10-14T12:19:52.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 -- 172.21.15.32:0/91040849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0006a840 msgr2=0x7f3b0006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 --2- 172.21.15.32:0/91040849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0006a840 0x7f3b0006acb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009e50 tx=0x7f3af800b330 comp rx=0 tx=0).stop 2023-10-14T12:19:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 -- 172.21.15.32:0/91040849 shutdown_connections 2023-10-14T12:19:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 --2- 172.21.15.32:0/91040849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0006a840 0x7f3b0006acb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 --2- 172.21.15.32:0/91040849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0015e2f0 0x7f3b000cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 -- 172.21.15.32:0/91040849 >> 172.21.15.32:0/91040849 conn(0x7f3b0006dae0 msgr2=0x7f3b0006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:52.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 -- 172.21.15.32:0/91040849 shutdown_connections 2023-10-14T12:19:52.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.474+0000 7f3b04d43700 1 -- 172.21.15.32:0/91040849 wait complete. 2023-10-14T12:19:52.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.476+0000 7f3b04d43700 1 Processor -- start 2023-10-14T12:19:52.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.476+0000 7f3b04d43700 1 -- start start 2023-10-14T12:19:52.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0006a840 0x7f3b00153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b000cd950 0x7f3b00160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 0x7f3b00160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000ad0c0 con 0x7f3b0015e2f0 2023-10-14T12:19:52.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00153fe0 con 0x7f3b000cd950 2023-10-14T12:19:52.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b48a0 con 0x7f3b0006a840 2023-10-14T12:19:52.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 0x7f3b00160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 0x7f3b00160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40078/0 (socket says 172.21.15.32:40078) 2023-10-14T12:19:52.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 -- 172.21.15.32:0/994456423 learned_addr learned my addr 172.21.15.32:0/994456423 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:52.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afe59c700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0006a840 0x7f3b00153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afdd9b700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b000cd950 0x7f3b00160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 -- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0006a840 msgr2=0x7f3b00153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0006a840 0x7f3b00153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 -- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b000cd950 msgr2=0x7f3b00160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b000cd950 0x7f3b00160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 -- 172.21.15.32:0/994456423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009b30 con 0x7f3b0015e2f0 2023-10-14T12:19:52.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afdd9b700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b000cd950 0x7f3b00160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:52.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3afed9d700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 0x7f3b00160580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3b0006d4f0 tx=0x7f3af8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8004960 con 0x7f3b0015e2f0 2023-10-14T12:19:52.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af80092e0 con 0x7f3b0015e2f0 2023-10-14T12:19:52.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000b4b80 con 0x7f3b0015e2f0 2023-10-14T12:19:52.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af801c660 con 0x7f3b0015e2f0 2023-10-14T12:19:52.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.477+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000b5140 con 0x7f3b0015e2f0 2023-10-14T12:19:52.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.478+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b000b5300 con 0x7f3b0015e2f0 2023-10-14T12:19:52.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.480+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3af801c7c0 con 0x7f3b0015e2f0 2023-10-14T12:19:52.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.480+0000 7f3aeeffd700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3ae006af00 0x7f3ae006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.480+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3af808b6b0 con 0x7f3b0015e2f0 2023-10-14T12:19:52.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.480+0000 7f3afe59c700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3ae006af00 0x7f3ae006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.481+0000 7f3afe59c700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3ae006af00 0x7f3ae006d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000f60 tx=0x7f3af0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.484+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3af80568b0 con 0x7f3b0015e2f0 2023-10-14T12:19:52.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.679+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b0015ec00 con 0x7f3ae006af00 2023-10-14T12:19:52.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.688+0000 7f3aeeffd700 1 -- 172.21.15.32:0/994456423 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288733 (secure 0 0 0) 0x7f3af00050d0 con 0x7f3ae006af00 2023-10-14T12:19:52.696 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:52.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3ae006af00 msgr2=0x7f3ae006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3ae006af00 0x7f3ae006d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000f60 tx=0x7f3af0009040 comp rx=0 tx=0).stop 2023-10-14T12:19:52.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 msgr2=0x7f3b00160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 0x7f3b00160580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3b0006d4f0 tx=0x7f3af8004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 shutdown_connections 2023-10-14T12:19:52.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0015e2f0 0x7f3b00160580 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b0006a840 0x7f3b00153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f3ae006af00 0x7f3ae006d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 --2- 172.21.15.32:0/994456423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b000cd950 0x7f3b00160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 >> 172.21.15.32:0/994456423 conn(0x7f3b0006dae0 msgr2=0x7f3b000b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:52.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 shutdown_connections 2023-10-14T12:19:52.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.691+0000 7f3b04d43700 1 -- 172.21.15.32:0/994456423 wait complete. 2023-10-14T12:19:52.705 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:19:52.707 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-14T12:19:51.111907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224368,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750352,"statfs":{"total":773094113280,"available":772864360448,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451175+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:45.451175+0000","last_peered":"2023-10-14T12:19:45.451175+0000","last_clean":"2023-10-14T12:19:45.451175+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:45.451175+0000","last_undegraded":"2023-10-14T12:19:45.451175+0000","last_fullsized":"2023-10-14T12:19:45.451175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:27.468407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374519+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:44.374519+0000","last_peered":"2023-10-14T12:19:44.374519+0000","last_clean":"2023-10-14T12:19:44.374519+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:44.374519+0000","last_undegraded":"2023-10-14T12:19:44.374519+0000","last_fullsized":"2023-10-14T12:19:44.374519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374280+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:44.374280+0000","last_peered":"2023-10-14T12:19:44.374280+0000","last_clean":"2023-10-14T12:19:44.374280+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:44.374280+0000","last_undegraded":"2023-10-14T12:19:44.374280+0000","last_fullsized":"2023-10-14T12:19:44.374280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452113+0000","last_change":"2023-10-14T12:19:43.390887+0000","last_active":"2023-10-14T12:19:45.452113+0000","last_peered":"2023-10-14T12:19:45.452113+0000","last_clean":"2023-10-14T12:19:45.452113+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:19:45.452113+0000","last_undegraded":"2023-10-14T12:19:45.452113+0000","last_fullsized":"2023-10-14T12:19:45.452113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370444+0000","last_change":"2023-10-14T12:19:43.379488+0000","last_active":"2023-10-14T12:19:44.370444+0000","last_peered":"2023-10-14T12:19:44.370444+0000","last_clean":"2023-10-14T12:19:44.370444+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:19:44.370444+0000","last_undegraded":"2023-10-14T12:19:44.370444+0000","last_fullsized":"2023-10-14T12:19:44.370444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374228+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:44.374228+0000","last_peered":"2023-10-14T12:19:44.374228+0000","last_clean":"2023-10-14T12:19:44.374228+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:44.374228+0000","last_undegraded":"2023-10-14T12:19:44.374228+0000","last_fullsized":"2023-10-14T12:19:44.374228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950553+0000","last_change":"2023-10-14T12:19:43.381841+0000","last_active":"2023-10-14T12:19:44.950553+0000","last_peered":"2023-10-14T12:19:44.950553+0000","last_clean":"2023-10-14T12:19:44.950553+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:19:44.950553+0000","last_undegraded":"2023-10-14T12:19:44.950553+0000","last_fullsized":"2023-10-14T12:19:44.950553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950418+0000","last_change":"2023-10-14T12:19:43.382639+0000","last_active":"2023-10-14T12:19:44.950418+0000","last_peered":"2023-10-14T12:19:44.950418+0000","last_clean":"2023-10-14T12:19:44.950418+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:19:44.950418+0000","last_undegraded":"2023-10-14T12:19:44.950418+0000","last_fullsized":"2023-10-14T12:19:44.950418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452065+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:45.452065+0000","last_peered":"2023-10-14T12:19:45.452065+0000","last_clean":"2023-10-14T12:19:45.452065+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:45.452065+0000","last_undegraded":"2023-10-14T12:19:45.452065+0000","last_fullsized":"2023-10-14T12:19:45.452065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452529+0000","last_change":"2023-10-14T12:19:43.382683+0000","last_active":"2023-10-14T12:19:45.452529+0000","last_peered":"2023-10-14T12:19:45.452529+0000","last_clean":"2023-10-14T12:19:45.452529+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:19:45.452529+0000","last_undegraded":"2023-10-14T12:19:45.452529+0000","last_fullsized":"2023-10-14T12:19:45.452529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950759+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:44.950759+0000","last_peered":"2023-10-14T12:19:44.950759+0000","last_clean":"2023-10-14T12:19:44.950759+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:44.950759+0000","last_undegraded":"2023-10-14T12:19:44.950759+0000","last_fullsized":"2023-10-14T12:19:44.950759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374556+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:44.374556+0000","last_peered":"2023-10-14T12:19:44.374556+0000","last_clean":"2023-10-14T12:19:44.374556+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:44.374556+0000","last_undegraded":"2023-10-14T12:19:44.374556+0000","last_fullsized":"2023-10-14T12:19:44.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370587+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:44.370587+0000","last_peered":"2023-10-14T12:19:44.370587+0000","last_clean":"2023-10-14T12:19:44.370587+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:44.370587+0000","last_undegraded":"2023-10-14T12:19:44.370587+0000","last_fullsized":"2023-10-14T12:19:44.370587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374251+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:44.374251+0000","last_peered":"2023-10-14T12:19:44.374251+0000","last_clean":"2023-10-14T12:19:44.374251+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:44.374251+0000","last_undegraded":"2023-10-14T12:19:44.374251+0000","last_fullsized":"2023-10-14T12:19:44.374251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374071+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:44.374071+0000","last_peered":"2023-10-14T12:19:44.374071+0000","last_clean":"2023-10-14T12:19:44.374071+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:44.374071+0000","last_undegraded":"2023-10-14T12:19:44.374071+0000","last_fullsized":"2023-10-14T12:19:44.374071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950717+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:44.950717+0000","last_peered":"2023-10-14T12:19:44.950717+0000","last_clean":"2023-10-14T12:19:44.950717+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:44.950717+0000","last_undegraded":"2023-10-14T12:19:44.950717+0000","last_fullsized":"2023-10-14T12:19:44.950717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.951014+0000","last_change":"2023-10-14T12:19:43.381288+0000","last_active":"2023-10-14T12:19:44.951014+0000","last_peered":"2023-10-14T12:19:44.951014+0000","last_clean":"2023-10-14T12:19:44.951014+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:19:44.951014+0000","last_undegraded":"2023-10-14T12:19:44.951014+0000","last_fullsized":"2023-10-14T12:19:44.951014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374498+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:44.374498+0000","last_peered":"2023-10-14T12:19:44.374498+0000","last_clean":"2023-10-14T12:19:44.374498+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:44.374498+0000","last_undegraded":"2023-10-14T12:19:44.374498+0000","last_fullsized":"2023-10-14T12:19:44.374498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374414+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:44.374414+0000","last_peered":"2023-10-14T12:19:44.374414+0000","last_clean":"2023-10-14T12:19:44.374414+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:44.374414+0000","last_undegraded":"2023-10-14T12:19:44.374414+0000","last_fullsized":"2023-10-14T12:19:44.374414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370717+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:44.370717+0000","last_peered":"2023-10-14T12:19:44.370717+0000","last_clean":"2023-10-14T12:19:44.370717+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:44.370717+0000","last_undegraded":"2023-10-14T12:19:44.370717+0000","last_fullsized":"2023-10-14T12:19:44.370717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451563+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:45.451563+0000","last_peered":"2023-10-14T12:19:45.451563+0000","last_clean":"2023-10-14T12:19:45.451563+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:45.451563+0000","last_undegraded":"2023-10-14T12:19:45.451563+0000","last_fullsized":"2023-10-14T12:19:45.451563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451538+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:45.451538+0000","last_peered":"2023-10-14T12:19:45.451538+0000","last_clean":"2023-10-14T12:19:45.451538+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:45.451538+0000","last_undegraded":"2023-10-14T12:19:45.451538+0000","last_fullsized":"2023-10-14T12:19:45.451538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451481+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:45.451481+0000","last_peered":"2023-10-14T12:19:45.451481+0000","last_clean":"2023-10-14T12:19:45.451481+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:19:45.451481+0000","last_undegraded":"2023-10-14T12:19:45.451481+0000","last_fullsized":"2023-10-14T12:19:45.451481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374009+0000","last_change":"2023-10-14T12:19:43.381941+0000","last_active":"2023-10-14T12:19:44.374009+0000","last_peered":"2023-10-14T12:19:44.374009+0000","last_clean":"2023-10-14T12:19:44.374009+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:19:44.374009+0000","last_undegraded":"2023-10-14T12:19:44.374009+0000","last_fullsized":"2023-10-14T12:19:44.374009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452578+0000","last_change":"2023-10-14T12:19:43.382954+0000","last_active":"2023-10-14T12:19:45.452578+0000","last_peered":"2023-10-14T12:19:45.452578+0000","last_clean":"2023-10-14T12:19:45.452578+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:19:45.452578+0000","last_undegraded":"2023-10-14T12:19:45.452578+0000","last_fullsized":"2023-10-14T12:19:45.452578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374673+0000","last_change":"2023-10-14T12:19:43.380761+0000","last_active":"2023-10-14T12:19:44.374673+0000","last_peered":"2023-10-14T12:19:44.374673+0000","last_clean":"2023-10-14T12:19:44.374673+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:44.374673+0000","last_undegraded":"2023-10-14T12:19:44.374673+0000","last_fullsized":"2023-10-14T12:19:44.374673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:17.111399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452237+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:45.452237+0000","last_peered":"2023-10-14T12:19:45.452237+0000","last_clean":"2023-10-14T12:19:45.452237+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:45.452237+0000","last_undegraded":"2023-10-14T12:19:45.452237+0000","last_fullsized":"2023-10-14T12:19:45.452237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374585+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:44.374585+0000","last_peered":"2023-10-14T12:19:44.374585+0000","last_clean":"2023-10-14T12:19:44.374585+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:44.374585+0000","last_undegraded":"2023-10-14T12:19:44.374585+0000","last_fullsized":"2023-10-14T12:19:44.374585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451575+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:45.451575+0000","last_peered":"2023-10-14T12:19:45.451575+0000","last_clean":"2023-10-14T12:19:45.451575+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:45.451575+0000","last_undegraded":"2023-10-14T12:19:45.451575+0000","last_fullsized":"2023-10-14T12:19:45.451575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:38.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950548+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:44.950548+0000","last_peered":"2023-10-14T12:19:44.950548+0000","last_clean":"2023-10-14T12:19:44.950548+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:44.950548+0000","last_undegraded":"2023-10-14T12:19:44.950548+0000","last_fullsized":"2023-10-14T12:19:44.950548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451213+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:45.451213+0000","last_peered":"2023-10-14T12:19:45.451213+0000","last_clean":"2023-10-14T12:19:45.451213+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:45.451213+0000","last_undegraded":"2023-10-14T12:19:45.451213+0000","last_fullsized":"2023-10-14T12:19:45.451213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:25.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950873+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:44.950873+0000","last_peered":"2023-10-14T12:19:44.950873+0000","last_clean":"2023-10-14T12:19:44.950873+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:44.950873+0000","last_undegraded":"2023-10-14T12:19:44.950873+0000","last_fullsized":"2023-10-14T12:19:44.950873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451526+0000","last_change":"2023-10-14T12:19:43.393781+0000","last_active":"2023-10-14T12:19:45.451526+0000","last_peered":"2023-10-14T12:19:45.451526+0000","last_clean":"2023-10-14T12:19:45.451526+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:19:45.451526+0000","last_undegraded":"2023-10-14T12:19:45.451526+0000","last_fullsized":"2023-10-14T12:19:45.451526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179754+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:45.179754+0000","last_peered":"2023-10-14T12:19:45.179754+0000","last_clean":"2023-10-14T12:19:45.179754+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:45.179754+0000","last_undegraded":"2023-10-14T12:19:45.179754+0000","last_fullsized":"2023-10-14T12:19:45.179754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:14.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451254+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:45.451254+0000","last_peered":"2023-10-14T12:19:45.451254+0000","last_clean":"2023-10-14T12:19:45.451254+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:45.451254+0000","last_undegraded":"2023-10-14T12:19:45.451254+0000","last_fullsized":"2023-10-14T12:19:45.451254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250696+0000","last_change":"2023-10-14T12:19:42.374484+0000","last_active":"2023-10-14T12:19:45.250696+0000","last_peered":"2023-10-14T12:19:45.250696+0000","last_clean":"2023-10-14T12:19:45.250696+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:19:45.250696+0000","last_undegraded":"2023-10-14T12:19:45.250696+0000","last_fullsized":"2023-10-14T12:19:45.250696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451711+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:45.451711+0000","last_peered":"2023-10-14T12:19:45.451711+0000","last_clean":"2023-10-14T12:19:45.451711+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:45.451711+0000","last_undegraded":"2023-10-14T12:19:45.451711+0000","last_fullsized":"2023-10-14T12:19:45.451711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374493+0000","last_change":"2023-10-14T12:19:42.374263+0000","last_active":"2023-10-14T12:19:44.374493+0000","last_peered":"2023-10-14T12:19:44.374493+0000","last_clean":"2023-10-14T12:19:44.374493+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:19:44.374493+0000","last_undegraded":"2023-10-14T12:19:44.374493+0000","last_fullsized":"2023-10-14T12:19:44.374493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:59.390912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452292+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:45.452292+0000","last_peered":"2023-10-14T12:19:45.452292+0000","last_clean":"2023-10-14T12:19:45.452292+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:45.452292+0000","last_undegraded":"2023-10-14T12:19:45.452292+0000","last_fullsized":"2023-10-14T12:19:45.452292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370652+0000","last_change":"2023-10-14T12:19:42.377643+0000","last_active":"2023-10-14T12:19:44.370652+0000","last_peered":"2023-10-14T12:19:44.370652+0000","last_clean":"2023-10-14T12:19:44.370652+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:44.370652+0000","last_undegraded":"2023-10-14T12:19:44.370652+0000","last_fullsized":"2023-10-14T12:19:44.370652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:00.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950565+0000","last_change":"2023-10-14T12:19:43.389426+0000","last_active":"2023-10-14T12:19:44.950565+0000","last_peered":"2023-10-14T12:19:44.950565+0000","last_clean":"2023-10-14T12:19:44.950565+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:19:44.950565+0000","last_undegraded":"2023-10-14T12:19:44.950565+0000","last_fullsized":"2023-10-14T12:19:44.950565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179883+0000","last_change":"2023-10-14T12:19:42.375646+0000","last_active":"2023-10-14T12:19:45.179883+0000","last_peered":"2023-10-14T12:19:45.179883+0000","last_clean":"2023-10-14T12:19:45.179883+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:19:45.179883+0000","last_undegraded":"2023-10-14T12:19:45.179883+0000","last_fullsized":"2023-10-14T12:19:45.179883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374300+0000","last_change":"2023-10-14T12:19:43.390502+0000","last_active":"2023-10-14T12:19:44.374300+0000","last_peered":"2023-10-14T12:19:44.374300+0000","last_clean":"2023-10-14T12:19:44.374300+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:19:44.374300+0000","last_undegraded":"2023-10-14T12:19:44.374300+0000","last_fullsized":"2023-10-14T12:19:44.374300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179837+0000","last_change":"2023-10-14T12:19:42.375014+0000","last_active":"2023-10-14T12:19:45.179837+0000","last_peered":"2023-10-14T12:19:45.179837+0000","last_clean":"2023-10-14T12:19:45.179837+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:19:45.179837+0000","last_undegraded":"2023-10-14T12:19:45.179837+0000","last_fullsized":"2023-10-14T12:19:45.179837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:36.593916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451210+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:45.451210+0000","last_peered":"2023-10-14T12:19:45.451210+0000","last_clean":"2023-10-14T12:19:45.451210+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:45.451210+0000","last_undegraded":"2023-10-14T12:19:45.451210+0000","last_fullsized":"2023-10-14T12:19:45.451210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373966+0000","last_change":"2023-10-14T12:19:42.373819+0000","last_active":"2023-10-14T12:19:44.373966+0000","last_peered":"2023-10-14T12:19:44.373966+0000","last_clean":"2023-10-14T12:19:44.373966+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:19:44.373966+0000","last_undegraded":"2023-10-14T12:19:44.373966+0000","last_fullsized":"2023-10-14T12:19:44.373966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451313+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:45.451313+0000","last_peered":"2023-10-14T12:19:45.451313+0000","last_clean":"2023-10-14T12:19:45.451313+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:45.451313+0000","last_undegraded":"2023-10-14T12:19:45.451313+0000","last_fullsized":"2023-10-14T12:19:45.451313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179741+0000","last_change":"2023-10-14T12:19:42.372089+0000","last_active":"2023-10-14T12:19:45.179741+0000","last_peered":"2023-10-14T12:19:45.179741+0000","last_clean":"2023-10-14T12:19:45.179741+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:19:45.179741+0000","last_undegraded":"2023-10-14T12:19:45.179741+0000","last_fullsized":"2023-10-14T12:19:45.179741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:22.438051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374586+0000","last_change":"2023-10-14T12:19:43.382324+0000","last_active":"2023-10-14T12:19:44.374586+0000","last_peered":"2023-10-14T12:19:44.374586+0000","last_clean":"2023-10-14T12:19:44.374586+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:19:44.374586+0000","last_undegraded":"2023-10-14T12:19:44.374586+0000","last_fullsized":"2023-10-14T12:19:44.374586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374708+0000","last_change":"2023-10-14T12:19:42.372382+0000","last_active":"2023-10-14T12:19:44.374708+0000","last_peered":"2023-10-14T12:19:44.374708+0000","last_clean":"2023-10-14T12:19:44.374708+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:19:44.374708+0000","last_undegraded":"2023-10-14T12:19:44.374708+0000","last_fullsized":"2023-10-14T12:19:44.374708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374844+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:44.374844+0000","last_peered":"2023-10-14T12:19:44.374844+0000","last_clean":"2023-10-14T12:19:44.374844+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:44.374844+0000","last_undegraded":"2023-10-14T12:19:44.374844+0000","last_fullsized":"2023-10-14T12:19:44.374844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:47:38.320770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250724+0000","last_change":"2023-10-14T12:19:42.376458+0000","last_active":"2023-10-14T12:19:45.250724+0000","last_peered":"2023-10-14T12:19:45.250724+0000","last_clean":"2023-10-14T12:19:45.250724+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:19:45.250724+0000","last_undegraded":"2023-10-14T12:19:45.250724+0000","last_fullsized":"2023-10-14T12:19:45.250724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374529+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:44.374529+0000","last_peered":"2023-10-14T12:19:44.374529+0000","last_clean":"2023-10-14T12:19:44.374529+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:44.374529+0000","last_undegraded":"2023-10-14T12:19:44.374529+0000","last_fullsized":"2023-10-14T12:19:44.374529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374572+0000","last_change":"2023-10-14T12:19:42.373797+0000","last_active":"2023-10-14T12:19:44.374572+0000","last_peered":"2023-10-14T12:19:44.374572+0000","last_clean":"2023-10-14T12:19:44.374572+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:19:44.374572+0000","last_undegraded":"2023-10-14T12:19:44.374572+0000","last_fullsized":"2023-10-14T12:19:44.374572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:21.195047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374459+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:44.374459+0000","last_peered":"2023-10-14T12:19:44.374459+0000","last_clean":"2023-10-14T12:19:44.374459+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:44.374459+0000","last_undegraded":"2023-10-14T12:19:44.374459+0000","last_fullsized":"2023-10-14T12:19:44.374459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374488+0000","last_change":"2023-10-14T12:19:42.371158+0000","last_active":"2023-10-14T12:19:44.374488+0000","last_peered":"2023-10-14T12:19:44.374488+0000","last_clean":"2023-10-14T12:19:44.374488+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:19:44.374488+0000","last_undegraded":"2023-10-14T12:19:44.374488+0000","last_fullsized":"2023-10-14T12:19:44.374488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:24.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451638+0000","last_change":"2023-10-14T12:19:43.380181+0000","last_active":"2023-10-14T12:19:45.451638+0000","last_peered":"2023-10-14T12:19:45.451638+0000","last_clean":"2023-10-14T12:19:45.451638+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:19:45.451638+0000","last_undegraded":"2023-10-14T12:19:45.451638+0000","last_fullsized":"2023-10-14T12:19:45.451638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179895+0000","last_change":"2023-10-14T12:19:42.373775+0000","last_active":"2023-10-14T12:19:45.179895+0000","last_peered":"2023-10-14T12:19:45.179895+0000","last_clean":"2023-10-14T12:19:45.179895+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:19:45.179895+0000","last_undegraded":"2023-10-14T12:19:45.179895+0000","last_fullsized":"2023-10-14T12:19:45.179895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374439+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:44.374439+0000","last_peered":"2023-10-14T12:19:44.374439+0000","last_clean":"2023-10-14T12:19:44.374439+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:44.374439+0000","last_undegraded":"2023-10-14T12:19:44.374439+0000","last_fullsized":"2023-10-14T12:19:44.374439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173778+0000","last_change":"2023-10-14T12:19:42.373838+0000","last_active":"2023-10-14T12:19:45.173778+0000","last_peered":"2023-10-14T12:19:45.173778+0000","last_clean":"2023-10-14T12:19:45.173778+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:19:45.173778+0000","last_undegraded":"2023-10-14T12:19:45.173778+0000","last_fullsized":"2023-10-14T12:19:45.173778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950851+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:44.950851+0000","last_peered":"2023-10-14T12:19:44.950851+0000","last_clean":"2023-10-14T12:19:44.950851+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:44.950851+0000","last_undegraded":"2023-10-14T12:19:44.950851+0000","last_fullsized":"2023-10-14T12:19:44.950851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374044+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:44.374044+0000","last_peered":"2023-10-14T12:19:44.374044+0000","last_clean":"2023-10-14T12:19:44.374044+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:44.374044+0000","last_undegraded":"2023-10-14T12:19:44.374044+0000","last_fullsized":"2023-10-14T12:19:44.374044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451127+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:45.451127+0000","last_peered":"2023-10-14T12:19:45.451127+0000","last_clean":"2023-10-14T12:19:45.451127+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:45.451127+0000","last_undegraded":"2023-10-14T12:19:45.451127+0000","last_fullsized":"2023-10-14T12:19:45.451127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:31.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374022+0000","last_change":"2023-10-14T12:19:42.373204+0000","last_active":"2023-10-14T12:19:44.374022+0000","last_peered":"2023-10-14T12:19:44.374022+0000","last_clean":"2023-10-14T12:19:44.374022+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:19:44.374022+0000","last_undegraded":"2023-10-14T12:19:44.374022+0000","last_fullsized":"2023-10-14T12:19:44.374022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:40.688686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451830+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:45.451830+0000","last_peered":"2023-10-14T12:19:45.451830+0000","last_clean":"2023-10-14T12:19:45.451830+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:45.451830+0000","last_undegraded":"2023-10-14T12:19:45.451830+0000","last_fullsized":"2023-10-14T12:19:45.451830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173941+0000","last_change":"2023-10-14T12:19:42.376646+0000","last_active":"2023-10-14T12:19:45.173941+0000","last_peered":"2023-10-14T12:19:45.173941+0000","last_clean":"2023-10-14T12:19:45.173941+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:19:45.173941+0000","last_undegraded":"2023-10-14T12:19:45.173941+0000","last_fullsized":"2023-10-14T12:19:45.173941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:37.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374521+0000","last_change":"2023-10-14T12:19:43.388112+0000","last_active":"2023-10-14T12:19:44.374521+0000","last_peered":"2023-10-14T12:19:44.374521+0000","last_clean":"2023-10-14T12:19:44.374521+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:19:44.374521+0000","last_undegraded":"2023-10-14T12:19:44.374521+0000","last_fullsized":"2023-10-14T12:19:44.374521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179959+0000","last_change":"2023-10-14T12:19:42.373858+0000","last_active":"2023-10-14T12:19:45.179959+0000","last_peered":"2023-10-14T12:19:45.179959+0000","last_clean":"2023-10-14T12:19:45.179959+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:19:45.179959+0000","last_undegraded":"2023-10-14T12:19:45.179959+0000","last_fullsized":"2023-10-14T12:19:45.179959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452035+0000","last_change":"2023-10-14T12:19:43.388334+0000","last_active":"2023-10-14T12:19:45.452035+0000","last_peered":"2023-10-14T12:19:45.452035+0000","last_clean":"2023-10-14T12:19:45.452035+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:19:45.452035+0000","last_undegraded":"2023-10-14T12:19:45.452035+0000","last_fullsized":"2023-10-14T12:19:45.452035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179931+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:45.179931+0000","last_peered":"2023-10-14T12:19:45.179931+0000","last_clean":"2023-10-14T12:19:45.179931+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:45.179931+0000","last_undegraded":"2023-10-14T12:19:45.179931+0000","last_fullsized":"2023-10-14T12:19:45.179931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:12.099355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370543+0000","last_change":"2023-10-14T12:19:43.384205+0000","last_active":"2023-10-14T12:19:44.370543+0000","last_peered":"2023-10-14T12:19:44.370543+0000","last_clean":"2023-10-14T12:19:44.370543+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:19:44.370543+0000","last_undegraded":"2023-10-14T12:19:44.370543+0000","last_fullsized":"2023-10-14T12:19:44.370543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:37.599241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179917+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:45.179917+0000","last_peered":"2023-10-14T12:19:45.179917+0000","last_clean":"2023-10-14T12:19:45.179917+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:45.179917+0000","last_undegraded":"2023-10-14T12:19:45.179917+0000","last_fullsized":"2023-10-14T12:19:45.179917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:19.606346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370619+0000","last_change":"2023-10-14T12:19:43.388769+0000","last_active":"2023-10-14T12:19:44.370619+0000","last_peered":"2023-10-14T12:19:44.370619+0000","last_clean":"2023-10-14T12:19:44.370619+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:19:44.370619+0000","last_undegraded":"2023-10-14T12:19:44.370619+0000","last_fullsized":"2023-10-14T12:19:44.370619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250596+0000","last_change":"2023-10-14T12:19:42.378784+0000","last_active":"2023-10-14T12:19:45.250596+0000","last_peered":"2023-10-14T12:19:45.250596+0000","last_clean":"2023-10-14T12:19:45.250596+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:45.250596+0000","last_undegraded":"2023-10-14T12:19:45.250596+0000","last_fullsized":"2023-10-14T12:19:45.250596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370513+0000","last_change":"2023-10-14T12:19:43.390194+0000","last_active":"2023-10-14T12:19:44.370513+0000","last_peered":"2023-10-14T12:19:44.370513+0000","last_clean":"2023-10-14T12:19:44.370513+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:19:44.370513+0000","last_undegraded":"2023-10-14T12:19:44.370513+0000","last_fullsized":"2023-10-14T12:19:44.370513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:13.104681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179660+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:45.179660+0000","last_peered":"2023-10-14T12:19:45.179660+0000","last_clean":"2023-10-14T12:19:45.179660+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:45.179660+0000","last_undegraded":"2023-10-14T12:19:45.179660+0000","last_fullsized":"2023-10-14T12:19:45.179660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370406+0000","last_change":"2023-10-14T12:19:43.382787+0000","last_active":"2023-10-14T12:19:44.370406+0000","last_peered":"2023-10-14T12:19:44.370406+0000","last_clean":"2023-10-14T12:19:44.370406+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:19:44.370406+0000","last_undegraded":"2023-10-14T12:19:44.370406+0000","last_fullsized":"2023-10-14T12:19:44.370406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179805+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:45.179805+0000","last_peered":"2023-10-14T12:19:45.179805+0000","last_clean":"2023-10-14T12:19:45.179805+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:45.179805+0000","last_undegraded":"2023-10-14T12:19:45.179805+0000","last_fullsized":"2023-10-14T12:19:45.179805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:17.650999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950643+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:44.950643+0000","last_peered":"2023-10-14T12:19:44.950643+0000","last_clean":"2023-10-14T12:19:44.950643+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:44.950643+0000","last_undegraded":"2023-10-14T12:19:44.950643+0000","last_fullsized":"2023-10-14T12:19:44.950643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373934+0000","last_change":"2023-10-14T12:19:42.377594+0000","last_active":"2023-10-14T12:19:44.373934+0000","last_peered":"2023-10-14T12:19:44.373934+0000","last_clean":"2023-10-14T12:19:44.373934+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:44.373934+0000","last_undegraded":"2023-10-14T12:19:44.373934+0000","last_fullsized":"2023-10-14T12:19:44.373934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370575+0000","last_change":"2023-10-14T12:19:43.388662+0000","last_active":"2023-10-14T12:19:44.370575+0000","last_peered":"2023-10-14T12:19:44.370575+0000","last_clean":"2023-10-14T12:19:44.370575+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:19:44.370575+0000","last_undegraded":"2023-10-14T12:19:44.370575+0000","last_fullsized":"2023-10-14T12:19:44.370575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:20.611672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173898+0000","last_change":"2023-10-14T12:19:42.377243+0000","last_active":"2023-10-14T12:19:45.173898+0000","last_peered":"2023-10-14T12:19:45.173898+0000","last_clean":"2023-10-14T12:19:45.173898+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:19:45.173898+0000","last_undegraded":"2023-10-14T12:19:45.173898+0000","last_fullsized":"2023-10-14T12:19:45.173898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:55.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374463+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:44.374463+0000","last_peered":"2023-10-14T12:19:44.374463+0000","last_clean":"2023-10-14T12:19:44.374463+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:44.374463+0000","last_undegraded":"2023-10-14T12:19:44.374463+0000","last_fullsized":"2023-10-14T12:19:44.374463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451670+0000","last_change":"2023-10-14T12:19:42.378619+0000","last_active":"2023-10-14T12:19:45.451670+0000","last_peered":"2023-10-14T12:19:45.451670+0000","last_clean":"2023-10-14T12:19:45.451670+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:19:45.451670+0000","last_undegraded":"2023-10-14T12:19:45.451670+0000","last_fullsized":"2023-10-14T12:19:45.451670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451627+0000","last_change":"2023-10-14T12:19:43.389128+0000","last_active":"2023-10-14T12:19:45.451627+0000","last_peered":"2023-10-14T12:19:45.451627+0000","last_clean":"2023-10-14T12:19:45.451627+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:19:45.451627+0000","last_undegraded":"2023-10-14T12:19:45.451627+0000","last_fullsized":"2023-10-14T12:19:45.451627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173817+0000","last_change":"2023-10-14T12:19:42.371259+0000","last_active":"2023-10-14T12:19:45.173817+0000","last_peered":"2023-10-14T12:19:45.173817+0000","last_clean":"2023-10-14T12:19:45.173817+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:19:45.173817+0000","last_undegraded":"2023-10-14T12:19:45.173817+0000","last_fullsized":"2023-10-14T12:19:45.173817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:34.980122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451233+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:45.451233+0000","last_peered":"2023-10-14T12:19:45.451233+0000","last_clean":"2023-10-14T12:19:45.451233+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:45.451233+0000","last_undegraded":"2023-10-14T12:19:45.451233+0000","last_fullsized":"2023-10-14T12:19:45.451233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250581+0000","last_change":"2023-10-14T12:19:42.371970+0000","last_active":"2023-10-14T12:19:45.250581+0000","last_peered":"2023-10-14T12:19:45.250581+0000","last_clean":"2023-10-14T12:19:45.250581+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:45.250581+0000","last_undegraded":"2023-10-14T12:19:45.250581+0000","last_fullsized":"2023-10-14T12:19:45.250581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:17.853714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451947+0000","last_change":"2023-10-14T12:19:43.388360+0000","last_active":"2023-10-14T12:19:45.451947+0000","last_peered":"2023-10-14T12:19:45.451947+0000","last_clean":"2023-10-14T12:19:45.451947+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:19:45.451947+0000","last_undegraded":"2023-10-14T12:19:45.451947+0000","last_fullsized":"2023-10-14T12:19:45.451947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173792+0000","last_change":"2023-10-14T12:19:42.376964+0000","last_active":"2023-10-14T12:19:45.173792+0000","last_peered":"2023-10-14T12:19:45.173792+0000","last_clean":"2023-10-14T12:19:45.173792+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:45.173792+0000","last_undegraded":"2023-10-14T12:19:45.173792+0000","last_fullsized":"2023-10-14T12:19:45.173792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:34.064338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374083+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:44.374083+0000","last_peered":"2023-10-14T12:19:44.374083+0000","last_clean":"2023-10-14T12:19:44.374083+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:44.374083+0000","last_undegraded":"2023-10-14T12:19:44.374083+0000","last_fullsized":"2023-10-14T12:19:44.374083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179816+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:45.179816+0000","last_peered":"2023-10-14T12:19:45.179816+0000","last_clean":"2023-10-14T12:19:45.179816+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:45.179816+0000","last_undegraded":"2023-10-14T12:19:45.179816+0000","last_fullsized":"2023-10-14T12:19:45.179816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:09.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451226+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:45.451226+0000","last_peered":"2023-10-14T12:19:45.451226+0000","last_clean":"2023-10-14T12:19:45.451226+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:45.451226+0000","last_undegraded":"2023-10-14T12:19:45.451226+0000","last_fullsized":"2023-10-14T12:19:45.451226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373897+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:44.373897+0000","last_peered":"2023-10-14T12:19:44.373897+0000","last_clean":"2023-10-14T12:19:44.373897+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:44.373897+0000","last_undegraded":"2023-10-14T12:19:44.373897+0000","last_fullsized":"2023-10-14T12:19:44.373897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:51.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950724+0000","last_change":"2023-10-14T12:19:43.385662+0000","last_active":"2023-10-14T12:19:44.950724+0000","last_peered":"2023-10-14T12:19:44.950724+0000","last_clean":"2023-10-14T12:19:44.950724+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:19:44.950724+0000","last_undegraded":"2023-10-14T12:19:44.950724+0000","last_fullsized":"2023-10-14T12:19:44.950724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179683+0000","last_change":"2023-10-14T12:19:42.371684+0000","last_active":"2023-10-14T12:19:45.179683+0000","last_peered":"2023-10-14T12:19:45.179683+0000","last_clean":"2023-10-14T12:19:45.179683+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:45.179683+0000","last_undegraded":"2023-10-14T12:19:45.179683+0000","last_fullsized":"2023-10-14T12:19:45.179683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:56.045404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373248+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:19:43.373248+0000","last_peered":"2023-10-14T12:19:43.373248+0000","last_clean":"2023-10-14T12:19:43.373248+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:19:43.373248+0000","last_undegraded":"2023-10-14T12:19:43.373248+0000","last_fullsized":"2023-10-14T12:19:43.373248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.624},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73499999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.629}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29799999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.41199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.376},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.443}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.59199999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.496},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.375},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.497}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.751},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.746},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:19:52.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:19:52.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.870+0000 7fa448b65700 1 Processor -- start 2023-10-14T12:19:52.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.870+0000 7fa448b65700 1 -- start start 2023-10-14T12:19:52.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa448b65700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cd950 0x7fa44415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa448b65700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa4440cede0 0x7fa44415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa448b65700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4440cf260 con 0x7fa44406a840 2023-10-14T12:19:52.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa448b65700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4441619a0 con 0x7fa4440cede0 2023-10-14T12:19:52.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa448b65700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440b2d60 con 0x7fa4440cd950 2023-10-14T12:19:52.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa4440cede0 0x7fa44415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa4440cede0 0x7fa44415f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40082/0 (socket says 172.21.15.32:40082) 2023-10-14T12:19:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 -- 172.21.15.32:0/3064294656 learned_addr learned my addr 172.21.15.32:0/3064294656 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa44259c700 1 --2- 172.21.15.32:0/3064294656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cd950 0x7fa44415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 -- 172.21.15.32:0/3064294656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cd950 msgr2=0x7fa44415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 --2- 172.21.15.32:0/3064294656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cd950 0x7fa44415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 -- 172.21.15.32:0/3064294656 >> v1:172.21.15.92:6789/0 conn(0x7fa44406a840 legacy=0x7fa444161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 -- 172.21.15.32:0/3064294656 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440cdd30 con 0x7fa4440cede0 2023-10-14T12:19:52.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa441d9b700 1 --2- 172.21.15.32:0/3064294656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4440cede0 0x7fa44415f570 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dd4c1117e60247 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa44159a700 1 -- 172.21.15.32:0/3064294656 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438005e30 con 0x7fa4440cede0 2023-10-14T12:19:52.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa44159a700 1 -- 172.21.15.32:0/3064294656 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438004030 con 0x7fa4440cede0 2023-10-14T12:19:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.871+0000 7fa44159a700 1 -- 172.21.15.32:0/3064294656 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380043e0 con 0x7fa4440cede0 2023-10-14T12:19:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 -- 172.21.15.32:0/3064294656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4440cede0 msgr2=0x7fa44415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 --2- 172.21.15.32:0/3064294656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4440cede0 0x7fa44415f570 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 -- 172.21.15.32:0/3064294656 shutdown_connections 2023-10-14T12:19:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 --2- 172.21.15.32:0/3064294656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cd950 0x7fa44415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 --2- 172.21.15.32:0/3064294656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4440cede0 0x7fa44415f570 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 -- 172.21.15.32:0/3064294656 >> 172.21.15.32:0/3064294656 conn(0x7fa44406dae0 msgr2=0x7fa44406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:52.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 -- 172.21.15.32:0/3064294656 shutdown_connections 2023-10-14T12:19:52.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.872+0000 7fa448b65700 1 -- 172.21.15.32:0/3064294656 wait complete. 2023-10-14T12:19:52.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.873+0000 7fa448b65700 1 Processor -- start 2023-10-14T12:19:52.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.873+0000 7fa448b65700 1 -- start start 2023-10-14T12:19:52.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa448b65700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 0x7fa4441f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa448b65700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4440cd950 0x7fa4441f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa448b65700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cede0 0x7fa4440c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa448b65700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c4130 con 0x7fa44406a840 2023-10-14T12:19:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa448b65700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c4410 con 0x7fa4440cd950 2023-10-14T12:19:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa448b65700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c46f0 con 0x7fa4440cede0 2023-10-14T12:19:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa44259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 0x7fa4441f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa44259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 0x7fa4441f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40086/0 (socket says 172.21.15.32:40086) 2023-10-14T12:19:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.874+0000 7fa44259c700 1 -- 172.21.15.32:0/3249827118 learned_addr learned my addr 172.21.15.32:0/3249827118 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa442d9d700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cede0 0x7fa4440c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa44259c700 1 -- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cede0 msgr2=0x7fa4440c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa44259c700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cede0 0x7fa4440c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa44259c700 1 -- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4440cd950 msgr2=0x7fa4441f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:52.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa441d9b700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4440cd950 0x7fa4441f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa44259c700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4440cd950 0x7fa4441f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:52.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa44259c700 1 -- 172.21.15.32:0/3249827118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438009500 con 0x7fa44406a840 2023-10-14T12:19:52.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa441d9b700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4440cd950 0x7fa4441f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:52.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa44259c700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 0x7fa4441f2fd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa43400e810 tx=0x7fa43400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434013610 con 0x7fa44406a840 2023-10-14T12:19:52.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434013770 con 0x7fa44406a840 2023-10-14T12:19:52.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4440c49d0 con 0x7fa44406a840 2023-10-14T12:19:52.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434013b20 con 0x7fa44406a840 2023-10-14T12:19:52.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.875+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4441f3510 con 0x7fa44406a840 2023-10-14T12:19:52.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.876+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa444160540 con 0x7fa44406a840 2023-10-14T12:19:52.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.876+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa434013c80 con 0x7fa44406a840 2023-10-14T12:19:52.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.877+0000 7fa432ffd700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa42406af00 0x7fa42406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:52.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.877+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa434089330 con 0x7fa44406a840 2023-10-14T12:19:52.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.877+0000 7fa441d9b700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa42406af00 0x7fa42406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:52.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.878+0000 7fa441d9b700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa42406af00 0x7fa42406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa438014040 tx=0x7fa438008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:52.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:52.881+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4340543d0 con 0x7fa44406a840 2023-10-14T12:19:53.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.084+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa444067d20 con 0x7fa44406a840 2023-10-14T12:19:53.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.085+0000 7fa432ffd700 1 -- 172.21.15.32:0/3249827118 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fa4340579f0 con 0x7fa44406a840 2023-10-14T12:19:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:53.087 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":32,"fsid":"9c9ba1f9-1c9e-46f6-8a30-4dee56baf6ed","created":"2023-10-14T12:18:29.404295+0000","modified":"2023-10-14T12:19:44.367373+0000","last_up_change":"2023-10-14T12:18:39.323337+0000","last_in_change":"2023-10-14T12:18:31.858033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:18:41.151000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:19:40.903437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:19:41.752188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a30f715-7217-41fb-87f2-3b54902f54b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6801","nonce":3987087050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6803","nonce":3987087050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6807","nonce":3987087050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3987087050},{"type":"v1","addr":"172.21.15.32:6805","nonce":3987087050}]},"public_addr":"172.21.15.32:6801/3987087050","cluster_addr":"172.21.15.32:6803/3987087050","heartbeat_back_addr":"172.21.15.32:6807/3987087050","heartbeat_front_addr":"172.21.15.32:6805/3987087050","state":["exists","up"]},{"osd":1,"uuid":"b510ad79-25de-47e7-896b-747dd8488598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6809","nonce":3306403672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6811","nonce":3306403672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6815","nonce":3306403672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3306403672},{"type":"v1","addr":"172.21.15.32:6813","nonce":3306403672}]},"public_addr":"172.21.15.32:6809/3306403672","cluster_addr":"172.21.15.32:6811/3306403672","heartbeat_back_addr":"172.21.15.32:6815/3306403672","heartbeat_front_addr":"172.21.15.32:6813/3306403672","state":["exists","up"]},{"osd":2,"uuid":"7e2e45a9-a69f-4a75-8c80-206635e8a7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6819","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6821","nonce":2045586294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6825","nonce":2045586294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6831","nonce":2045586294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":2045586294},{"type":"v1","addr":"172.21.15.32:6828","nonce":2045586294}]},"public_addr":"172.21.15.32:6821/2045586294","cluster_addr":"172.21.15.32:6825/2045586294","heartbeat_back_addr":"172.21.15.32:6831/2045586294","heartbeat_front_addr":"172.21.15.32:6828/2045586294","state":["exists","up"]},{"osd":3,"uuid":"42e9134f-a98b-4516-ac90-0a8edb83f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6817","nonce":4217654174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6820","nonce":4217654174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6829","nonce":4217654174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":4217654174},{"type":"v1","addr":"172.21.15.32:6824","nonce":4217654174}]},"public_addr":"172.21.15.32:6817/4217654174","cluster_addr":"172.21.15.32:6820/4217654174","heartbeat_back_addr":"172.21.15.32:6829/4217654174","heartbeat_front_addr":"172.21.15.32:6824/4217654174","state":["exists","up"]},{"osd":4,"uuid":"9ec6a0f5-42d3-4763-8f02-933f9ffd4e6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6801","nonce":2175015118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6803","nonce":2175015118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6807","nonce":2175015118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2175015118},{"type":"v1","addr":"172.21.15.92:6805","nonce":2175015118}]},"public_addr":"172.21.15.92:6801/2175015118","cluster_addr":"172.21.15.92:6803/2175015118","heartbeat_back_addr":"172.21.15.92:6807/2175015118","heartbeat_front_addr":"172.21.15.92:6805/2175015118","state":["exists","up"]},{"osd":5,"uuid":"e2d13906-ef87-447f-bac3-9371176c87c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6809","nonce":2463723168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6811","nonce":2463723168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6815","nonce":2463723168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2463723168},{"type":"v1","addr":"172.21.15.92:6813","nonce":2463723168}]},"public_addr":"172.21.15.92:6809/2463723168","cluster_addr":"172.21.15.92:6811/2463723168","heartbeat_back_addr":"172.21.15.92:6815/2463723168","heartbeat_front_addr":"172.21.15.92:6813/2463723168","state":["exists","up"]},{"osd":6,"uuid":"b2885cf8-8304-4748-8f49-664b88012f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6818","nonce":1317212629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6822","nonce":1317212629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6830","nonce":1317212629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1317212629},{"type":"v1","addr":"172.21.15.92:6826","nonce":1317212629}]},"public_addr":"172.21.15.92:6818/1317212629","cluster_addr":"172.21.15.92:6822/1317212629","heartbeat_back_addr":"172.21.15.92:6830/1317212629","heartbeat_front_addr":"172.21.15.92:6826/1317212629","state":["exists","up"]},{"osd":7,"uuid":"09251b8b-4019-4e97-968a-b24fa2abc702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6819","nonce":769790747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6823","nonce":769790747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6831","nonce":769790747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":769790747},{"type":"v1","addr":"172.21.15.92:6827","nonce":769790747}]},"public_addr":"172.21.15.92:6819/769790747","cluster_addr":"172.21.15.92:6823/769790747","heartbeat_back_addr":"172.21.15.92:6831/769790747","heartbeat_front_addr":"172.21.15.92:6827/769790747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.049937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.051965+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.060556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.109338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.717839+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.028257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:36.990861+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:18:37.071124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:19:53.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa42406af00 msgr2=0x7fa42406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:53.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa42406af00 0x7fa42406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa438014040 tx=0x7fa438008070 comp rx=0 tx=0).stop 2023-10-14T12:19:53.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 msgr2=0x7fa4441f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:53.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 0x7fa4441f2fd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa43400e810 tx=0x7fa43400ebd0 comp rx=0 tx=0).stop 2023-10-14T12:19:53.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 shutdown_connections 2023-10-14T12:19:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4440cede0 0x7fa4440c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa44406a840 0x7fa4441f2fd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fa42406af00 0x7fa42406d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 --2- 172.21.15.32:0/3249827118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4440cd950 0x7fa4441f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 >> 172.21.15.32:0/3249827118 conn(0x7fa44406dae0 msgr2=0x7fa4440aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 shutdown_connections 2023-10-14T12:19:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:53.088+0000 7fa448b65700 1 -- 172.21.15.32:0/3249827118 wait complete. 2023-10-14T12:19:54.103 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T12:19:54.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:54.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.247+0000 7fb87883e700 1 Processor -- start 2023-10-14T12:19:54.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.247+0000 7fb87883e700 1 -- start start 2023-10-14T12:19:54.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87883e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb874151680 0x7fb87415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87883e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8740727e0 0x7fb8740b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87883e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb87406da30 0x7fb87406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87883e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87406e420 con 0x7fb87406da30 2023-10-14T12:19:54.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87883e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8740b2e40 con 0x7fb874151680 2023-10-14T12:19:54.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87883e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87415e7c0 con 0x7fb8740727e0 2023-10-14T12:19:54.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb872d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb87406da30 0x7fb87406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb872d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb87406da30 0x7fb87406dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40098/0 (socket says 172.21.15.32:40098) 2023-10-14T12:19:54.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb872d9d700 1 -- 172.21.15.32:0/2785962624 learned_addr learned my addr 172.21.15.32:0/2785962624 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb87259c700 1 --2- 172.21.15.32:0/2785962624 >> v2:172.21.15.92:3300/0 conn(0x7fb874151680 0x7fb87415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.248+0000 7fb871d9b700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8740727e0 0x7fb8740b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb872d9d700 1 -- 172.21.15.32:0/2785962624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8740727e0 msgr2=0x7fb8740b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb872d9d700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8740727e0 0x7fb8740b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb872d9d700 1 -- 172.21.15.32:0/2785962624 >> v2:172.21.15.92:3300/0 conn(0x7fb874151680 msgr2=0x7fb87415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb872d9d700 1 --2- 172.21.15.32:0/2785962624 >> v2:172.21.15.92:3300/0 conn(0x7fb874151680 0x7fb87415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb872d9d700 1 -- 172.21.15.32:0/2785962624 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740b2880 con 0x7fb87406da30 2023-10-14T12:19:54.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb871d9b700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8740727e0 0x7fb8740b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:54.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb872d9d700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb87406da30 0x7fb87406dee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb8740721f0 tx=0x7fb86c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e75dc8c7df003c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb87159a700 1 -- 172.21.15.32:0/2785962624 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00e070 con 0x7fb87406da30 2023-10-14T12:19:54.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb87159a700 1 -- 172.21.15.32:0/2785962624 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00b910 con 0x7fb87406da30 2023-10-14T12:19:54.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.249+0000 7fb87159a700 1 -- 172.21.15.32:0/2785962624 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00bcc0 con 0x7fb87406da30 2023-10-14T12:19:54.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 -- 172.21.15.32:0/2785962624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb87406da30 msgr2=0x7fb87406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb87406da30 0x7fb87406dee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb8740721f0 tx=0x7fb86c00b330 comp rx=0 tx=0).stop 2023-10-14T12:19:54.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 -- 172.21.15.32:0/2785962624 shutdown_connections 2023-10-14T12:19:54.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb87406da30 0x7fb87406dee0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 --2- 172.21.15.32:0/2785962624 >> v2:172.21.15.92:3300/0 conn(0x7fb874151680 0x7fb87415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 --2- 172.21.15.32:0/2785962624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8740727e0 0x7fb8740b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 -- 172.21.15.32:0/2785962624 >> 172.21.15.32:0/2785962624 conn(0x7fb87406bd70 msgr2=0x7fb87406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 -- 172.21.15.32:0/2785962624 shutdown_connections 2023-10-14T12:19:54.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.250+0000 7fb87883e700 1 -- 172.21.15.32:0/2785962624 wait complete. 2023-10-14T12:19:54.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.251+0000 7fb87883e700 1 Processor -- start 2023-10-14T12:19:54.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.251+0000 7fb87883e700 1 -- start start 2023-10-14T12:19:54.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87883e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb87406da30 0x7fb8740b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87883e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8740727e0 0x7fb8740c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87883e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb874151680 0x7fb87414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87883e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740c6d90 con 0x7fb874151680 2023-10-14T12:19:54.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87883e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740b46c0 con 0x7fb8740727e0 2023-10-14T12:19:54.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87883e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740b49a0 con 0x7fb87406da30 2023-10-14T12:19:54.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb874151680 0x7fb87414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb874151680 0x7fb87414d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40104/0 (socket says 172.21.15.32:40104) 2023-10-14T12:19:54.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 -- 172.21.15.32:0/1711029884 learned_addr learned my addr 172.21.15.32:0/1711029884 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb87259c700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb87406da30 0x7fb8740b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb871d9b700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8740727e0 0x7fb8740c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 -- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb87406da30 msgr2=0x7fb8740b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb87406da30 0x7fb8740b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 -- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8740727e0 msgr2=0x7fb8740c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.252+0000 7fb872d9d700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8740727e0 0x7fb8740c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb872d9d700 1 -- 172.21.15.32:0/1711029884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009b30 con 0x7fb874151680 2023-10-14T12:19:54.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb872d9d700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb874151680 0x7fb87414d660 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb87406e7e0 tx=0x7fb86c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0099b0 con 0x7fb874151680 2023-10-14T12:19:54.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c0092e0 con 0x7fb874151680 2023-10-14T12:19:54.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8740b4c80 con 0x7fb874151680 2023-10-14T12:19:54.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c004470 con 0x7fb874151680 2023-10-14T12:19:54.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.253+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8740b5240 con 0x7fb874151680 2023-10-14T12:19:54.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.254+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb87415e450 con 0x7fb874151680 2023-10-14T12:19:54.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.254+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb86c0045d0 con 0x7fb874151680 2023-10-14T12:19:54.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb862ffd700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb85406af00 0x7fb85406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb86c08a590 con 0x7fb874151680 2023-10-14T12:19:54.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb862ffd700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7fb854073100 0x7fb854075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 --> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb854075c10 con 0x7fb854073100 2023-10-14T12:19:54.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb86c08cc50 con 0x7fb874151680 2023-10-14T12:19:54.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb87259c700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb85406af00 0x7fb85406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb871d9b700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7fb854073100 0x7fb854075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.255+0000 7fb871d9b700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7fb854073100 0x7fb854075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.256+0000 7fb87259c700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb85406af00 0x7fb85406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb868009be0 tx=0x7fb868009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.256+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== osd.0 v2:172.21.15.32:6800/3987087050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb854075c10 con 0x7fb854073100 2023-10-14T12:19:54.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.271+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 --> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8740b2b60 con 0x7fb854073100 2023-10-14T12:19:54.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.271+0000 7fb862ffd700 1 -- 172.21.15.32:0/1711029884 <== osd.0 v2:172.21.15.32:6800/3987087050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb864003760 con 0x7fb854073100 2023-10-14T12:19:54.281 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:54.281 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:54.282 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:54.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7fb854073100 msgr2=0x7fb854075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:6800/3987087050,v1:172.21.15.32:6801/3987087050] conn(0x7fb854073100 0x7fb854075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb85406af00 msgr2=0x7fb85406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb85406af00 0x7fb85406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb868009be0 tx=0x7fb868009210 comp rx=0 tx=0).stop 2023-10-14T12:19:54.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb874151680 msgr2=0x7fb87414d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 --2- 172.21.15.32:0/1711029884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb874151680 0x7fb87414d660 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb87406e7e0 tx=0x7fb86c004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb872d9d700 1 -- 172.21.15.32:0/1711029884 reap_dead start 2023-10-14T12:19:54.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 shutdown_connections 2023-10-14T12:19:54.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 >> 172.21.15.32:0/1711029884 conn(0x7fb87406bd70 msgr2=0x7fb87415d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 shutdown_connections 2023-10-14T12:19:54.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.272+0000 7fb87883e700 1 -- 172.21.15.32:0/1711029884 wait complete. 2023-10-14T12:19:54.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T12:19:54.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.416+0000 7f286f9eb700 1 Processor -- start 2023-10-14T12:19:54.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.416+0000 7f286f9eb700 1 -- start start 2023-10-14T12:19:54.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286f9eb700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28680cc3f0 0x7f28680cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286f9eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f286806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286f9eb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f28680ccd10 0x7f286806ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286f9eb700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2868071ab0 con 0x7f28680cc3f0 2023-10-14T12:19:54.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286f9eb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2868161bc0 con 0x7f28680ccd10 2023-10-14T12:19:54.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286f9eb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2868161ea0 con 0x7f2868161670 2023-10-14T12:19:54.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28680cc3f0 0x7f28680cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28680cc3f0 0x7f28680cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40110/0 (socket says 172.21.15.32:40110) 2023-10-14T12:19:54.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 -- 172.21.15.32:0/2875979294 learned_addr learned my addr 172.21.15.32:0/2875979294 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286cf86700 1 --2- 172.21.15.32:0/2875979294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f286806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286df88700 1 --2- 172.21.15.32:0/2875979294 >> v2:172.21.15.92:3300/0 conn(0x7f28680ccd10 0x7f286806ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 -- 172.21.15.32:0/2875979294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 msgr2=0x7f286806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 --2- 172.21.15.32:0/2875979294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f286806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 -- 172.21.15.32:0/2875979294 >> v2:172.21.15.92:3300/0 conn(0x7f28680ccd10 msgr2=0x7f286806ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 --2- 172.21.15.32:0/2875979294 >> v2:172.21.15.92:3300/0 conn(0x7f28680ccd10 0x7f286806ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286d787700 1 -- 172.21.15.32:0/2875979294 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868162180 con 0x7f28680cc3f0 2023-10-14T12:19:54.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.417+0000 7f286df88700 1 --2- 172.21.15.32:0/2875979294 >> v2:172.21.15.92:3300/0 conn(0x7f28680ccd10 0x7f286806ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:54.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286d787700 1 --2- 172.21.15.32:0/2875979294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680cc3f0 0x7f28680cc7d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f28680c7480 tx=0x7f2858009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aff52efb56b217 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f285ffff700 1 -- 172.21.15.32:0/2875979294 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858011830 con 0x7f28680cc3f0 2023-10-14T12:19:54.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f285ffff700 1 -- 172.21.15.32:0/2875979294 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858011990 con 0x7f28680cc3f0 2023-10-14T12:19:54.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f285ffff700 1 -- 172.21.15.32:0/2875979294 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858011d20 con 0x7f28680cc3f0 2023-10-14T12:19:54.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 -- 172.21.15.32:0/2875979294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680cc3f0 msgr2=0x7f28680cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 --2- 172.21.15.32:0/2875979294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680cc3f0 0x7f28680cc7d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f28680c7480 tx=0x7f2858009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 -- 172.21.15.32:0/2875979294 shutdown_connections 2023-10-14T12:19:54.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 --2- 172.21.15.32:0/2875979294 >> v2:172.21.15.92:3300/0 conn(0x7f28680ccd10 0x7f286806ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 --2- 172.21.15.32:0/2875979294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680cc3f0 0x7f28680cc7d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 --2- 172.21.15.32:0/2875979294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f286806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 -- 172.21.15.32:0/2875979294 >> 172.21.15.32:0/2875979294 conn(0x7f286806dac0 msgr2=0x7f286806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 -- 172.21.15.32:0/2875979294 shutdown_connections 2023-10-14T12:19:54.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.418+0000 7f286f9eb700 1 -- 172.21.15.32:0/2875979294 wait complete. 2023-10-14T12:19:54.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 Processor -- start 2023-10-14T12:19:54.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 -- start start 2023-10-14T12:19:54.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28680cc3f0 0x7f28681f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 0x7f28680c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f28680c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680b4a40 con 0x7f28680ccd10 2023-10-14T12:19:54.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680b4840 con 0x7f28680cc3f0 2023-10-14T12:19:54.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286f9eb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28681f37e0 con 0x7f2868161670 2023-10-14T12:19:54.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286cf86700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 0x7f28680c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286cf86700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 0x7f28680c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40118/0 (socket says 172.21.15.32:40118) 2023-10-14T12:19:54.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.420+0000 7f286cf86700 1 -- 172.21.15.32:0/3345572404 learned_addr learned my addr 172.21.15.32:0/3345572404 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286d787700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28680cc3f0 0x7f28681f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286df88700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f28680c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286cf86700 1 -- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 msgr2=0x7f28680c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286cf86700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f28680c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286cf86700 1 -- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28680cc3f0 msgr2=0x7f28681f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286cf86700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28680cc3f0 0x7f28681f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286cf86700 1 -- 172.21.15.32:0/3345572404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858009550 con 0x7f28680ccd10 2023-10-14T12:19:54.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286df88700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f28680c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:54.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286cf86700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 0x7f28680c60b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f286400e980 tx=0x7f286400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864009710 con 0x7f28680ccd10 2023-10-14T12:19:54.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400c850 con 0x7f28680ccd10 2023-10-14T12:19:54.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28681f3ac0 con 0x7f28680ccd10 2023-10-14T12:19:54.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400cbe0 con 0x7f28680ccd10 2023-10-14T12:19:54.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.421+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28681f4080 con 0x7f28680ccd10 2023-10-14T12:19:54.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.422+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28680b4cb0 con 0x7f28680ccd10 2023-10-14T12:19:54.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.423+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f286400cd40 con 0x7f28680ccd10 2023-10-14T12:19:54.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.423+0000 7f285dffb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f284c06af00 0x7f284c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.423+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2864089690 con 0x7f28680ccd10 2023-10-14T12:19:54.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.424+0000 7f286d787700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f284c06af00 0x7f284c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.424+0000 7f286d787700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f284c06af00 0x7f284c06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2858014040 tx=0x7f2858008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.428+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2864054870 con 0x7f28680ccd10 2023-10-14T12:19:54.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.628+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2868162460 con 0x7f284c06af00 2023-10-14T12:19:54.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.629+0000 7f285dffb700 1 -- 172.21.15.32:0/3345572404 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2858011b00 con 0x7f284c06af00 2023-10-14T12:19:54.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f284c06af00 msgr2=0x7f284c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f284c06af00 0x7f284c06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2858014040 tx=0x7f2858008030 comp rx=0 tx=0).stop 2023-10-14T12:19:54.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 msgr2=0x7f28680c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 0x7f28680c60b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f286400e980 tx=0x7f286400ed40 comp rx=0 tx=0).stop 2023-10-14T12:19:54.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 shutdown_connections 2023-10-14T12:19:54.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2868161670 0x7f28680c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f284c06af00 0x7f284c06d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28680cc3f0 0x7f28681f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 --2- 172.21.15.32:0/3345572404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28680ccd10 0x7f28680c60b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 >> 172.21.15.32:0/3345572404 conn(0x7f286806dac0 msgr2=0x7f286806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 shutdown_connections 2023-10-14T12:19:54.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.631+0000 7f286f9eb700 1 -- 172.21.15.32:0/3345572404 wait complete. 2023-10-14T12:19:54.637 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T12:19:54.645 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T12:19:54.646 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:54.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.774+0000 7fd08bd51700 1 Processor -- start 2023-10-14T12:19:54.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.774+0000 7fd08bd51700 1 -- start start 2023-10-14T12:19:54.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd08bd51700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd084151680 0x7fd08415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd08bd51700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0840727e0 0x7fd0840b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd08bd51700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840b2e40 con 0x7fd08406da30 2023-10-14T12:19:54.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd08bd51700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08415e7c0 con 0x7fd084151680 2023-10-14T12:19:54.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd08bd51700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b2880 con 0x7fd0840727e0 2023-10-14T12:19:54.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd084151680 0x7fd08415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd084151680 0x7fd08415ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40124/0 (socket says 172.21.15.32:40124) 2023-10-14T12:19:54.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd08a2ee700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd08406da30 0x7fd08415acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57152/0 (socket says 172.21.15.32:57152) 2023-10-14T12:19:54.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 -- 172.21.15.32:0/2424106799 learned_addr learned my addr 172.21.15.32:0/2424106799 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd0892ec700 1 --2- 172.21.15.32:0/2424106799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0840727e0 0x7fd0840b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 -- 172.21.15.32:0/2424106799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0840727e0 msgr2=0x7fd0840b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 --2- 172.21.15.32:0/2424106799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0840727e0 0x7fd0840b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 -- 172.21.15.32:0/2424106799 >> v1:172.21.15.32:6789/0 conn(0x7fd08406da30 legacy=0x7fd08415acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd088aeb700 1 -- 172.21.15.32:0/2424106799 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150666216 0 0) 0x7fd07c001490 con 0x7fd08406da30 2023-10-14T12:19:54.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 -- 172.21.15.32:0/2424106799 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840b2b60 con 0x7fd084151680 2023-10-14T12:19:54.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.775+0000 7fd089aed700 1 --2- 172.21.15.32:0/2424106799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd084151680 0x7fd08415ec50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098f0 tx=0x7fd074009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76e101fb8138089 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd088aeb700 1 -- 172.21.15.32:0/2424106799 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400b8a0 con 0x7fd084151680 2023-10-14T12:19:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd088aeb700 1 -- 172.21.15.32:0/2424106799 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400ba00 con 0x7fd084151680 2023-10-14T12:19:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd088aeb700 1 -- 172.21.15.32:0/2424106799 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400bd90 con 0x7fd084151680 2023-10-14T12:19:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 -- 172.21.15.32:0/2424106799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd084151680 msgr2=0x7fd08415ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 --2- 172.21.15.32:0/2424106799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd084151680 0x7fd08415ec50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098f0 tx=0x7fd074009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:54.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 -- 172.21.15.32:0/2424106799 shutdown_connections 2023-10-14T12:19:54.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 --2- 172.21.15.32:0/2424106799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd084151680 0x7fd08415ec50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 --2- 172.21.15.32:0/2424106799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0840727e0 0x7fd0840b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 -- 172.21.15.32:0/2424106799 >> 172.21.15.32:0/2424106799 conn(0x7fd08406bd70 msgr2=0x7fd08406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 -- 172.21.15.32:0/2424106799 shutdown_connections 2023-10-14T12:19:54.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.776+0000 7fd08bd51700 1 -- 172.21.15.32:0/2424106799 wait complete. 2023-10-14T12:19:54.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.778+0000 7fd08bd51700 1 Processor -- start 2023-10-14T12:19:54.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.778+0000 7fd08bd51700 1 -- start start 2023-10-14T12:19:54.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08bd51700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08406da30 0x7fd084150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08bd51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0840727e0 0x7fd0841e5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08bd51700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd084151680 0x7fd0841e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08bd51700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840c7c70 con 0x7fd08406da30 2023-10-14T12:19:54.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08bd51700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841f4640 con 0x7fd0840727e0 2023-10-14T12:19:54.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08bd51700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841f53c0 con 0x7fd084151680 2023-10-14T12:19:54.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08406da30 0x7fd084150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08406da30 0x7fd084150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40130/0 (socket says 172.21.15.32:40130) 2023-10-14T12:19:54.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 -- 172.21.15.32:0/3445269004 learned_addr learned my addr 172.21.15.32:0/3445269004 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd0892ec700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0840727e0 0x7fd0841e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd08a2ee700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd084151680 0x7fd0841e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 -- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd084151680 msgr2=0x7fd0841e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd084151680 0x7fd0841e5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 -- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0840727e0 msgr2=0x7fd0841e5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0840727e0 0x7fd0841e5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 -- 172.21.15.32:0/3445269004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009550 con 0x7fd08406da30 2023-10-14T12:19:54.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd0892ec700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0840727e0 0x7fd0841e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:54.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.779+0000 7fd089aed700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08406da30 0x7fd084150800 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd074009c40 tx=0x7fd074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.780+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740036a0 con 0x7fd08406da30 2023-10-14T12:19:54.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.780+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07401e070 con 0x7fd08406da30 2023-10-14T12:19:54.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.780+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074003a20 con 0x7fd08406da30 2023-10-14T12:19:54.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.780+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0841e63b0 con 0x7fd08406da30 2023-10-14T12:19:54.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.780+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0841f4bc0 con 0x7fd08406da30 2023-10-14T12:19:54.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.780+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd08415f190 con 0x7fd08406da30 2023-10-14T12:19:54.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.781+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd074003b80 con 0x7fd08406da30 2023-10-14T12:19:54.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.781+0000 7fd07a7fc700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd06806af00 0x7fd06806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd074020070 con 0x7fd08406da30 2023-10-14T12:19:54.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd07a7fc700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7fd068073100 0x7fd068075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 --> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd068075c10 con 0x7fd068073100 2023-10-14T12:19:54.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd07408b3a0 con 0x7fd08406da30 2023-10-14T12:19:54.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd0892ec700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd06806af00 0x7fd06806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd08a2ee700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7fd068073100 0x7fd068075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd08a2ee700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7fd068073100 0x7fd068075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.782+0000 7fd0892ec700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd06806af00 0x7fd06806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0840c7200 tx=0x7fd080008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.783+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== osd.1 v2:172.21.15.32:6808/3306403672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd068075c10 con 0x7fd068073100 2023-10-14T12:19:54.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.797+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 --> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd08415e450 con 0x7fd068073100 2023-10-14T12:19:54.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd07a7fc700 1 -- 172.21.15.32:0/3445269004 <== osd.1 v2:172.21.15.32:6808/3306403672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd07c0070f0 con 0x7fd068073100 2023-10-14T12:19:54.802 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:54.803 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:54.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7fd068073100 msgr2=0x7fd068075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:6808/3306403672,v1:172.21.15.32:6809/3306403672] conn(0x7fd068073100 0x7fd068075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd06806af00 msgr2=0x7fd06806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fd06806af00 0x7fd06806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0840c7200 tx=0x7fd080008040 comp rx=0 tx=0).stop 2023-10-14T12:19:54.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08406da30 msgr2=0x7fd084150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 --2- 172.21.15.32:0/3445269004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08406da30 0x7fd084150800 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd074009c40 tx=0x7fd074004750 comp rx=0 tx=0).stop 2023-10-14T12:19:54.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08a2ee700 1 -- 172.21.15.32:0/3445269004 reap_dead start 2023-10-14T12:19:54.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 shutdown_connections 2023-10-14T12:19:54.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 >> 172.21.15.32:0/3445269004 conn(0x7fd08406bd70 msgr2=0x7fd0840d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 shutdown_connections 2023-10-14T12:19:54.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.798+0000 7fd08bd51700 1 -- 172.21.15.32:0/3445269004 wait complete. 2023-10-14T12:19:54.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T12:19:54.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.935+0000 7f6a2367b700 1 Processor -- start 2023-10-14T12:19:54.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.935+0000 7f6a2367b700 1 -- start start 2023-10-14T12:19:54.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a2367b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6a1c15dbc0 0x7f6a1c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a2367b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a1c0d3fc0 0x7f6a1c0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a2367b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c0d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a2367b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c15e4e0 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a2367b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b7560 con 0x7f6a1c15dbc0 2023-10-14T12:19:54.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a2367b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b7840 con 0x7f6a1c0b7050 2023-10-14T12:19:54.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a20c16700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a1c0d3fc0 0x7f6a1c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a20c16700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a1c0d3fc0 0x7f6a1c0d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40140/0 (socket says 172.21.15.32:40140) 2023-10-14T12:19:54.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.936+0000 7f6a20c16700 1 -- 172.21.15.32:0/317348612 learned_addr learned my addr 172.21.15.32:0/317348612 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a21417700 1 --2- 172.21.15.32:0/317348612 >> v2:172.21.15.92:3300/0 conn(0x7f6a1c15dbc0 0x7f6a1c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a21c18700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c0d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a20c16700 1 -- 172.21.15.32:0/317348612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 msgr2=0x7f6a1c0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a20c16700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c0d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a20c16700 1 -- 172.21.15.32:0/317348612 >> v2:172.21.15.92:3300/0 conn(0x7f6a1c15dbc0 msgr2=0x7f6a1c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:54.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a20c16700 1 --2- 172.21.15.32:0/317348612 >> v2:172.21.15.92:3300/0 conn(0x7f6a1c15dbc0 0x7f6a1c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a20c16700 1 -- 172.21.15.32:0/317348612 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0b7b20 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a21c18700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c0d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:54.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a20c16700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c0d1ac0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c072db0 tx=0x7f6a18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f021490872023e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a13fff700 1 -- 172.21.15.32:0/317348612 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800b870 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a13fff700 1 -- 172.21.15.32:0/317348612 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800b9d0 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.937+0000 7f6a13fff700 1 -- 172.21.15.32:0/317348612 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800bd60 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 -- 172.21.15.32:0/317348612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 msgr2=0x7f6a1c0d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c0d1ac0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c072db0 tx=0x7f6a18009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 -- 172.21.15.32:0/317348612 shutdown_connections 2023-10-14T12:19:54.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c0d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 --2- 172.21.15.32:0/317348612 >> v2:172.21.15.92:3300/0 conn(0x7f6a1c15dbc0 0x7f6a1c15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 --2- 172.21.15.32:0/317348612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c0d1ac0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 -- 172.21.15.32:0/317348612 >> 172.21.15.32:0/317348612 conn(0x7f6a1c09cb40 msgr2=0x7f6a1c0d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 -- 172.21.15.32:0/317348612 shutdown_connections 2023-10-14T12:19:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.938+0000 7f6a2367b700 1 -- 172.21.15.32:0/317348612 wait complete. 2023-10-14T12:19:54.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.939+0000 7f6a2367b700 1 Processor -- start 2023-10-14T12:19:54.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.939+0000 7f6a2367b700 1 -- start start 2023-10-14T12:19:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a2367b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c1f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a2367b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a2367b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a1c15dbc0 0x7f6a1c0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a2367b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1f7750 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a2367b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0ca900 con 0x7f6a1c15dbc0 2023-10-14T12:19:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a2367b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0a0e50 con 0x7f6a1c0b7050 2023-10-14T12:19:54.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a20c16700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a20c16700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40148/0 (socket says 172.21.15.32:40148) 2023-10-14T12:19:54.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.940+0000 7f6a20c16700 1 -- 172.21.15.32:0/687877278 learned_addr learned my addr 172.21.15.32:0/687877278 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:54.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a21417700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c1f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a21c18700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a1c15dbc0 0x7f6a1c0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a20c16700 1 -- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 msgr2=0x7f6a1c1f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a20c16700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c1f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a20c16700 1 -- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a1c15dbc0 msgr2=0x7f6a1c0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:54.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a20c16700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a1c15dbc0 0x7f6a1c0d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:54.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a20c16700 1 -- 172.21.15.32:0/687877278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18009550 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a20c16700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c153870 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18004540 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a180036a0 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c0a1130 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18003a50 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.941+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c0a1410 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.942+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c0cade0 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.943+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6a18021070 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.943+0000 7f6a11ffb700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6a0006af00 0x7f6a0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.943+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6a1808ac10 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.943+0000 7f6a21417700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6a0006af00 0x7f6a0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:54.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.944+0000 7f6a21417700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6a0006af00 0x7f6a0006d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c006fd0 tx=0x7f6a0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:54.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:54.948+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a1c0cade0 con 0x7f6a1c0d3fc0 2023-10-14T12:19:54.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:19:54.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:19:55.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.148+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a1c0b80e0 con 0x7f6a0006af00 2023-10-14T12:19:55.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.148+0000 7f6a11ffb700 1 -- 172.21.15.32:0/687877278 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a0c00be10 con 0x7f6a0006af00 2023-10-14T12:19:55.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6a0006af00 msgr2=0x7f6a0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6a0006af00 0x7f6a0006d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c006fd0 tx=0x7f6a0c008040 comp rx=0 tx=0).stop 2023-10-14T12:19:55.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 msgr2=0x7f6a1c153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c153870 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18004750 comp rx=0 tx=0).stop 2023-10-14T12:19:55.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 shutdown_connections 2023-10-14T12:19:55.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6a0006af00 0x7f6a0006d3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a1c15dbc0 0x7f6a1c0d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a1c0b7050 0x7f6a1c1f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 --2- 172.21.15.32:0/687877278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a1c0d3fc0 0x7f6a1c153870 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 >> 172.21.15.32:0/687877278 conn(0x7f6a1c09cb40 msgr2=0x7f6a1c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 shutdown_connections 2023-10-14T12:19:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.151+0000 7f6a2367b700 1 -- 172.21.15.32:0/687877278 wait complete. 2023-10-14T12:19:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T12:19:55.164 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T12:19:55.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 Processor -- start 2023-10-14T12:19:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 -- start start 2023-10-14T12:19:55.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f56900b0730 0x7f56900d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 0x7f56900cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56900cbdb0 con 0x7f56900cdf10 2023-10-14T12:19:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900d0b40 con 0x7f56900b0730 2023-10-14T12:19:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.293+0000 7f5696f25700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900d0e20 con 0x7f56900cc240 2023-10-14T12:19:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f5694cc1700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f56900cdf10 0x7f56900ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57178/0 (socket says 172.21.15.32:57178) 2023-10-14T12:19:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f5694cc1700 1 -- 172.21.15.32:0/29411015 learned_addr learned my addr 172.21.15.32:0/29411015 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568ffff700 1 --2- 172.21.15.32:0/29411015 >> v2:172.21.15.92:3300/0 conn(0x7f56900b0730 0x7f56900d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f56954c2700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 0x7f56900cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054128967 0 0) 0x7f56900cbdb0 con 0x7f56900cdf10 2023-10-14T12:19:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56800035b0 con 0x7f56900cdf10 2023-10-14T12:19:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790931705 0 0) 0x7f56800035b0 con 0x7f56900cdf10 2023-10-14T12:19:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 msgr2=0x7f56900cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 0x7f56900cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 >> v2:172.21.15.92:3300/0 conn(0x7f56900b0730 msgr2=0x7f56900d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 --2- 172.21.15.32:0/29411015 >> v2:172.21.15.92:3300/0 conn(0x7f56900b0730 0x7f56900d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900d1100 con 0x7f56900cdf10 2023-10-14T12:19:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f56840017f0 con 0x7f56900cdf10 2023-10-14T12:19:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 >> v1:172.21.15.32:6789/0 conn(0x7f56900cdf10 legacy=0x7f56900ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5680003a00 0x7f5680003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680004850 0x7f5680004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 0x7f5680005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900d0b40 con 0x7f5680003a00 2023-10-14T12:19:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900d0e20 con 0x7f5680004850 2023-10-14T12:19:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568000ba10 con 0x7f56900cc240 2023-10-14T12:19:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f5694cc1700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5680003a00 0x7f5680003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f568ffff700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680004850 0x7f5680004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.294+0000 7f56954c2700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 0x7f5680005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5694cc1700 1 -- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 msgr2=0x7f5680005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5694cc1700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56900cc240 0x7f5680005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5694cc1700 1 -- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680004850 msgr2=0x7f5680004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5694cc1700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5680004850 0x7f5680004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5694cc1700 1 -- 172.21.15.32:0/29411015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800035b0 con 0x7f5680003a00 2023-10-14T12:19:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5694cc1700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5680003a00 0x7f5680003e20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f568400c320 tx=0x7f5680005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba86be00de63024 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400ce60 con 0x7f5680003a00 2023-10-14T12:19:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684007bf0 con 0x7f5680003a00 2023-10-14T12:19:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f568f7fe700 1 -- 172.21.15.32:0/29411015 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684007310 con 0x7f5680003a00 2023-10-14T12:19:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5696f25700 1 -- 172.21.15.32:0/29411015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5680003a00 msgr2=0x7f5680003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5696f25700 1 --2- 172.21.15.32:0/29411015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5680003a00 0x7f5680003e20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f568400c320 tx=0x7f5680005880 comp rx=0 tx=0).stop 2023-10-14T12:19:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f56954c2700 1 -- 172.21.15.32:0/29411015 reap_dead start 2023-10-14T12:19:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.295+0000 7f5696f25700 1 -- 172.21.15.32:0/29411015 shutdown_connections 2023-10-14T12:19:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.296+0000 7f5696f25700 1 -- 172.21.15.32:0/29411015 >> 172.21.15.32:0/29411015 conn(0x7f56900d1530 msgr2=0x7f56900d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.296+0000 7f5696f25700 1 -- 172.21.15.32:0/29411015 shutdown_connections 2023-10-14T12:19:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.296+0000 7f5696f25700 1 -- 172.21.15.32:0/29411015 wait complete. 2023-10-14T12:19:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.297+0000 7f5696f25700 1 Processor -- start 2023-10-14T12:19:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.297+0000 7f5696f25700 1 -- start start 2023-10-14T12:19:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f5696f25700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5680003a00 0x7f56900b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f5696f25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569015cb80 0x7f5690160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f5696f25700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f569015b9a0 0x7f569015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f5696f25700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569015c390 con 0x7f569015b9a0 2023-10-14T12:19:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f5696f25700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b4150 con 0x7f569015cb80 2023-10-14T12:19:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f5696f25700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b43f0 con 0x7f5680003a00 2023-10-14T12:19:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.298+0000 7f56954c2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f569015b9a0 0x7f569015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f569015b9a0 0x7f569015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40170/0 (socket says 172.21.15.32:40170) 2023-10-14T12:19:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 -- 172.21.15.32:0/1952287551 learned_addr learned my addr 172.21.15.32:0/1952287551 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f568ffff700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569015cb80 0x7f5690160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f5694cc1700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5680003a00 0x7f56900b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 -- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5680003a00 msgr2=0x7f56900b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5680003a00 0x7f56900b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 -- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569015cb80 msgr2=0x7f5690160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569015cb80 0x7f5690160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 -- 172.21.15.32:0/1952287551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900b46d0 con 0x7f569015b9a0 2023-10-14T12:19:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f56954c2700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f569015b9a0 0x7f569015be50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f56900724a0 tx=0x7f5688011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800e040 con 0x7f569015b9a0 2023-10-14T12:19:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800f040 con 0x7f569015b9a0 2023-10-14T12:19:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56900b49b0 con 0x7f569015b9a0 2023-10-14T12:19:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800fd00 con 0x7f569015b9a0 2023-10-14T12:19:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.299+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56900b6e70 con 0x7f569015b9a0 2023-10-14T12:19:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.300+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56900b7000 con 0x7f569015b9a0 2023-10-14T12:19:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5688022460 con 0x7f569015b9a0 2023-10-14T12:19:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568d7fa700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f567406af30 0x7f567406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5688089a50 con 0x7f569015b9a0 2023-10-14T12:19:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568d7fa700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7f5674073130 0x7f5674075570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 --> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5674075c40 con 0x7f5674073130 2023-10-14T12:19:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f568808e2c0 con 0x7f569015b9a0 2023-10-14T12:19:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f568ffff700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7f5674073130 0x7f5674075570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.301+0000 7f5694cc1700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f567406af30 0x7f567406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.302+0000 7f568ffff700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7f5674073130 0x7f5674075570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.302+0000 7f5694cc1700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f567406af30 0x7f567406d3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5684015040 tx=0x7f568400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.302+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== osd.2 v2:172.21.15.32:6819/2045586294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5674075c40 con 0x7f5674073130 2023-10-14T12:19:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.317+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 --> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56900b0490 con 0x7f5674073130 2023-10-14T12:19:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f568d7fa700 1 -- 172.21.15.32:0/1952287551 <== osd.2 v2:172.21.15.32:6819/2045586294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f567c009b90 con 0x7f5674073130 2023-10-14T12:19:55.328 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:55.328 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:55.328 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:55.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7f5674073130 msgr2=0x7f5674075570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:6819/2045586294,v1:172.21.15.32:6821/2045586294] conn(0x7f5674073130 0x7f5674075570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f567406af30 msgr2=0x7f567406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f567406af30 0x7f567406d3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5684015040 tx=0x7f568400a000 comp rx=0 tx=0).stop 2023-10-14T12:19:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f569015b9a0 msgr2=0x7f569015be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 --2- 172.21.15.32:0/1952287551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f569015b9a0 0x7f569015be50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f56900724a0 tx=0x7f5688011e60 comp rx=0 tx=0).stop 2023-10-14T12:19:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f56954c2700 1 -- 172.21.15.32:0/1952287551 reap_dead start 2023-10-14T12:19:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 shutdown_connections 2023-10-14T12:19:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 >> 172.21.15.32:0/1952287551 conn(0x7f56900d1530 msgr2=0x7f56900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 shutdown_connections 2023-10-14T12:19:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.318+0000 7f5696f25700 1 -- 172.21.15.32:0/1952287551 wait complete. 2023-10-14T12:19:55.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T12:19:55.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.460+0000 7fc149239700 1 Processor -- start 2023-10-14T12:19:55.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.460+0000 7fc149239700 1 -- start start 2023-10-14T12:19:55.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc149239700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc14415b8b0 0x7fc1440b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc149239700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1440ce3b0 0x7fc1440ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc149239700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc144072a10 con 0x7fc1440ccec0 2023-10-14T12:19:55.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc149239700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1440ced70 con 0x7fc14415b8b0 2023-10-14T12:19:55.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc149239700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440b2230 con 0x7fc1440ce3b0 2023-10-14T12:19:55.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc14415b8b0 0x7fc1440b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc14415b8b0 0x7fc1440b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40176/0 (socket says 172.21.15.32:40176) 2023-10-14T12:19:55.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc14359e700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc1440ccec0 0x7fc1440cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57204/0 (socket says 172.21.15.32:57204) 2023-10-14T12:19:55.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 -- 172.21.15.32:0/138103697 learned_addr learned my addr 172.21.15.32:0/138103697 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:55.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 -- 172.21.15.32:0/138103697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1440ce3b0 msgr2=0x7fc1440ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 --2- 172.21.15.32:0/138103697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1440ce3b0 0x7fc1440ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 -- 172.21.15.32:0/138103697 >> v1:172.21.15.32:6789/0 conn(0x7fc1440ccec0 legacy=0x7fc1440cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc142d9d700 1 -- 172.21.15.32:0/138103697 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440b2e90 con 0x7fc14415b8b0 2023-10-14T12:19:55.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.461+0000 7fc141d9b700 1 -- 172.21.15.32:0/138103697 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595808865 0 0) 0x7fc144072a10 con 0x7fc1440ccec0 2023-10-14T12:19:55.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc142d9d700 1 --2- 172.21.15.32:0/138103697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14415b8b0 0x7fc1440b2950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc1380098f0 tx=0x7fc138009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8008d057052b0d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc141d9b700 1 -- 172.21.15.32:0/138103697 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800b8a0 con 0x7fc14415b8b0 2023-10-14T12:19:55.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc141d9b700 1 -- 172.21.15.32:0/138103697 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13800ba00 con 0x7fc14415b8b0 2023-10-14T12:19:55.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc141d9b700 1 -- 172.21.15.32:0/138103697 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800bd90 con 0x7fc14415b8b0 2023-10-14T12:19:55.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 -- 172.21.15.32:0/138103697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14415b8b0 msgr2=0x7fc1440b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 --2- 172.21.15.32:0/138103697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14415b8b0 0x7fc1440b2950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc1380098f0 tx=0x7fc138009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:55.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 -- 172.21.15.32:0/138103697 shutdown_connections 2023-10-14T12:19:55.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 --2- 172.21.15.32:0/138103697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14415b8b0 0x7fc1440b2950 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 --2- 172.21.15.32:0/138103697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1440ce3b0 0x7fc1440ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 -- 172.21.15.32:0/138103697 >> 172.21.15.32:0/138103697 conn(0x7fc14406dac0 msgr2=0x7fc14406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 -- 172.21.15.32:0/138103697 shutdown_connections 2023-10-14T12:19:55.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.462+0000 7fc149239700 1 -- 172.21.15.32:0/138103697 wait complete. 2023-10-14T12:19:55.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.464+0000 7fc149239700 1 Processor -- start 2023-10-14T12:19:55.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.464+0000 7fc149239700 1 -- start start 2023-10-14T12:19:55.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc149239700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 0x7fc144154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc149239700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1440ce3b0 0x7fc144153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc149239700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc14415b8b0 0x7fc1441e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc149239700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14415cd50 con 0x7fc1440ccec0 2023-10-14T12:19:55.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc149239700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14415d8d0 con 0x7fc1440ce3b0 2023-10-14T12:19:55.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc149239700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc144153f50 con 0x7fc14415b8b0 2023-10-14T12:19:55.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc142d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 0x7fc144154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc142d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 0x7fc144154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40182/0 (socket says 172.21.15.32:40182) 2023-10-14T12:19:55.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc142d9d700 1 -- 172.21.15.32:0/1433579223 learned_addr learned my addr 172.21.15.32:0/1433579223 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:55.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc14359e700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc14415b8b0 0x7fc1441e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.465+0000 7fc14259c700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1440ce3b0 0x7fc144153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc142d9d700 1 -- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc14415b8b0 msgr2=0x7fc1441e51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc142d9d700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc14415b8b0 0x7fc1441e51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc142d9d700 1 -- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1440ce3b0 msgr2=0x7fc144153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc142d9d700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1440ce3b0 0x7fc144153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc142d9d700 1 -- 172.21.15.32:0/1433579223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138009550 con 0x7fc1440ccec0 2023-10-14T12:19:55.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc142d9d700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 0x7fc144154660 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc138009c40 tx=0x7fc138004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138004380 con 0x7fc1440ccec0 2023-10-14T12:19:55.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13801f070 con 0x7fc1440ccec0 2023-10-14T12:19:55.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1380036a0 con 0x7fc1440ccec0 2023-10-14T12:19:55.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14415cfa0 con 0x7fc1440ccec0 2023-10-14T12:19:55.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.466+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14415d560 con 0x7fc1440ccec0 2023-10-14T12:19:55.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.467+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1440ca3a0 con 0x7fc1440ccec0 2023-10-14T12:19:55.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.468+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc138021030 con 0x7fc1440ccec0 2023-10-14T12:19:55.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.468+0000 7fc12b7fe700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc13006af00 0x7fc13006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.468+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc13808a970 con 0x7fc1440ccec0 2023-10-14T12:19:55.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.468+0000 7fc14259c700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc13006af00 0x7fc13006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.469+0000 7fc14259c700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc13006af00 0x7fc13006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc1441e5fb0 tx=0x7fc134009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.472+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc138055a90 con 0x7fc1440ccec0 2023-10-14T12:19:55.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.674+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc144072170 con 0x7fc13006af00 2023-10-14T12:19:55.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.675+0000 7fc12b7fe700 1 -- 172.21.15.32:0/1433579223 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc134009660 con 0x7fc13006af00 2023-10-14T12:19:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc13006af00 msgr2=0x7fc13006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc13006af00 0x7fc13006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc1441e5fb0 tx=0x7fc134009190 comp rx=0 tx=0).stop 2023-10-14T12:19:55.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 msgr2=0x7fc144154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 0x7fc144154660 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc138009c40 tx=0x7fc138004750 comp rx=0 tx=0).stop 2023-10-14T12:19:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 shutdown_connections 2023-10-14T12:19:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc14415b8b0 0x7fc1441e51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1440ccec0 0x7fc144154660 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fc13006af00 0x7fc13006d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 --2- 172.21.15.32:0/1433579223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1440ce3b0 0x7fc144153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 >> 172.21.15.32:0/1433579223 conn(0x7fc14406dac0 msgr2=0x7fc1440b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 shutdown_connections 2023-10-14T12:19:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.677+0000 7fc149239700 1 -- 172.21.15.32:0/1433579223 wait complete. 2023-10-14T12:19:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T12:19:55.691 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T12:19:55.691 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:55.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.819+0000 7f8c89273700 1 Processor -- start 2023-10-14T12:19:55.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.819+0000 7f8c89273700 1 -- start start 2023-10-14T12:19:55.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c89273700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8c840d1760 0x7f8c840b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c89273700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8c840d1b40 0x7f8c840d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c89273700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840b6190 con 0x7f8c8415d940 2023-10-14T12:19:55.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c89273700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c840d2500 con 0x7f8c840d1b40 2023-10-14T12:19:55.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c89273700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c840cf6c0 con 0x7f8c840d1760 2023-10-14T12:19:55.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8c840d1b40 0x7f8c840d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c837fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8c8415d940 0x7f8c8415ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57216/0 (socket says 172.21.15.32:57216) 2023-10-14T12:19:55.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8c840d1b40 0x7f8c840d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40194/0 (socket says 172.21.15.32:40194) 2023-10-14T12:19:55.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c837fe700 1 -- 172.21.15.32:0/2852953293 learned_addr learned my addr 172.21.15.32:0/2852953293 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:55.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c82ffd700 1 --2- 172.21.15.32:0/2852953293 >> v2:172.21.15.92:3300/0 conn(0x7f8c840d1760 0x7f8c840b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 -- 172.21.15.32:0/2852953293 >> v2:172.21.15.92:3300/0 conn(0x7f8c840d1760 msgr2=0x7f8c840b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 --2- 172.21.15.32:0/2852953293 >> v2:172.21.15.92:3300/0 conn(0x7f8c840d1760 0x7f8c840b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 -- 172.21.15.32:0/2852953293 >> v1:172.21.15.32:6789/0 conn(0x7f8c8415d940 legacy=0x7f8c8415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 -- 172.21.15.32:0/2852953293 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840b58f0 con 0x7f8c840d1b40 2023-10-14T12:19:55.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c81ffb700 1 -- 172.21.15.32:0/2852953293 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888258598 0 0) 0x7f8c840b6190 con 0x7f8c8415d940 2023-10-14T12:19:55.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c827fc700 1 --2- 172.21.15.32:0/2852953293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1b40 0x7f8c840d1fc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8c8408b430 tx=0x7f8c74009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859ccc8c5c011910 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.820+0000 7f8c81ffb700 1 -- 172.21.15.32:0/2852953293 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011830 con 0x7f8c840d1b40 2023-10-14T12:19:55.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c81ffb700 1 -- 172.21.15.32:0/2852953293 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74011990 con 0x7f8c840d1b40 2023-10-14T12:19:55.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c81ffb700 1 -- 172.21.15.32:0/2852953293 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011d20 con 0x7f8c840d1b40 2023-10-14T12:19:55.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 -- 172.21.15.32:0/2852953293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1b40 msgr2=0x7f8c840d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 --2- 172.21.15.32:0/2852953293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1b40 0x7f8c840d1fc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8c8408b430 tx=0x7f8c74009b20 comp rx=0 tx=0).stop 2023-10-14T12:19:55.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 -- 172.21.15.32:0/2852953293 shutdown_connections 2023-10-14T12:19:55.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 --2- 172.21.15.32:0/2852953293 >> v2:172.21.15.92:3300/0 conn(0x7f8c840d1760 0x7f8c840b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 --2- 172.21.15.32:0/2852953293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1b40 0x7f8c840d1fc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 -- 172.21.15.32:0/2852953293 >> 172.21.15.32:0/2852953293 conn(0x7f8c840d37a0 msgr2=0x7f8c840d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 -- 172.21.15.32:0/2852953293 shutdown_connections 2023-10-14T12:19:55.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.821+0000 7f8c89273700 1 -- 172.21.15.32:0/2852953293 wait complete. 2023-10-14T12:19:55.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.822+0000 7f8c89273700 1 Processor -- start 2023-10-14T12:19:55.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 -- start start 2023-10-14T12:19:55.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1760 0x7f8c84158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c840d1b40 0x7f8c840ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8c8415d940 0x7f8c840cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8415b4d0 con 0x7f8c840d1760 2023-10-14T12:19:55.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b69c0 con 0x7f8c840d1b40 2023-10-14T12:19:55.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c89273700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b6ca0 con 0x7f8c8415d940 2023-10-14T12:19:55.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c82ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1760 0x7f8c84158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c82ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1760 0x7f8c84158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40196/0 (socket says 172.21.15.32:40196) 2023-10-14T12:19:55.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.823+0000 7f8c82ffd700 1 -- 172.21.15.32:0/3257993324 learned_addr learned my addr 172.21.15.32:0/3257993324 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:55.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c827fc700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c840d1b40 0x7f8c840ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c837fe700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8c8415d940 0x7f8c840cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c82ffd700 1 -- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8c8415d940 msgr2=0x7f8c840cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c82ffd700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8c8415d940 0x7f8c840cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c82ffd700 1 -- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c840d1b40 msgr2=0x7f8c840ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c82ffd700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c840d1b40 0x7f8c840ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c82ffd700 1 -- 172.21.15.32:0/3257993324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740094a0 con 0x7f8c840d1760 2023-10-14T12:19:55.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c837fe700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8c8415d940 0x7f8c840cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:55.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c82ffd700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1760 0x7f8c84158b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e730 tx=0x7f8c7800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78013610 con 0x7f8c840d1760 2023-10-14T12:19:55.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78013770 con 0x7f8c840d1760 2023-10-14T12:19:55.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c840b6f80 con 0x7f8c840d1760 2023-10-14T12:19:55.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78013b20 con 0x7f8c840d1760 2023-10-14T12:19:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.824+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c841590a0 con 0x7f8c840d1760 2023-10-14T12:19:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.825+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c840b6b30 con 0x7f8c840d1760 2023-10-14T12:19:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.825+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c78013c80 con 0x7f8c840d1760 2023-10-14T12:19:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c6b7fe700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8c7006af00 0x7f8c7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8c78088ef0 con 0x7f8c840d1760 2023-10-14T12:19:55.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c6b7fe700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7f8c70073100 0x7f8c70075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 --> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c70075c10 con 0x7f8c70073100 2023-10-14T12:19:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c7808b5b0 con 0x7f8c840d1760 2023-10-14T12:19:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c827fc700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8c7006af00 0x7f8c7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.826+0000 7f8c837fe700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7f8c70073100 0x7f8c70075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.827+0000 7f8c827fc700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8c7006af00 0x7f8c7006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c740090b0 tx=0x7f8c74008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.827+0000 7f8c837fe700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7f8c70073100 0x7f8c70075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.827+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== osd.3 v2:172.21.15.32:6816/4217654174 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8c70075c10 con 0x7f8c70073100 2023-10-14T12:19:55.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 --> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c840b5eb0 con 0x7f8c70073100 2023-10-14T12:19:55.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c6b7fe700 1 -- 172.21.15.32:0/3257993324 <== osd.3 v2:172.21.15.32:6816/4217654174 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8c7c0071b0 con 0x7f8c70073100 2023-10-14T12:19:55.849 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:55.849 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:55.849 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:55.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7f8c70073100 msgr2=0x7f8c70075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:6816/4217654174,v1:172.21.15.32:6817/4217654174] conn(0x7f8c70073100 0x7f8c70075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8c7006af00 msgr2=0x7f8c7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f8c7006af00 0x7f8c7006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c740090b0 tx=0x7f8c74008030 comp rx=0 tx=0).stop 2023-10-14T12:19:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1760 msgr2=0x7f8c84158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.842+0000 7f8c89273700 1 --2- 172.21.15.32:0/3257993324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c840d1760 0x7f8c84158b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e730 tx=0x7f8c7800ea40 comp rx=0 tx=0).stop 2023-10-14T12:19:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.843+0000 7f8c837fe700 1 -- 172.21.15.32:0/3257993324 reap_dead start 2023-10-14T12:19:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.843+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 shutdown_connections 2023-10-14T12:19:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.843+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 >> 172.21.15.32:0/3257993324 conn(0x7f8c840d37a0 msgr2=0x7f8c840c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.843+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 shutdown_connections 2023-10-14T12:19:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.843+0000 7f8c89273700 1 -- 172.21.15.32:0/3257993324 wait complete. 2023-10-14T12:19:55.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T12:19:55.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.980+0000 7f5e784b5700 1 Processor -- start 2023-10-14T12:19:55.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.980+0000 7f5e784b5700 1 -- start start 2023-10-14T12:19:55.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e784b5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e7015bbc0 0x7f5e700d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e784b5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5e7015bfa0 0x7f5e700cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e784b5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e700b0760 0x7f5e700ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e784b5700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700cd4e0 con 0x7f5e700b0760 2023-10-14T12:19:55.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e784b5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700cce60 con 0x7f5e7015bfa0 2023-10-14T12:19:55.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e784b5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700b2ba0 con 0x7f5e7015bbc0 2023-10-14T12:19:55.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e76a52700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e700b0760 0x7f5e700ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e76a52700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e700b0760 0x7f5e700ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40210/0 (socket says 172.21.15.32:40210) 2023-10-14T12:19:55.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e76a52700 1 -- 172.21.15.32:0/4157655290 learned_addr learned my addr 172.21.15.32:0/4157655290 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:55.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e76251700 1 --2- 172.21.15.32:0/4157655290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e7015bbc0 0x7f5e700d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.981+0000 7f5e75a50700 1 --2- 172.21.15.32:0/4157655290 >> v2:172.21.15.92:3300/0 conn(0x7f5e7015bfa0 0x7f5e700cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e76a52700 1 -- 172.21.15.32:0/4157655290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e7015bbc0 msgr2=0x7f5e700d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e76a52700 1 --2- 172.21.15.32:0/4157655290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e7015bbc0 0x7f5e700d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e76a52700 1 -- 172.21.15.32:0/4157655290 >> v2:172.21.15.92:3300/0 conn(0x7f5e7015bfa0 msgr2=0x7f5e700cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:55.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e76a52700 1 --2- 172.21.15.32:0/4157655290 >> v2:172.21.15.92:3300/0 conn(0x7f5e7015bfa0 0x7f5e700cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e76a52700 1 -- 172.21.15.32:0/4157655290 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e700cd100 con 0x7f5e700b0760 2023-10-14T12:19:55.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e76a52700 1 --2- 172.21.15.32:0/4157655290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e700b0760 0x7f5e700ce2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e7008bb80 tx=0x7f5e6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a269f88d2ce9bac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:55.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e7524f700 1 -- 172.21.15.32:0/4157655290 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6800e070 con 0x7f5e700b0760 2023-10-14T12:19:55.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e7524f700 1 -- 172.21.15.32:0/4157655290 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6800b910 con 0x7f5e700b0760 2023-10-14T12:19:55.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e7524f700 1 -- 172.21.15.32:0/4157655290 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6800bcc0 con 0x7f5e700b0760 2023-10-14T12:19:55.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e784b5700 1 -- 172.21.15.32:0/4157655290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e700b0760 msgr2=0x7f5e700ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:55.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.982+0000 7f5e784b5700 1 --2- 172.21.15.32:0/4157655290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e700b0760 0x7f5e700ce2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e7008bb80 tx=0x7f5e6800b330 comp rx=0 tx=0).stop 2023-10-14T12:19:55.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 -- 172.21.15.32:0/4157655290 shutdown_connections 2023-10-14T12:19:55.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 --2- 172.21.15.32:0/4157655290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e700b0760 0x7f5e700ce2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 --2- 172.21.15.32:0/4157655290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e7015bbc0 0x7f5e700d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 --2- 172.21.15.32:0/4157655290 >> v2:172.21.15.92:3300/0 conn(0x7f5e7015bfa0 0x7f5e700cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:55.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 -- 172.21.15.32:0/4157655290 >> 172.21.15.32:0/4157655290 conn(0x7f5e700d15f0 msgr2=0x7f5e700d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:55.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 -- 172.21.15.32:0/4157655290 shutdown_connections 2023-10-14T12:19:55.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.983+0000 7f5e784b5700 1 -- 172.21.15.32:0/4157655290 wait complete. 2023-10-14T12:19:55.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.984+0000 7f5e784b5700 1 Processor -- start 2023-10-14T12:19:55.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.984+0000 7f5e784b5700 1 -- start start 2023-10-14T12:19:55.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e700b0760 0x7f5e70158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7015bbc0 0x7f5e700caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 0x7f5e700caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:55.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700c8d80 con 0x7f5e7015bfa0 2023-10-14T12:19:55.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70159040 con 0x7f5e7015bbc0 2023-10-14T12:19:55.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700b6230 con 0x7f5e700b0760 2023-10-14T12:19:55.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 0x7f5e700caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 0x7f5e700caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40216/0 (socket says 172.21.15.32:40216) 2023-10-14T12:19:55.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 -- 172.21.15.32:0/3671162687 learned_addr learned my addr 172.21.15.32:0/3671162687 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:55.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e75a50700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7015bbc0 0x7f5e700caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:55.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76251700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e700b0760 0x7f5e70158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 -- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e700b0760 msgr2=0x7f5e70158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e700b0760 0x7f5e70158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 -- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7015bbc0 msgr2=0x7f5e700caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7015bbc0 0x7f5e700caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 -- 172.21.15.32:0/3671162687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68009b30 con 0x7f5e7015bfa0 2023-10-14T12:19:56.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e76a52700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 0x7f5e700caf40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006b6e0 tx=0x7f5e68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680099b0 con 0x7f5e7015bfa0 2023-10-14T12:19:56.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6800ce80 con 0x7f5e7015bfa0 2023-10-14T12:19:56.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e700b6510 con 0x7f5e7015bfa0 2023-10-14T12:19:56.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.985+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68004490 con 0x7f5e7015bfa0 2023-10-14T12:19:56.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.986+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e700c89a0 con 0x7f5e7015bfa0 2023-10-14T12:19:56.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.986+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7006dfb0 con 0x7f5e7015bfa0 2023-10-14T12:19:56.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.987+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e680045f0 con 0x7f5e7015bfa0 2023-10-14T12:19:56.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.987+0000 7f5e66ffd700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5e5406af00 0x7f5e5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.987+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5e6808a4a0 con 0x7f5e7015bfa0 2023-10-14T12:19:56.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.987+0000 7f5e76251700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5e5406af00 0x7f5e5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.988+0000 7f5e76251700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5e5406af00 0x7f5e5406d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009ac0 tx=0x7f5e60009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:55.992+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e68055670 con 0x7f5e7015bfa0 2023-10-14T12:19:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.196+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e700b2e80 con 0x7f5e5406af00 2023-10-14T12:19:56.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.196+0000 7f5e66ffd700 1 -- 172.21.15.32:0/3671162687 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e60004020 con 0x7f5e5406af00 2023-10-14T12:19:56.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5e5406af00 msgr2=0x7f5e5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5e5406af00 0x7f5e5406d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009ac0 tx=0x7f5e60009210 comp rx=0 tx=0).stop 2023-10-14T12:19:56.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 msgr2=0x7f5e700caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 0x7f5e700caf40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006b6e0 tx=0x7f5e68004ad0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 shutdown_connections 2023-10-14T12:19:56.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e7015bfa0 0x7f5e700caf40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e700b0760 0x7f5e70158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f5e5406af00 0x7f5e5406d3c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 --2- 172.21.15.32:0/3671162687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7015bbc0 0x7f5e700caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.198+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 >> 172.21.15.32:0/3671162687 conn(0x7f5e700d15f0 msgr2=0x7f5e7006faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.199+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 shutdown_connections 2023-10-14T12:19:56.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.199+0000 7f5e784b5700 1 -- 172.21.15.32:0/3671162687 wait complete. 2023-10-14T12:19:56.212 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T12:19:56.213 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T12:19:56.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.342+0000 7f1d6b789700 1 Processor -- start 2023-10-14T12:19:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.342+0000 7f1d6b789700 1 -- start start 2023-10-14T12:19:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d6b789700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d640d1760 0x7f1d640b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d6b789700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1b40 0x7f1d640d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d6b789700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640b6190 con 0x7f1d6415d940 2023-10-14T12:19:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d6b789700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640d2500 con 0x7f1d640d1760 2023-10-14T12:19:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d6b789700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640cf6c0 con 0x7f1d640d1b40 2023-10-14T12:19:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d640d1760 0x7f1d640b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d640d1760 0x7f1d640b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40220/0 (socket says 172.21.15.32:40220) 2023-10-14T12:19:56.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 -- 172.21.15.32:0/3576800882 learned_addr learned my addr 172.21.15.32:0/3576800882 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:56.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d68d24700 1 --2- 172.21.15.32:0/3576800882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1b40 0x7f1d640d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 -- 172.21.15.32:0/3576800882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1b40 msgr2=0x7f1d640d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:56.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 --2- 172.21.15.32:0/3576800882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1b40 0x7f1d640d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 -- 172.21.15.32:0/3576800882 >> v1:172.21.15.92:6789/0 conn(0x7f1d6415d940 legacy=0x7f1d6415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 -- 172.21.15.32:0/3576800882 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640b58f0 con 0x7f1d640d1760 2023-10-14T12:19:56.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d69525700 1 --2- 172.21.15.32:0/3576800882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d640d1760 0x7f1d640b4890 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1d60006fd0 tx=0x7f1d60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6966d0aa94814525 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.343+0000 7f1d5bfff700 1 -- 172.21.15.32:0/3576800882 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60005e30 con 0x7f1d640d1760 2023-10-14T12:19:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d5bfff700 1 -- 172.21.15.32:0/3576800882 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60004030 con 0x7f1d640d1760 2023-10-14T12:19:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d5bfff700 1 -- 172.21.15.32:0/3576800882 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600043e0 con 0x7f1d640d1760 2023-10-14T12:19:56.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 -- 172.21.15.32:0/3576800882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d640d1760 msgr2=0x7f1d640b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 --2- 172.21.15.32:0/3576800882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d640d1760 0x7f1d640b4890 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1d60006fd0 tx=0x7f1d60009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 -- 172.21.15.32:0/3576800882 shutdown_connections 2023-10-14T12:19:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 --2- 172.21.15.32:0/3576800882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d640d1760 0x7f1d640b4890 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 --2- 172.21.15.32:0/3576800882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1b40 0x7f1d640d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 -- 172.21.15.32:0/3576800882 >> 172.21.15.32:0/3576800882 conn(0x7f1d640d37a0 msgr2=0x7f1d640d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 -- 172.21.15.32:0/3576800882 shutdown_connections 2023-10-14T12:19:56.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.344+0000 7f1d6b789700 1 -- 172.21.15.32:0/3576800882 wait complete. 2023-10-14T12:19:56.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.345+0000 7f1d6b789700 1 Processor -- start 2023-10-14T12:19:56.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.345+0000 7f1d6b789700 1 -- start start 2023-10-14T12:19:56.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d6b789700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1760 0x7f1d6414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d6b789700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d640d1b40 0x7f1d640b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d6b789700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d6415d940 0x7f1d640ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d6b789700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d641506f0 con 0x7f1d6415d940 2023-10-14T12:19:56.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d6b789700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415def0 con 0x7f1d640d1b40 2023-10-14T12:19:56.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d6b789700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415e1d0 con 0x7f1d640d1760 2023-10-14T12:19:56.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d6415d940 0x7f1d640ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d6415d940 0x7f1d640ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40230/0 (socket says 172.21.15.32:40230) 2023-10-14T12:19:56.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 -- 172.21.15.32:0/2824017881 learned_addr learned my addr 172.21.15.32:0/2824017881 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:56.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d68d24700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d640d1b40 0x7f1d640b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69525700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1760 0x7f1d6414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 -- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1760 msgr2=0x7f1d6414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d640d1760 0x7f1d6414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 -- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d640d1b40 msgr2=0x7f1d640b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d640d1b40 0x7f1d640b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.346+0000 7f1d69d26700 1 -- 172.21.15.32:0/2824017881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60009500 con 0x7f1d6415d940 2023-10-14T12:19:56.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.347+0000 7f1d69d26700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d6415d940 0x7f1d640ccd40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00cb50 tx=0x7f1d5c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.347+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c003c00 con 0x7f1d6415d940 2023-10-14T12:19:56.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.347+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c003d60 con 0x7f1d6415d940 2023-10-14T12:19:56.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.347+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6415e4b0 con 0x7f1d6415d940 2023-10-14T12:19:56.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.347+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00ab70 con 0x7f1d6415d940 2023-10-14T12:19:56.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.347+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6415ea70 con 0x7f1d6415d940 2023-10-14T12:19:56.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.348+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d640b5eb0 con 0x7f1d6415d940 2023-10-14T12:19:56.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.348+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d5c00acd0 con 0x7f1d6415d940 2023-10-14T12:19:56.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d59ffb700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d4806af00 0x7f1d4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1d5c0896f0 con 0x7f1d6415d940 2023-10-14T12:19:56.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d59ffb700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f1d48073100 0x7f1d48075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 --> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d48075c10 con 0x7f1d48073100 2023-10-14T12:19:56.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d5c08bdb0 con 0x7f1d6415d940 2023-10-14T12:19:56.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d69525700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d4806af00 0x7f1d4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d68d24700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f1d48073100 0x7f1d48075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d69525700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d4806af00 0x7f1d4806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009130 tx=0x7f1d60008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.349+0000 7f1d68d24700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f1d48073100 0x7f1d48075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.350+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== osd.4 v2:172.21.15.92:6800/2175015118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1d48075c10 con 0x7f1d48073100 2023-10-14T12:19:56.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.365+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 --> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1d640b5bd0 con 0x7f1d48073100 2023-10-14T12:19:56.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.365+0000 7f1d59ffb700 1 -- 172.21.15.32:0/2824017881 <== osd.4 v2:172.21.15.92:6800/2175015118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1d540099c0 con 0x7f1d48073100 2023-10-14T12:19:56.367 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:56.368 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:56.368 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:56.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f1d48073100 msgr2=0x7f1d48075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6800/2175015118,v1:172.21.15.92:6801/2175015118] conn(0x7f1d48073100 0x7f1d48075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d4806af00 msgr2=0x7f1d4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1d4806af00 0x7f1d4806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009130 tx=0x7f1d60008070 comp rx=0 tx=0).stop 2023-10-14T12:19:56.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d6415d940 msgr2=0x7f1d640ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 --2- 172.21.15.32:0/2824017881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d6415d940 0x7f1d640ccd40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00cb50 tx=0x7f1d5c00cf10 comp rx=0 tx=0).stop 2023-10-14T12:19:56.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d69d26700 1 -- 172.21.15.32:0/2824017881 reap_dead start 2023-10-14T12:19:56.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 shutdown_connections 2023-10-14T12:19:56.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 >> 172.21.15.32:0/2824017881 conn(0x7f1d640d37a0 msgr2=0x7f1d6415ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 shutdown_connections 2023-10-14T12:19:56.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.366+0000 7f1d6b789700 1 -- 172.21.15.32:0/2824017881 wait complete. 2023-10-14T12:19:56.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T12:19:56.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.506+0000 7eff36202700 1 Processor -- start 2023-10-14T12:19:56.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.506+0000 7eff36202700 1 -- start start 2023-10-14T12:19:56.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff36202700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff300cc3f0 0x7eff300cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff36202700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff30071ab0 con 0x7eff30161670 2023-10-14T12:19:56.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff36202700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff30161bc0 con 0x7eff3006af50 2023-10-14T12:19:56.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff36202700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff30161ea0 con 0x7eff300cc3f0 2023-10-14T12:19:56.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff300cc3f0 0x7eff300cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff300cc3f0 0x7eff300cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40236/0 (socket says 172.21.15.32:40236) 2023-10-14T12:19:56.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2effd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7eff30161670 0x7eff3006a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57260/0 (socket says 172.21.15.32:57260) 2023-10-14T12:19:56.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 -- 172.21.15.32:0/2962914755 learned_addr learned my addr 172.21.15.32:0/2962914755 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:56.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 -- 172.21.15.32:0/2962914755 >> v1:172.21.15.92:6789/0 conn(0x7eff3006af50 legacy=0x7eff30071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 -- 172.21.15.32:0/2962914755 >> v1:172.21.15.32:6789/0 conn(0x7eff30161670 legacy=0x7eff3006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 -- 172.21.15.32:0/2962914755 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30162180 con 0x7eff300cc3f0 2023-10-14T12:19:56.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2f7fe700 1 --2- 172.21.15.32:0/2962914755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300cc7d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff200098f0 tx=0x7eff20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52094ddaf988ed0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2e7fc700 1 -- 172.21.15.32:0/2962914755 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000b8a0 con 0x7eff300cc3f0 2023-10-14T12:19:56.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2e7fc700 1 -- 172.21.15.32:0/2962914755 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000ba00 con 0x7eff300cc3f0 2023-10-14T12:19:56.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.507+0000 7eff2e7fc700 1 -- 172.21.15.32:0/2962914755 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000bd90 con 0x7eff300cc3f0 2023-10-14T12:19:56.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 -- 172.21.15.32:0/2962914755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 msgr2=0x7eff300cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 --2- 172.21.15.32:0/2962914755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300cc7d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff200098f0 tx=0x7eff20009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:56.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 -- 172.21.15.32:0/2962914755 shutdown_connections 2023-10-14T12:19:56.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 --2- 172.21.15.32:0/2962914755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300cc7d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 -- 172.21.15.32:0/2962914755 >> 172.21.15.32:0/2962914755 conn(0x7eff3006dac0 msgr2=0x7eff3006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 -- 172.21.15.32:0/2962914755 shutdown_connections 2023-10-14T12:19:56.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.508+0000 7eff36202700 1 -- 172.21.15.32:0/2962914755 wait complete. 2023-10-14T12:19:56.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.509+0000 7eff36202700 1 Processor -- start 2023-10-14T12:19:56.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.509+0000 7eff36202700 1 -- start start 2023-10-14T12:19:56.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff36202700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff3006af50 0x7eff300b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff36202700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff36202700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff30161670 0x7eff300b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff36202700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff30145160 con 0x7eff300cc3f0 2023-10-14T12:19:56.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff36202700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300ad900 con 0x7eff3006af50 2023-10-14T12:19:56.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff36202700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b4f80 con 0x7eff30161670 2023-10-14T12:19:56.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff2effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff2effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40244/0 (socket says 172.21.15.32:40244) 2023-10-14T12:19:56.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff2effd700 1 -- 172.21.15.32:0/3911377265 learned_addr learned my addr 172.21.15.32:0/3911377265 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:56.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff2f7fe700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff3006af50 0x7eff300b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.510+0000 7eff2ffff700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff30161670 0x7eff300b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff2effd700 1 -- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff30161670 msgr2=0x7eff300b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff2effd700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff30161670 0x7eff300b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff2effd700 1 -- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff3006af50 msgr2=0x7eff300b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff2effd700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff3006af50 0x7eff300b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff2effd700 1 -- 172.21.15.32:0/3911377265 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20009550 con 0x7eff300cc3f0 2023-10-14T12:19:56.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff2effd700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300b2930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c520 tx=0x7eff2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24005cb0 con 0x7eff300cc3f0 2023-10-14T12:19:56.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff24005e10 con 0x7eff300cc3f0 2023-10-14T12:19:56.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff300b5260 con 0x7eff300cc3f0 2023-10-14T12:19:56.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240072d0 con 0x7eff300cc3f0 2023-10-14T12:19:56.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.511+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff300b5820 con 0x7eff300cc3f0 2023-10-14T12:19:56.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.512+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff30067d20 con 0x7eff300cc3f0 2023-10-14T12:19:56.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.512+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7eff24007430 con 0x7eff300cc3f0 2023-10-14T12:19:56.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.513+0000 7eff17fff700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7eff1c06af00 0x7eff1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.513+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7eff240887d0 con 0x7eff300cc3f0 2023-10-14T12:19:56.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.513+0000 7eff2f7fe700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7eff1c06af00 0x7eff1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.514+0000 7eff2f7fe700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7eff1c06af00 0x7eff1c06d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7eff20009c40 tx=0x7eff20008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.517+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff240539a0 con 0x7eff300cc3f0 2023-10-14T12:19:56.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.716+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7eff30162460 con 0x7eff1c06af00 2023-10-14T12:19:56.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.716+0000 7eff17fff700 1 -- 172.21.15.32:0/3911377265 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff2000bbf0 con 0x7eff1c06af00 2023-10-14T12:19:56.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7eff1c06af00 msgr2=0x7eff1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7eff1c06af00 0x7eff1c06d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7eff20009c40 tx=0x7eff20008030 comp rx=0 tx=0).stop 2023-10-14T12:19:56.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 msgr2=0x7eff300b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300b2930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c520 tx=0x7eff2400c830 comp rx=0 tx=0).stop 2023-10-14T12:19:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 shutdown_connections 2023-10-14T12:19:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff30161670 0x7eff300b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7eff1c06af00 0x7eff1c06d3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff3006af50 0x7eff300b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 --2- 172.21.15.32:0/3911377265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff300cc3f0 0x7eff300b2930 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 >> 172.21.15.32:0/3911377265 conn(0x7eff3006dac0 msgr2=0x7eff30160a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 shutdown_connections 2023-10-14T12:19:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.718+0000 7eff36202700 1 -- 172.21.15.32:0/3911377265 wait complete. 2023-10-14T12:19:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T12:19:56.732 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T12:19:56.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:56.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.859+0000 7f6b3cfed700 1 Processor -- start 2023-10-14T12:19:56.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.859+0000 7f6b3cfed700 1 -- start start 2023-10-14T12:19:56.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.860+0000 7f6b3cfed700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b38151680 0x7f6b3815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.860+0000 7f6b3cfed700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6b380727e0 0x7f6b380b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.860+0000 7f6b3cfed700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b380b2e40 con 0x7f6b3806da30 2023-10-14T12:19:56.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.860+0000 7f6b3cfed700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3815e7c0 con 0x7f6b380727e0 2023-10-14T12:19:56.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.860+0000 7f6b3cfed700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380b2880 con 0x7f6b38151680 2023-10-14T12:19:56.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b35d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6b380727e0 0x7f6b380b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b38151680 0x7f6b3815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b36d9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6b3806da30 0x7f6b3815acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:56154/0 (socket says 172.21.15.32:56154) 2023-10-14T12:19:56.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b36d9d700 1 -- 172.21.15.32:0/3682608845 learned_addr learned my addr 172.21.15.32:0/3682608845 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:56.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b35d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6b380727e0 0x7f6b380b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:44518/0 (socket says 172.21.15.32:44518) 2023-10-14T12:19:56.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3659c700 1 -- 172.21.15.32:0/3682608845 >> v2:172.21.15.92:3300/0 conn(0x7f6b380727e0 msgr2=0x7f6b380b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:56.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3559a700 1 -- 172.21.15.32:0/3682608845 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306954438 0 0) 0x7f6b30001490 con 0x7f6b3806da30 2023-10-14T12:19:56.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3659c700 1 --2- 172.21.15.32:0/3682608845 >> v2:172.21.15.92:3300/0 conn(0x7f6b380727e0 0x7f6b380b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3659c700 1 -- 172.21.15.32:0/3682608845 >> v1:172.21.15.92:6789/0 conn(0x7f6b3806da30 legacy=0x7f6b3815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3659c700 1 -- 172.21.15.32:0/3682608845 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380b2b60 con 0x7f6b38151680 2023-10-14T12:19:56.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3659c700 1 --2- 172.21.15.32:0/3682608845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b38151680 0x7f6b3815ec50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009840 tx=0x7f6b2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46c8398b6b545407 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3559a700 1 -- 172.21.15.32:0/3682608845 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011830 con 0x7f6b38151680 2023-10-14T12:19:56.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3559a700 1 -- 172.21.15.32:0/3682608845 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c011990 con 0x7f6b38151680 2023-10-14T12:19:56.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.861+0000 7f6b3559a700 1 -- 172.21.15.32:0/3682608845 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011d20 con 0x7f6b38151680 2023-10-14T12:19:56.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 -- 172.21.15.32:0/3682608845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b38151680 msgr2=0x7f6b3815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 --2- 172.21.15.32:0/3682608845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b38151680 0x7f6b3815ec50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009840 tx=0x7f6b2c009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:56.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 -- 172.21.15.32:0/3682608845 shutdown_connections 2023-10-14T12:19:56.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 --2- 172.21.15.32:0/3682608845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b38151680 0x7f6b3815ec50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 --2- 172.21.15.32:0/3682608845 >> v2:172.21.15.92:3300/0 conn(0x7f6b380727e0 0x7f6b380b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 -- 172.21.15.32:0/3682608845 >> 172.21.15.32:0/3682608845 conn(0x7f6b3806bd70 msgr2=0x7f6b3806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 -- 172.21.15.32:0/3682608845 shutdown_connections 2023-10-14T12:19:56.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.862+0000 7f6b3cfed700 1 -- 172.21.15.32:0/3682608845 wait complete. 2023-10-14T12:19:56.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.863+0000 7f6b3cfed700 1 Processor -- start 2023-10-14T12:19:56.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.863+0000 7f6b3cfed700 1 -- start start 2023-10-14T12:19:56.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b3cfed700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b3806da30 0x7f6b3806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b3cfed700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b380727e0 0x7f6b380c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b3cfed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b38151680 0x7f6b380cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b3cfed700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3814fb60 con 0x7f6b380727e0 2023-10-14T12:19:56.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b3cfed700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3814ef50 con 0x7f6b38151680 2023-10-14T12:19:56.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b3cfed700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3814f230 con 0x7f6b3806da30 2023-10-14T12:19:56.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b35d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b380727e0 0x7f6b380c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b35d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b380727e0 0x7f6b380c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40258/0 (socket says 172.21.15.32:40258) 2023-10-14T12:19:56.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.864+0000 7f6b35d9b700 1 -- 172.21.15.32:0/1096127939 learned_addr learned my addr 172.21.15.32:0/1096127939 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:56.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b36d9d700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b38151680 0x7f6b380cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b3659c700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b3806da30 0x7f6b3806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b35d9b700 1 -- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b3806da30 msgr2=0x7f6b3806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b35d9b700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6b3806da30 0x7f6b3806ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b35d9b700 1 -- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b38151680 msgr2=0x7f6b380cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b35d9b700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b38151680 0x7f6b380cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b35d9b700 1 -- 172.21.15.32:0/1096127939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0094a0 con 0x7f6b380727e0 2023-10-14T12:19:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b35d9b700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b380727e0 0x7f6b380c5fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800e9b0 tx=0x7f6b2800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28009710 con 0x7f6b380727e0 2023-10-14T12:19:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800c850 con 0x7f6b380727e0 2023-10-14T12:19:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800cbc0 con 0x7f6b380727e0 2023-10-14T12:19:56.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3814f510 con 0x7f6b380727e0 2023-10-14T12:19:56.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.865+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3806b370 con 0x7f6b380727e0 2023-10-14T12:19:56.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.866+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b3815f190 con 0x7f6b380727e0 2023-10-14T12:19:56.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.866+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b2800cd20 con 0x7f6b380727e0 2023-10-14T12:19:56.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b26ffd700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6b1806af00 0x7f6b1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6b28089a30 con 0x7f6b380727e0 2023-10-14T12:19:56.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b26ffd700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f6b18073100 0x7f6b18075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:56.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 --> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b18075c10 con 0x7f6b18073100 2023-10-14T12:19:56.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b2808e2c0 con 0x7f6b380727e0 2023-10-14T12:19:56.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b3659c700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6b1806af00 0x7f6b1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.867+0000 7f6b36d9d700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f6b18073100 0x7f6b18075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:56.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.868+0000 7f6b3659c700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6b1806af00 0x7f6b1806d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c000c00 tx=0x7f6b2c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.868+0000 7f6b36d9d700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f6b18073100 0x7f6b18075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:56.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.868+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== osd.5 v2:172.21.15.92:6808/2463723168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6b18075c10 con 0x7f6b18073100 2023-10-14T12:19:56.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.883+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 --> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6b3815e450 con 0x7f6b18073100 2023-10-14T12:19:56.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b26ffd700 1 -- 172.21.15.32:0/1096127939 <== osd.5 v2:172.21.15.92:6808/2463723168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6b300070b0 con 0x7f6b18073100 2023-10-14T12:19:56.887 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:56.887 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:56.887 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:56.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f6b18073100 msgr2=0x7f6b18075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6808/2463723168,v1:172.21.15.92:6809/2463723168] conn(0x7f6b18073100 0x7f6b18075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:56.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6b1806af00 msgr2=0x7f6b1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6b1806af00 0x7f6b1806d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c000c00 tx=0x7f6b2c008030 comp rx=0 tx=0).stop 2023-10-14T12:19:56.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b380727e0 msgr2=0x7f6b380c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:56.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 --2- 172.21.15.32:0/1096127939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b380727e0 0x7f6b380c5fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800e9b0 tx=0x7f6b2800ed70 comp rx=0 tx=0).stop 2023-10-14T12:19:56.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b36d9d700 1 -- 172.21.15.32:0/1096127939 reap_dead start 2023-10-14T12:19:56.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 shutdown_connections 2023-10-14T12:19:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 >> 172.21.15.32:0/1096127939 conn(0x7f6b3806bd70 msgr2=0x7f6b38146180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.884+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 shutdown_connections 2023-10-14T12:19:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:56.885+0000 7f6b3cfed700 1 -- 172.21.15.32:0/1096127939 wait complete. 2023-10-14T12:19:56.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T12:19:57.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 Processor -- start 2023-10-14T12:19:57.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 -- start start 2023-10-14T12:19:57.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01fc0ce3b0 0x7f01fc0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01fc072a10 con 0x7f01fc0ccec0 2023-10-14T12:19:57.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01fc0ced70 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.023+0000 7f02015ea700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc0b2230 con 0x7f01fc15b8b0 2023-10-14T12:19:57.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01fa7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01fc0ce3b0 0x7f01fc0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01faffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01fb7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f01fc0ccec0 0x7f01fc0cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:56170/0 (socket says 172.21.15.32:56170) 2023-10-14T12:19:57.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01fb7fe700 1 -- 172.21.15.32:0/1548885632 learned_addr learned my addr 172.21.15.32:0/1548885632 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:57.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01faffd700 1 -- 172.21.15.32:0/1548885632 >> v2:172.21.15.92:3300/0 conn(0x7f01fc0ce3b0 msgr2=0x7f01fc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:57.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01faffd700 1 --2- 172.21.15.32:0/1548885632 >> v2:172.21.15.92:3300/0 conn(0x7f01fc0ce3b0 0x7f01fc0ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01faffd700 1 -- 172.21.15.32:0/1548885632 >> v1:172.21.15.92:6789/0 conn(0x7f01fc0ccec0 legacy=0x7f01fc0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01faffd700 1 -- 172.21.15.32:0/1548885632 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0b2e90 con 0x7f01fc15b8b0 2023-10-14T12:19:57.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01fa7fc700 1 --2- 172.21.15.32:0/1548885632 >> v2:172.21.15.92:3300/0 conn(0x7f01fc0ce3b0 0x7f01fc0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:19:57.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.024+0000 7f01faffd700 1 --2- 172.21.15.32:0/1548885632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0b2950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009840 tx=0x7f01ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c7b06342fbe0e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f01f9ffb700 1 -- 172.21.15.32:0/1548885632 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec011830 con 0x7f01fc15b8b0 2023-10-14T12:19:57.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f01f9ffb700 1 -- 172.21.15.32:0/1548885632 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec011990 con 0x7f01fc15b8b0 2023-10-14T12:19:57.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f01f9ffb700 1 -- 172.21.15.32:0/1548885632 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec011d20 con 0x7f01fc15b8b0 2023-10-14T12:19:57.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 -- 172.21.15.32:0/1548885632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 msgr2=0x7f01fc0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 --2- 172.21.15.32:0/1548885632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0b2950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009840 tx=0x7f01ec009b50 comp rx=0 tx=0).stop 2023-10-14T12:19:57.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 -- 172.21.15.32:0/1548885632 shutdown_connections 2023-10-14T12:19:57.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 --2- 172.21.15.32:0/1548885632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0b2950 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 --2- 172.21.15.32:0/1548885632 >> v2:172.21.15.92:3300/0 conn(0x7f01fc0ce3b0 0x7f01fc0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 -- 172.21.15.32:0/1548885632 >> 172.21.15.32:0/1548885632 conn(0x7f01fc06dac0 msgr2=0x7f01fc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 -- 172.21.15.32:0/1548885632 shutdown_connections 2023-10-14T12:19:57.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.025+0000 7f02015ea700 1 -- 172.21.15.32:0/1548885632 wait complete. 2023-10-14T12:19:57.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.026+0000 7f02015ea700 1 Processor -- start 2023-10-14T12:19:57.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 -- start start 2023-10-14T12:19:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01fc0ccec0 0x7f01fc1f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 0x7f01fc158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc1f7120 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc0b1590 con 0x7f01fc0ccec0 2023-10-14T12:19:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f02015ea700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc0b12b0 con 0x7f01fc15b8b0 2023-10-14T12:19:57.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f01fa7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 0x7f01fc158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f01fa7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 0x7f01fc158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40276/0 (socket says 172.21.15.32:40276) 2023-10-14T12:19:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f01fa7fc700 1 -- 172.21.15.32:0/3123653371 learned_addr learned my addr 172.21.15.32:0/3123653371 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.027+0000 7f01faffd700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01fc0ccec0 0x7f01fc1f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fb7fe700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fa7fc700 1 -- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 msgr2=0x7f01fc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fa7fc700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fa7fc700 1 -- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01fc0ccec0 msgr2=0x7f01fc1f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fa7fc700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01fc0ccec0 0x7f01fc1f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fa7fc700 1 -- 172.21.15.32:0/3123653371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00094a0 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01fa7fc700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 0x7f01fc158580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ebe0 tx=0x7f01f000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0009800 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f000c910 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000cc80 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0094a0 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.028+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01fc0caf10 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.029+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01fc0cb560 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.030+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f01f0013470 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.030+0000 7f01e37fe700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f01e806af00 0x7f01e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.030+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f01f00896c0 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.030+0000 7f01faffd700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f01e806af00 0x7f01e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.031+0000 7f01faffd700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f01e806af00 0x7f01e806d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01ec000c00 tx=0x7f01ec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.035+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01f00547e0 con 0x7f01fc0ce3b0 2023-10-14T12:19:57.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.234+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f01fc072170 con 0x7f01e806af00 2023-10-14T12:19:57.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.235+0000 7f01e37fe700 1 -- 172.21.15.32:0/3123653371 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f01ec011c00 con 0x7f01e806af00 2023-10-14T12:19:57.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f01e806af00 msgr2=0x7f01e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f01e806af00 0x7f01e806d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01ec000c00 tx=0x7f01ec008030 comp rx=0 tx=0).stop 2023-10-14T12:19:57.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 msgr2=0x7f01fc158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 0x7f01fc158580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ebe0 tx=0x7f01f000eef0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 shutdown_connections 2023-10-14T12:19:57.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01fc15b8b0 0x7f01fc0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f01e806af00 0x7f01e806d3c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01fc0ccec0 0x7f01fc1f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 --2- 172.21.15.32:0/3123653371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01fc0ce3b0 0x7f01fc158580 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 >> 172.21.15.32:0/3123653371 conn(0x7f01fc06dac0 msgr2=0x7f01fc0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 shutdown_connections 2023-10-14T12:19:57.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.237+0000 7f02015ea700 1 -- 172.21.15.32:0/3123653371 wait complete. 2023-10-14T12:19:57.243 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T12:19:57.250 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T12:19:57.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:57.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.378+0000 7fb868393700 1 Processor -- start 2023-10-14T12:19:57.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.378+0000 7fb868393700 1 -- start start 2023-10-14T12:19:57.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.379+0000 7fb868393700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015d7f0 0x7fb8600d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.379+0000 7fb868393700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb8600d23f0 0x7fb8600ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.379+0000 7fb868393700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8600cf8b0 con 0x7fb86015dbd0 2023-10-14T12:19:57.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.379+0000 7fb868393700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600cf5d0 con 0x7fb8600d23f0 2023-10-14T12:19:57.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.379+0000 7fb868393700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b6710 con 0x7fb86015d7f0 2023-10-14T12:19:57.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.379+0000 7fb866930700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb8600d23f0 0x7fb8600ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb8600d23f0 0x7fb8600ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40284/0 (socket says 172.21.15.32:40284) 2023-10-14T12:19:57.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 -- 172.21.15.32:0/4084758933 learned_addr learned my addr 172.21.15.32:0/4084758933 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb86612f700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015d7f0 0x7fb8600d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 -- 172.21.15.32:0/4084758933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015d7f0 msgr2=0x7fb8600d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:57.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015d7f0 0x7fb8600d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 -- 172.21.15.32:0/4084758933 >> v1:172.21.15.92:6789/0 conn(0x7fb86015dbd0 legacy=0x7fb8600d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 -- 172.21.15.32:0/4084758933 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600b69f0 con 0x7fb8600d23f0 2023-10-14T12:19:57.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb86612f700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015d7f0 0x7fb8600d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:57.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb866930700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8600d23f0 0x7fb8600ceed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb858009e50 tx=0x7fb85800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bee44303fdf2ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb86512d700 1 -- 172.21.15.32:0/4084758933 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800e070 con 0x7fb8600d23f0 2023-10-14T12:19:57.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb86512d700 1 -- 172.21.15.32:0/4084758933 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800b9c0 con 0x7fb8600d23f0 2023-10-14T12:19:57.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.380+0000 7fb86512d700 1 -- 172.21.15.32:0/4084758933 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800bd70 con 0x7fb8600d23f0 2023-10-14T12:19:57.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 -- 172.21.15.32:0/4084758933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8600d23f0 msgr2=0x7fb8600ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8600d23f0 0x7fb8600ceed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb858009e50 tx=0x7fb85800b330 comp rx=0 tx=0).stop 2023-10-14T12:19:57.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 -- 172.21.15.32:0/4084758933 shutdown_connections 2023-10-14T12:19:57.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8600d23f0 0x7fb8600ceed0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 --2- 172.21.15.32:0/4084758933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015d7f0 0x7fb8600d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 -- 172.21.15.32:0/4084758933 >> 172.21.15.32:0/4084758933 conn(0x7fb86009ca60 msgr2=0x7fb8600d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 -- 172.21.15.32:0/4084758933 shutdown_connections 2023-10-14T12:19:57.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.381+0000 7fb868393700 1 -- 172.21.15.32:0/4084758933 wait complete. 2023-10-14T12:19:57.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.382+0000 7fb868393700 1 Processor -- start 2023-10-14T12:19:57.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.382+0000 7fb868393700 1 -- start start 2023-10-14T12:19:57.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8600d23f0 0x7fb86009e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86015d7f0 0x7fb860150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015dbd0 0x7fb860150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601503f0 con 0x7fb86015d7f0 2023-10-14T12:19:57.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860151290 con 0x7fb8600d23f0 2023-10-14T12:19:57.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86014f770 con 0x7fb86015dbd0 2023-10-14T12:19:57.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86015d7f0 0x7fb860150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86015d7f0 0x7fb860150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40288/0 (socket says 172.21.15.32:40288) 2023-10-14T12:19:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 -- 172.21.15.32:0/1317830338 learned_addr learned my addr 172.21.15.32:0/1317830338 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb866930700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015dbd0 0x7fb860150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86612f700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8600d23f0 0x7fb86009e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 -- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015dbd0 msgr2=0x7fb860150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb86015dbd0 0x7fb860150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 -- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8600d23f0 msgr2=0x7fb86009e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8600d23f0 0x7fb86009e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 -- 172.21.15.32:0/1317830338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009b30 con 0x7fb86015d7f0 2023-10-14T12:19:57.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb86592e700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86015d7f0 0x7fb860150810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c450 tx=0x7fb85c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0052d0 con 0x7fb86015d7f0 2023-10-14T12:19:57.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c005430 con 0x7fb86015d7f0 2023-10-14T12:19:57.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86014fa50 con 0x7fb86015d7f0 2023-10-14T12:19:57.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0038c0 con 0x7fb86015d7f0 2023-10-14T12:19:57.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.383+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb860150010 con 0x7fb86015d7f0 2023-10-14T12:19:57.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.384+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8600b6cd0 con 0x7fb86015d7f0 2023-10-14T12:19:57.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.385+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb85c003a20 con 0x7fb86015d7f0 2023-10-14T12:19:57.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.385+0000 7fb856ffd700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb84406af00 0x7fb84406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.385+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb85c089000 con 0x7fb86015d7f0 2023-10-14T12:19:57.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb856ffd700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7fb844073100 0x7fb844075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 --> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb844075c10 con 0x7fb844073100 2023-10-14T12:19:57.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb85c089450 con 0x7fb86015d7f0 2023-10-14T12:19:57.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb86612f700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb84406af00 0x7fb84406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb866930700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7fb844073100 0x7fb844075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb86612f700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb84406af00 0x7fb84406d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8500099c0 tx=0x7fb850008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.386+0000 7fb866930700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7fb844073100 0x7fb844075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.387+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== osd.6 v2:172.21.15.92:6816/1317212629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb844075c10 con 0x7fb844073100 2023-10-14T12:19:57.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 --> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8601501d0 con 0x7fb844073100 2023-10-14T12:19:57.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb856ffd700 1 -- 172.21.15.32:0/1317830338 <== osd.6 v2:172.21.15.92:6816/1317212629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb8601501d0 con 0x7fb844073100 2023-10-14T12:19:57.407 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:57.407 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:57.408 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:57.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7fb844073100 msgr2=0x7fb844075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6816/1317212629,v1:172.21.15.92:6818/1317212629] conn(0x7fb844073100 0x7fb844075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb84406af00 msgr2=0x7fb84406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb84406af00 0x7fb84406d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8500099c0 tx=0x7fb850008040 comp rx=0 tx=0).stop 2023-10-14T12:19:57.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86015d7f0 msgr2=0x7fb860150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb868393700 1 --2- 172.21.15.32:0/1317830338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86015d7f0 0x7fb860150810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c450 tx=0x7fb85c00c760 comp rx=0 tx=0).stop 2023-10-14T12:19:57.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.402+0000 7fb866930700 1 -- 172.21.15.32:0/1317830338 reap_dead start 2023-10-14T12:19:57.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.403+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 shutdown_connections 2023-10-14T12:19:57.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.403+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 >> 172.21.15.32:0/1317830338 conn(0x7fb86009ca60 msgr2=0x7fb860160340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.403+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 shutdown_connections 2023-10-14T12:19:57.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.403+0000 7fb868393700 1 -- 172.21.15.32:0/1317830338 wait complete. 2023-10-14T12:19:57.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T12:19:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.542+0000 7fb7ec7e0700 1 Processor -- start 2023-10-14T12:19:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.542+0000 7fb7ec7e0700 1 -- start start 2023-10-14T12:19:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ec7e0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e415a850 0x7fb7e40cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ec7e0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7e40b2940 0x7fb7e40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ec7e0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb7e40cd2e0 0x7fb7e4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ec7e0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40ce3b0 con 0x7fb7e40b2940 2023-10-14T12:19:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ec7e0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40b2dc0 con 0x7fb7e40cd2e0 2023-10-14T12:19:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ec7e0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40b6290 con 0x7fb7e415a850 2023-10-14T12:19:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7e40b2940 0x7fb7e40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7e40b2940 0x7fb7e40ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40296/0 (socket says 172.21.15.32:40296) 2023-10-14T12:19:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 -- 172.21.15.32:0/1696731583 learned_addr learned my addr 172.21.15.32:0/1696731583 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ead7d700 1 --2- 172.21.15.32:0/1696731583 >> v2:172.21.15.92:3300/0 conn(0x7fb7e40cd2e0 0x7fb7e4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ea57c700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e415a850 0x7fb7e40cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 -- 172.21.15.32:0/1696731583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e415a850 msgr2=0x7fb7e40cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e415a850 0x7fb7e40cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 -- 172.21.15.32:0/1696731583 >> v2:172.21.15.92:3300/0 conn(0x7fb7e40cd2e0 msgr2=0x7fb7e4071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 --2- 172.21.15.32:0/1696731583 >> v2:172.21.15.92:3300/0 conn(0x7fb7e40cd2e0 0x7fb7e4071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 -- 172.21.15.32:0/1696731583 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40cc220 con 0x7fb7e40b2940 2023-10-14T12:19:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7ea57c700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e415a850 0x7fb7e40cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:19:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.543+0000 7fb7e9d7b700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e40ccda0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40caa90 tx=0x7fb7d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a993cb8ba5ea5d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7e957a700 1 -- 172.21.15.32:0/1696731583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400b870 con 0x7fb7e40b2940 2023-10-14T12:19:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7e957a700 1 -- 172.21.15.32:0/1696731583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400b9d0 con 0x7fb7e40b2940 2023-10-14T12:19:57.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7e957a700 1 -- 172.21.15.32:0/1696731583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400bd60 con 0x7fb7e40b2940 2023-10-14T12:19:57.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/1696731583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 msgr2=0x7fb7e40ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e40ccda0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40caa90 tx=0x7fb7d4009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/1696731583 shutdown_connections 2023-10-14T12:19:57.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/1696731583 >> v2:172.21.15.92:3300/0 conn(0x7fb7e40cd2e0 0x7fb7e4071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e415a850 0x7fb7e40cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/1696731583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e40ccda0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/1696731583 >> 172.21.15.32:0/1696731583 conn(0x7fb7e406dac0 msgr2=0x7fb7e406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/1696731583 shutdown_connections 2023-10-14T12:19:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.544+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/1696731583 wait complete. 2023-10-14T12:19:57.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.545+0000 7fb7ec7e0700 1 Processor -- start 2023-10-14T12:19:57.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 -- start start 2023-10-14T12:19:57.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e41e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e40cd2e0 0x7fb7e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e415a850 0x7fb7e406ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40b54d0 con 0x7fb7e40b2940 2023-10-14T12:19:57.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40b48e0 con 0x7fb7e415a850 2023-10-14T12:19:57.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ec7e0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e415d690 con 0x7fb7e40cd2e0 2023-10-14T12:19:57.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ea57c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e41e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ea57c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e41e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40302/0 (socket says 172.21.15.32:40302) 2023-10-14T12:19:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ea57c700 1 -- 172.21.15.32:0/4166103500 learned_addr learned my addr 172.21.15.32:0/4166103500 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7ead7d700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e415a850 0x7fb7e406ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.546+0000 7fb7e9d7b700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e40cd2e0 0x7fb7e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ea57c700 1 -- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e40cd2e0 msgr2=0x7fb7e406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ea57c700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e40cd2e0 0x7fb7e406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ea57c700 1 -- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e415a850 msgr2=0x7fb7e406ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ea57c700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e415a850 0x7fb7e406ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ea57c700 1 -- 172.21.15.32:0/4166103500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4009550 con 0x7fb7e40b2940 2023-10-14T12:19:57.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ead7d700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e415a850 0x7fb7e406ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:57.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ea57c700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e41e5470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c820 tx=0x7fb7e000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011800 con 0x7fb7e40b2940 2023-10-14T12:19:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0011960 con 0x7fb7e40b2940 2023-10-14T12:19:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e41e59b0 con 0x7fb7e40b2940 2023-10-14T12:19:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011d10 con 0x7fb7e40b2940 2023-10-14T12:19:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.547+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e40b4e10 con 0x7fb7e40b2940 2023-10-14T12:19:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.548+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e4067d20 con 0x7fb7e40b2940 2023-10-14T12:19:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.549+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb7e0018360 con 0x7fb7e40b2940 2023-10-14T12:19:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.549+0000 7fb7daffd700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb7c806af00 0x7fb7c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.549+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb7e0089520 con 0x7fb7e40b2940 2023-10-14T12:19:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.549+0000 7fb7e9d7b700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb7c806af00 0x7fb7c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.550+0000 7fb7e9d7b700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb7c806af00 0x7fb7c806d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4014040 tx=0x7fb7d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.554+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7e00545c0 con 0x7fb7e40b2940 2023-10-14T12:19:57.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.751+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7e40cc7e0 con 0x7fb7c806af00 2023-10-14T12:19:57.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.752+0000 7fb7daffd700 1 -- 172.21.15.32:0/4166103500 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7d400bbc0 con 0x7fb7c806af00 2023-10-14T12:19:57.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb7c806af00 msgr2=0x7fb7c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb7c806af00 0x7fb7c806d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4014040 tx=0x7fb7d4008030 comp rx=0 tx=0).stop 2023-10-14T12:19:57.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 msgr2=0x7fb7e41e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e41e5470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c820 tx=0x7fb7e000cbe0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 shutdown_connections 2023-10-14T12:19:57.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7fb7c806af00 0x7fb7c806d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e415a850 0x7fb7e406ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7e40b2940 0x7fb7e41e5470 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 --2- 172.21.15.32:0/4166103500 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e40cd2e0 0x7fb7e406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 >> 172.21.15.32:0/4166103500 conn(0x7fb7e406dac0 msgr2=0x7fb7e40b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 shutdown_connections 2023-10-14T12:19:57.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.754+0000 7fb7ec7e0700 1 -- 172.21.15.32:0/4166103500 wait complete. 2023-10-14T12:19:57.759 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T12:19:57.767 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T12:19:57.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:19:57.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.896+0000 7f9c348d7700 1 Processor -- start 2023-10-14T12:19:57.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.896+0000 7f9c348d7700 1 -- start start 2023-10-14T12:19:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c348d7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c300727e0 0x7f9c300b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c348d7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9c3006da30 0x7f9c3006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c348d7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c300b2e40 con 0x7f9c30151680 2023-10-14T12:19:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c348d7700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3006e420 con 0x7f9c300727e0 2023-10-14T12:19:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c348d7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3015e7c0 con 0x7f9c3006da30 2023-10-14T12:19:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c300727e0 0x7f9c300b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c300727e0 0x7f9c300b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40312/0 (socket says 172.21.15.32:40312) 2023-10-14T12:19:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/239966019 learned_addr learned my addr 172.21.15.32:0/239966019 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2ed9d700 1 --2- 172.21.15.32:0/239966019 >> v2:172.21.15.92:3300/0 conn(0x7f9c3006da30 0x7f9c3006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/239966019 >> v2:172.21.15.92:3300/0 conn(0x7f9c3006da30 msgr2=0x7f9c3006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:57.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 --2- 172.21.15.32:0/239966019 >> v2:172.21.15.92:3300/0 conn(0x7f9c3006da30 0x7f9c3006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/239966019 >> v1:172.21.15.92:6789/0 conn(0x7f9c30151680 legacy=0x7f9c3015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:57.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.897+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/239966019 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300b2880 con 0x7f9c300727e0 2023-10-14T12:19:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c2dd9b700 1 --2- 172.21.15.32:0/239966019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300b1f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9c3015be00 tx=0x7f9c20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf2804aebc13e10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c2d59a700 1 -- 172.21.15.32:0/239966019 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20004230 con 0x7f9c300727e0 2023-10-14T12:19:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c2d59a700 1 -- 172.21.15.32:0/239966019 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c20004390 con 0x7f9c300727e0 2023-10-14T12:19:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c2d59a700 1 -- 172.21.15.32:0/239966019 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200036a0 con 0x7f9c300727e0 2023-10-14T12:19:57.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 -- 172.21.15.32:0/239966019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 msgr2=0x7f9c300b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 --2- 172.21.15.32:0/239966019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300b1f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9c3015be00 tx=0x7f9c20009bd0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 -- 172.21.15.32:0/239966019 shutdown_connections 2023-10-14T12:19:57.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 --2- 172.21.15.32:0/239966019 >> v2:172.21.15.92:3300/0 conn(0x7f9c3006da30 0x7f9c3006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 --2- 172.21.15.32:0/239966019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300b1f10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 -- 172.21.15.32:0/239966019 >> 172.21.15.32:0/239966019 conn(0x7f9c3006bd70 msgr2=0x7f9c3006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 -- 172.21.15.32:0/239966019 shutdown_connections 2023-10-14T12:19:57.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.898+0000 7f9c348d7700 1 -- 172.21.15.32:0/239966019 wait complete. 2023-10-14T12:19:57.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 Processor -- start 2023-10-14T12:19:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 -- start start 2023-10-14T12:19:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3006da30 0x7f9c3014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c30151680 0x7f9c300b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300ca530 con 0x7f9c300727e0 2023-10-14T12:19:57.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300c68b0 con 0x7f9c3006da30 2023-10-14T12:19:57.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.900+0000 7f9c348d7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301545e0 con 0x7f9c30151680 2023-10-14T12:19:57.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40318/0 (socket says 172.21.15.32:40318) 2023-10-14T12:19:57.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/1269471690 learned_addr learned my addr 172.21.15.32:0/1269471690 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:57.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2e59c700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3006da30 0x7f9c3014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2ed9d700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c30151680 0x7f9c300b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c30151680 msgr2=0x7f9c300b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c30151680 0x7f9c300b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3006da30 msgr2=0x7f9c3014fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c3006da30 0x7f9c3014fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 -- 172.21.15.32:0/1269471690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20009550 con 0x7f9c300727e0 2023-10-14T12:19:57.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c2dd9b700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300afef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009130 tx=0x7f9c20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20003b90 con 0x7f9c300727e0 2023-10-14T12:19:57.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2001f070 con 0x7f9c300727e0 2023-10-14T12:19:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c30159cc0 con 0x7f9c300727e0 2023-10-14T12:19:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20011630 con 0x7f9c300727e0 2023-10-14T12:19:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.901+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c301540c0 con 0x7f9c300727e0 2023-10-14T12:19:57.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.902+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c3015e450 con 0x7f9c300727e0 2023-10-14T12:19:57.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.903+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c20021030 con 0x7f9c300727e0 2023-10-14T12:19:57.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.903+0000 7f9c1effd700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1006af00 0x7f9c1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.903+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9c2008a8a0 con 0x7f9c300727e0 2023-10-14T12:19:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.903+0000 7f9c1effd700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7f9c10073100 0x7f9c10075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.903+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 --> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c10075c10 con 0x7f9c10073100 2023-10-14T12:19:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.903+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c2008f2a0 con 0x7f9c300727e0 2023-10-14T12:19:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.904+0000 7f9c2e59c700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1006af00 0x7f9c1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.904+0000 7f9c2ed9d700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7f9c10073100 0x7f9c10075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.904+0000 7f9c2e59c700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1006af00 0x7f9c1006d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c30072660 tx=0x7f9c240090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.904+0000 7f9c2ed9d700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7f9c10073100 0x7f9c10075540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:57.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.905+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== osd.7 v2:172.21.15.92:6817/769790747 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9c10075c10 con 0x7f9c10073100 2023-10-14T12:19:57.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 --> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c300b2b60 con 0x7f9c10073100 2023-10-14T12:19:57.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c1effd700 1 -- 172.21.15.32:0/1269471690 <== osd.7 v2:172.21.15.92:6817/769790747 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9c280083a0 con 0x7f9c10073100 2023-10-14T12:19:57.922 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-14T12:19:57.923 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:19:57.923 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-14T12:19:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7f9c10073100 msgr2=0x7f9c10075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6817/769790747,v1:172.21.15.92:6819/769790747] conn(0x7f9c10073100 0x7f9c10075540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1006af00 msgr2=0x7f9c1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f9c1006af00 0x7f9c1006d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c30072660 tx=0x7f9c240090e0 comp rx=0 tx=0).stop 2023-10-14T12:19:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 msgr2=0x7f9c300afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 --2- 172.21.15.32:0/1269471690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300727e0 0x7f9c300afef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009130 tx=0x7f9c20004750 comp rx=0 tx=0).stop 2023-10-14T12:19:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c2ed9d700 1 -- 172.21.15.32:0/1269471690 reap_dead start 2023-10-14T12:19:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 shutdown_connections 2023-10-14T12:19:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.920+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 >> 172.21.15.32:0/1269471690 conn(0x7f9c3006bd70 msgr2=0x7f9c3015ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:57.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.921+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 shutdown_connections 2023-10-14T12:19:57.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:57.921+0000 7f9c348d7700 1 -- 172.21.15.32:0/1269471690 wait complete. 2023-10-14T12:19:57.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T12:19:58.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.058+0000 7f1fc6a1b700 1 Processor -- start 2023-10-14T12:19:58.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.058+0000 7f1fc6a1b700 1 -- start start 2023-10-14T12:19:58.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fc6a1b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1fc00cbc40 0x7f1fc00b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fc6a1b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00ce3b0 con 0x7f1fc015a850 2023-10-14T12:19:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fc6a1b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00b6290 con 0x7f1fc00cd4b0 2023-10-14T12:19:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fc6a1b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc00cc220 con 0x7f1fc00cbc40 2023-10-14T12:19:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1fc015a850 0x7f1fc00ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57350/0 (socket says 172.21.15.32:57350) 2023-10-14T12:19:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbffff700 1 -- 172.21.15.32:0/3482254287 learned_addr learned my addr 172.21.15.32:0/3482254287 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:19:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fc4fb8700 1 --2- 172.21.15.32:0/3482254287 >> v2:172.21.15.92:3300/0 conn(0x7f1fc00cbc40 0x7f1fc00b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616014591 0 0) 0x7f1fc00ce3b0 con 0x7f1fc015a850 2023-10-14T12:19:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fac0035b0 con 0x7f1fc015a850 2023-10-14T12:19:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234030378 0 0) 0x7f1fac0035b0 con 0x7f1fc015a850 2023-10-14T12:19:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 >> v2:172.21.15.92:3300/0 conn(0x7f1fc00cbc40 msgr2=0x7f1fc00b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 --2- 172.21.15.32:0/3482254287 >> v2:172.21.15.92:3300/0 conn(0x7f1fc00cbc40 0x7f1fc00b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 >> v1:172.21.15.92:6789/0 conn(0x7f1fc00cd4b0 legacy=0x7f1fc00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00cc500 con 0x7f1fc015a850 2023-10-14T12:19:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f1fa8001670 con 0x7f1fc015a850 2023-10-14T12:19:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.059+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 >> v1:172.21.15.32:6789/0 conn(0x7f1fc015a850 legacy=0x7f1fc00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fac003a00 0x7f1fac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fac004850 0x7f1fac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac005210 0x7f1fac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00cc220 con 0x7f1fac003a00 2023-10-14T12:19:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac00c1b0 con 0x7f1fac005210 2023-10-14T12:19:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac00c370 con 0x7f1fac004850 2023-10-14T12:19:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fac003a00 0x7f1fac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fc4fb8700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac005210 0x7f1fac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbf7fe700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fac004850 0x7f1fac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 -- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fac004850 msgr2=0x7f1fac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fac004850 0x7f1fac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 -- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac005210 msgr2=0x7f1fac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac005210 0x7f1fac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 -- 172.21.15.32:0/3482254287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0035b0 con 0x7f1fac003a00 2023-10-14T12:19:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbf7fe700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fac004850 0x7f1fac004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fc4fb8700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac005210 0x7f1fac00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fc4fb8700 1 -- 172.21.15.32:0/3482254287 reap_dead start 2023-10-14T12:19:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fac003a00 0x7f1fac003e20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c240 tx=0x7f1fac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0da0e9cb4bb2d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:58.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8007c10 con 0x7f1fac003a00 2023-10-14T12:19:58.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa800cde0 con 0x7f1fac003a00 2023-10-14T12:19:58.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.060+0000 7f1fbeffd700 1 -- 172.21.15.32:0/3482254287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8005ba0 con 0x7f1fac003a00 2023-10-14T12:19:58.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3482254287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fac003a00 msgr2=0x7f1fac003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fac003a00 0x7f1fac003e20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c240 tx=0x7f1fac005880 comp rx=0 tx=0).stop 2023-10-14T12:19:58.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3482254287 shutdown_connections 2023-10-14T12:19:58.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3482254287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fac003a00 0x7f1fac003e20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3482254287 >> 172.21.15.32:0/3482254287 conn(0x7f1fc006dac0 msgr2=0x7f1fc006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:58.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3482254287 shutdown_connections 2023-10-14T12:19:58.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.061+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3482254287 wait complete. 2023-10-14T12:19:58.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.062+0000 7f1fc6a1b700 1 Processor -- start 2023-10-14T12:19:58.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.063+0000 7f1fc6a1b700 1 -- start start 2023-10-14T12:19:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.063+0000 7f1fc6a1b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac003a00 0x7f1fc00b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.063+0000 7f1fc6a1b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 0x7f1fc00c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc6a1b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fc00c9ed0 0x7f1fc00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc6a1b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c8980 con 0x7f1fc0157570 2023-10-14T12:19:58.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc6a1b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc01579f0 con 0x7f1fac003a00 2023-10-14T12:19:58.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc6a1b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c8e70 con 0x7f1fc00c9ed0 2023-10-14T12:19:58.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 0x7f1fc00c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 0x7f1fc00c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40338/0 (socket says 172.21.15.32:40338) 2023-10-14T12:19:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 -- 172.21.15.32:0/3838615818 learned_addr learned my addr 172.21.15.32:0/3838615818 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac003a00 0x7f1fc00b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc4fb8700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fc00c9ed0 0x7f1fc00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 -- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fc00c9ed0 msgr2=0x7f1fc00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fc00c9ed0 0x7f1fc00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 -- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac003a00 msgr2=0x7f1fc00b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac003a00 0x7f1fc00b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 -- 172.21.15.32:0/3838615818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00c9110 con 0x7f1fc0157570 2023-10-14T12:19:58.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc4fb8700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fc00c9ed0 0x7f1fc00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:58.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac003a00 0x7f1fc00b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:58.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbf7fe700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 0x7f1fc00c8440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000e460 tx=0x7f1fb000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:58.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00052e0 con 0x7f1fc0157570 2023-10-14T12:19:58.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb0005440 con 0x7f1fc0157570 2023-10-14T12:19:58.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00038c0 con 0x7f1fc0157570 2023-10-14T12:19:58.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc00c93f0 con 0x7f1fc0157570 2023-10-14T12:19:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.064+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc00c99b0 con 0x7f1fc0157570 2023-10-14T12:19:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.065+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc00c9d20 con 0x7f1fc0157570 2023-10-14T12:19:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.066+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1fb0003a20 con 0x7f1fc0157570 2023-10-14T12:19:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.066+0000 7f1fbcff9700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1fa006af00 0x7f1fa006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.066+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1fb0088940 con 0x7f1fc0157570 2023-10-14T12:19:58.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.066+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1fa006af00 0x7f1fa006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.067+0000 7f1fbffff700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1fa006af00 0x7f1fa006d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000c00 tx=0x7f1fa8007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.071+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fb0053a60 con 0x7f1fc0157570 2023-10-14T12:19:58.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.271+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fc00ccac0 con 0x7f1fa006af00 2023-10-14T12:19:58.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.271+0000 7f1fbcff9700 1 -- 172.21.15.32:0/3838615818 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1fa8007b30 con 0x7f1fa006af00 2023-10-14T12:19:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1fa006af00 msgr2=0x7f1fa006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1fa006af00 0x7f1fa006d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000c00 tx=0x7f1fa8007000 comp rx=0 tx=0).stop 2023-10-14T12:19:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 msgr2=0x7f1fc00c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 0x7f1fc00c8440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000e460 tx=0x7f1fb000e820 comp rx=0 tx=0).stop 2023-10-14T12:19:58.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 shutdown_connections 2023-10-14T12:19:58.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fc00c9ed0 0x7f1fc00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f1fa006af00 0x7f1fa006d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac003a00 0x7f1fc00b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 --2- 172.21.15.32:0/3838615818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fc0157570 0x7f1fc00c8440 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 >> 172.21.15.32:0/3838615818 conn(0x7f1fc006dac0 msgr2=0x7f1fc01597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 shutdown_connections 2023-10-14T12:19:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.274+0000 7f1fc6a1b700 1 -- 172.21.15.32:0/3838615818 wait complete. 2023-10-14T12:19:58.280 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T12:19:58.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:19:58.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.412+0000 7f30603dc700 1 Processor -- start 2023-10-14T12:19:58.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.412+0000 7f30603dc700 1 -- start start 2023-10-14T12:19:58.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f30603dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 0x7f305815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f30603dc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30580cede0 0x7f305815f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f30603dc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580cf260 con 0x7f305806a840 2023-10-14T12:19:58.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f30603dc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30581619a0 con 0x7f30580cede0 2023-10-14T12:19:58.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f30603dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b2d60 con 0x7f30580cd950 2023-10-14T12:19:58.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 0x7f305815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305d977700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30580cede0 0x7f305815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 0x7f305815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:46036/0 (socket says 172.21.15.32:46036) 2023-10-14T12:19:58.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 -- 172.21.15.32:0/3331261477 learned_addr learned my addr 172.21.15.32:0/3331261477 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:58.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e979700 1 --1- 172.21.15.32:0/3331261477 >> v1:172.21.15.92:6789/0 conn(0x7f305806a840 0x7f3058161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:56248/0 (socket says 172.21.15.32:56248) 2023-10-14T12:19:58.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 -- 172.21.15.32:0/3331261477 >> v2:172.21.15.92:3300/0 conn(0x7f30580cede0 msgr2=0x7f305815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:19:58.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 --2- 172.21.15.32:0/3331261477 >> v2:172.21.15.92:3300/0 conn(0x7f30580cede0 0x7f305815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 -- 172.21.15.32:0/3331261477 >> v1:172.21.15.92:6789/0 conn(0x7f305806a840 legacy=0x7f3058161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.413+0000 7f305e178700 1 -- 172.21.15.32:0/3331261477 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580cdd30 con 0x7f30580cd950 2023-10-14T12:19:58.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f305e178700 1 --2- 172.21.15.32:0/3331261477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 0x7f305815e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30540098f0 tx=0x7f3054009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8469c424e5f3b36a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:58.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f305d176700 1 -- 172.21.15.32:0/3331261477 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054011830 con 0x7f30580cd950 2023-10-14T12:19:58.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f305d176700 1 -- 172.21.15.32:0/3331261477 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054011990 con 0x7f30580cd950 2023-10-14T12:19:58.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f305d176700 1 -- 172.21.15.32:0/3331261477 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054011d20 con 0x7f30580cd950 2023-10-14T12:19:58.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 -- 172.21.15.32:0/3331261477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 msgr2=0x7f305815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 --2- 172.21.15.32:0/3331261477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 0x7f305815e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30540098f0 tx=0x7f3054009c00 comp rx=0 tx=0).stop 2023-10-14T12:19:58.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 -- 172.21.15.32:0/3331261477 shutdown_connections 2023-10-14T12:19:58.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 --2- 172.21.15.32:0/3331261477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30580cd950 0x7f305815e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 --2- 172.21.15.32:0/3331261477 >> v2:172.21.15.92:3300/0 conn(0x7f30580cede0 0x7f305815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 -- 172.21.15.32:0/3331261477 >> 172.21.15.32:0/3331261477 conn(0x7f305806dae0 msgr2=0x7f305806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:58.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 -- 172.21.15.32:0/3331261477 shutdown_connections 2023-10-14T12:19:58.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.414+0000 7f30603dc700 1 -- 172.21.15.32:0/3331261477 wait complete. 2023-10-14T12:19:58.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 Processor -- start 2023-10-14T12:19:58.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 -- start start 2023-10-14T12:19:58.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f305806a840 0x7f305815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30580cd950 0x7f30580b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 0x7f30580c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c8a30 con 0x7f30580cede0 2023-10-14T12:19:58.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c8c80 con 0x7f30580cd950 2023-10-14T12:19:58.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.416+0000 7f30603dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c8f60 con 0x7f305806a840 2023-10-14T12:19:58.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 0x7f30580c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 0x7f30580c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40354/0 (socket says 172.21.15.32:40354) 2023-10-14T12:19:58.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 -- 172.21.15.32:0/1287727187 learned_addr learned my addr 172.21.15.32:0/1287727187 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:19:58.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305d977700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30580cd950 0x7f30580b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e178700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f305806a840 0x7f305815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 -- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f305806a840 msgr2=0x7f305815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f305806a840 0x7f305815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 -- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30580cd950 msgr2=0x7f30580b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30580cd950 0x7f30580b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 -- 172.21.15.32:0/1287727187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054009550 con 0x7f30580cede0 2023-10-14T12:19:58.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305d977700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30580cd950 0x7f30580b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:19:58.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f305e979700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 0x7f30580c61d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f305000cbc0 tx=0x7f305000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:58.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000ab50 con 0x7f30580cede0 2023-10-14T12:19:58.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000acb0 con 0x7f30580cede0 2023-10-14T12:19:58.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30580c9240 con 0x7f30580cede0 2023-10-14T12:19:58.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050007270 con 0x7f30580cede0 2023-10-14T12:19:58.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.417+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30580b35c0 con 0x7f30580cede0 2023-10-14T12:19:58.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.418+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580c9760 con 0x7f30580cede0 2023-10-14T12:19:58.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.419+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f30500073d0 con 0x7f30580cede0 2023-10-14T12:19:58.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.419+0000 7f304effd700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:19:58.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.419+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f30500891f0 con 0x7f30580cede0 2023-10-14T12:19:58.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.419+0000 7f305e178700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:19:58.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.420+0000 7f305e178700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f303c06af00 0x7f303c06d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3054009c40 tx=0x7f3054008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:19:58.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.424+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30580c9760 con 0x7f30580cede0 2023-10-14T12:19:58.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.620+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30580c8df0 con 0x7f303c06af00 2023-10-14T12:19:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.628+0000 7f304effd700 1 -- 172.21.15.32:0/1287727187 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287993 (secure 0 0 0) 0x7f30580c8df0 con 0x7f303c06af00 2023-10-14T12:19:58.633 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:19:58.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f303c06af00 msgr2=0x7f303c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f303c06af00 0x7f303c06d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3054009c40 tx=0x7f3054008030 comp rx=0 tx=0).stop 2023-10-14T12:19:58.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 msgr2=0x7f30580c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:19:58.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 0x7f30580c61d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f305000cbc0 tx=0x7f305000cf80 comp rx=0 tx=0).stop 2023-10-14T12:19:58.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 shutdown_connections 2023-10-14T12:19:58.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30580cede0 0x7f30580c61d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f305806a840 0x7f305815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 --2- 172.21.15.32:0/1287727187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30580cd950 0x7f30580b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:19:58.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.631+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 >> 172.21.15.32:0/1287727187 conn(0x7f305806dae0 msgr2=0x7f30580ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:19:58.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.632+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 shutdown_connections 2023-10-14T12:19:58.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:19:58.632+0000 7f30603dc700 1 -- 172.21.15.32:0/1287727187 wait complete. 2023-10-14T12:19:58.639 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:19:58.645 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-14T12:19:57.113370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224368,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750352,"statfs":{"total":773094113280,"available":772864360448,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002896"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451175+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:45.451175+0000","last_peered":"2023-10-14T12:19:45.451175+0000","last_clean":"2023-10-14T12:19:45.451175+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:45.451175+0000","last_undegraded":"2023-10-14T12:19:45.451175+0000","last_fullsized":"2023-10-14T12:19:45.451175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:27.468407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374519+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:44.374519+0000","last_peered":"2023-10-14T12:19:44.374519+0000","last_clean":"2023-10-14T12:19:44.374519+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:44.374519+0000","last_undegraded":"2023-10-14T12:19:44.374519+0000","last_fullsized":"2023-10-14T12:19:44.374519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374280+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:44.374280+0000","last_peered":"2023-10-14T12:19:44.374280+0000","last_clean":"2023-10-14T12:19:44.374280+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:44.374280+0000","last_undegraded":"2023-10-14T12:19:44.374280+0000","last_fullsized":"2023-10-14T12:19:44.374280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452136+0000","last_change":"2023-10-14T12:19:43.390887+0000","last_active":"2023-10-14T12:19:45.452136+0000","last_peered":"2023-10-14T12:19:45.452136+0000","last_clean":"2023-10-14T12:19:45.452136+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:19:45.452136+0000","last_undegraded":"2023-10-14T12:19:45.452136+0000","last_fullsized":"2023-10-14T12:19:45.452136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370444+0000","last_change":"2023-10-14T12:19:43.379488+0000","last_active":"2023-10-14T12:19:44.370444+0000","last_peered":"2023-10-14T12:19:44.370444+0000","last_clean":"2023-10-14T12:19:44.370444+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:19:44.370444+0000","last_undegraded":"2023-10-14T12:19:44.370444+0000","last_fullsized":"2023-10-14T12:19:44.370444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:05.715151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374228+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:44.374228+0000","last_peered":"2023-10-14T12:19:44.374228+0000","last_clean":"2023-10-14T12:19:44.374228+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:44.374228+0000","last_undegraded":"2023-10-14T12:19:44.374228+0000","last_fullsized":"2023-10-14T12:19:44.374228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950553+0000","last_change":"2023-10-14T12:19:43.381841+0000","last_active":"2023-10-14T12:19:44.950553+0000","last_peered":"2023-10-14T12:19:44.950553+0000","last_clean":"2023-10-14T12:19:44.950553+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:19:44.950553+0000","last_undegraded":"2023-10-14T12:19:44.950553+0000","last_fullsized":"2023-10-14T12:19:44.950553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:41.694012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950418+0000","last_change":"2023-10-14T12:19:43.382639+0000","last_active":"2023-10-14T12:19:44.950418+0000","last_peered":"2023-10-14T12:19:44.950418+0000","last_clean":"2023-10-14T12:19:44.950418+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:19:44.950418+0000","last_undegraded":"2023-10-14T12:19:44.950418+0000","last_fullsized":"2023-10-14T12:19:44.950418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.244563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452065+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:45.452065+0000","last_peered":"2023-10-14T12:19:45.452065+0000","last_clean":"2023-10-14T12:19:45.452065+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:45.452065+0000","last_undegraded":"2023-10-14T12:19:45.452065+0000","last_fullsized":"2023-10-14T12:19:45.452065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:12.758822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452582+0000","last_change":"2023-10-14T12:19:43.382683+0000","last_active":"2023-10-14T12:19:45.452582+0000","last_peered":"2023-10-14T12:19:45.452582+0000","last_clean":"2023-10-14T12:19:45.452582+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:19:45.452582+0000","last_undegraded":"2023-10-14T12:19:45.452582+0000","last_fullsized":"2023-10-14T12:19:45.452582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950759+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:44.950759+0000","last_peered":"2023-10-14T12:19:44.950759+0000","last_clean":"2023-10-14T12:19:44.950759+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:44.950759+0000","last_undegraded":"2023-10-14T12:19:44.950759+0000","last_fullsized":"2023-10-14T12:19:44.950759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374556+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:44.374556+0000","last_peered":"2023-10-14T12:19:44.374556+0000","last_clean":"2023-10-14T12:19:44.374556+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:44.374556+0000","last_undegraded":"2023-10-14T12:19:44.374556+0000","last_fullsized":"2023-10-14T12:19:44.374556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370587+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:44.370587+0000","last_peered":"2023-10-14T12:19:44.370587+0000","last_clean":"2023-10-14T12:19:44.370587+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:44.370587+0000","last_undegraded":"2023-10-14T12:19:44.370587+0000","last_fullsized":"2023-10-14T12:19:44.370587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:16.117843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374251+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:44.374251+0000","last_peered":"2023-10-14T12:19:44.374251+0000","last_clean":"2023-10-14T12:19:44.374251+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:44.374251+0000","last_undegraded":"2023-10-14T12:19:44.374251+0000","last_fullsized":"2023-10-14T12:19:44.374251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374071+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:44.374071+0000","last_peered":"2023-10-14T12:19:44.374071+0000","last_clean":"2023-10-14T12:19:44.374071+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:44.374071+0000","last_undegraded":"2023-10-14T12:19:44.374071+0000","last_fullsized":"2023-10-14T12:19:44.374071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950717+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:44.950717+0000","last_peered":"2023-10-14T12:19:44.950717+0000","last_clean":"2023-10-14T12:19:44.950717+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:44.950717+0000","last_undegraded":"2023-10-14T12:19:44.950717+0000","last_fullsized":"2023-10-14T12:19:44.950717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.951014+0000","last_change":"2023-10-14T12:19:43.381288+0000","last_active":"2023-10-14T12:19:44.951014+0000","last_peered":"2023-10-14T12:19:44.951014+0000","last_clean":"2023-10-14T12:19:44.951014+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:19:44.951014+0000","last_undegraded":"2023-10-14T12:19:44.951014+0000","last_fullsized":"2023-10-14T12:19:44.951014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374498+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:44.374498+0000","last_peered":"2023-10-14T12:19:44.374498+0000","last_clean":"2023-10-14T12:19:44.374498+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:44.374498+0000","last_undegraded":"2023-10-14T12:19:44.374498+0000","last_fullsized":"2023-10-14T12:19:44.374498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:02.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374414+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:44.374414+0000","last_peered":"2023-10-14T12:19:44.374414+0000","last_clean":"2023-10-14T12:19:44.374414+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:44.374414+0000","last_undegraded":"2023-10-14T12:19:44.374414+0000","last_fullsized":"2023-10-14T12:19:44.374414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370717+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:44.370717+0000","last_peered":"2023-10-14T12:19:44.370717+0000","last_clean":"2023-10-14T12:19:44.370717+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:44.370717+0000","last_undegraded":"2023-10-14T12:19:44.370717+0000","last_fullsized":"2023-10-14T12:19:44.370717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:18.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451563+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:45.451563+0000","last_peered":"2023-10-14T12:19:45.451563+0000","last_clean":"2023-10-14T12:19:45.451563+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:45.451563+0000","last_undegraded":"2023-10-14T12:19:45.451563+0000","last_fullsized":"2023-10-14T12:19:45.451563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:14:56.582389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451538+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:45.451538+0000","last_peered":"2023-10-14T12:19:45.451538+0000","last_clean":"2023-10-14T12:19:45.451538+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:45.451538+0000","last_undegraded":"2023-10-14T12:19:45.451538+0000","last_fullsized":"2023-10-14T12:19:45.451538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:35.985448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451530+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:45.451530+0000","last_peered":"2023-10-14T12:19:45.451530+0000","last_clean":"2023-10-14T12:19:45.451530+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:19:45.451530+0000","last_undegraded":"2023-10-14T12:19:45.451530+0000","last_fullsized":"2023-10-14T12:19:45.451530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374009+0000","last_change":"2023-10-14T12:19:43.381941+0000","last_active":"2023-10-14T12:19:44.374009+0000","last_peered":"2023-10-14T12:19:44.374009+0000","last_clean":"2023-10-14T12:19:44.374009+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:19:44.374009+0000","last_undegraded":"2023-10-14T12:19:44.374009+0000","last_fullsized":"2023-10-14T12:19:44.374009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452614+0000","last_change":"2023-10-14T12:19:43.382954+0000","last_active":"2023-10-14T12:19:45.452614+0000","last_peered":"2023-10-14T12:19:45.452614+0000","last_clean":"2023-10-14T12:19:45.452614+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:19:45.452614+0000","last_undegraded":"2023-10-14T12:19:45.452614+0000","last_fullsized":"2023-10-14T12:19:45.452614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374673+0000","last_change":"2023-10-14T12:19:43.380761+0000","last_active":"2023-10-14T12:19:44.374673+0000","last_peered":"2023-10-14T12:19:44.374673+0000","last_clean":"2023-10-14T12:19:44.374673+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:44.374673+0000","last_undegraded":"2023-10-14T12:19:44.374673+0000","last_fullsized":"2023-10-14T12:19:44.374673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:17.111399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452281+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:45.452281+0000","last_peered":"2023-10-14T12:19:45.452281+0000","last_clean":"2023-10-14T12:19:45.452281+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:45.452281+0000","last_undegraded":"2023-10-14T12:19:45.452281+0000","last_fullsized":"2023-10-14T12:19:45.452281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374585+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:44.374585+0000","last_peered":"2023-10-14T12:19:44.374585+0000","last_clean":"2023-10-14T12:19:44.374585+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:44.374585+0000","last_undegraded":"2023-10-14T12:19:44.374585+0000","last_fullsized":"2023-10-14T12:19:44.374585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:02.016613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451575+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:45.451575+0000","last_peered":"2023-10-14T12:19:45.451575+0000","last_clean":"2023-10-14T12:19:45.451575+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:45.451575+0000","last_undegraded":"2023-10-14T12:19:45.451575+0000","last_fullsized":"2023-10-14T12:19:45.451575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:38.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950548+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:44.950548+0000","last_peered":"2023-10-14T12:19:44.950548+0000","last_clean":"2023-10-14T12:19:44.950548+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:44.950548+0000","last_undegraded":"2023-10-14T12:19:44.950548+0000","last_fullsized":"2023-10-14T12:19:44.950548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:22.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451213+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:45.451213+0000","last_peered":"2023-10-14T12:19:45.451213+0000","last_clean":"2023-10-14T12:19:45.451213+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:45.451213+0000","last_undegraded":"2023-10-14T12:19:45.451213+0000","last_fullsized":"2023-10-14T12:19:45.451213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:25.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950873+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:44.950873+0000","last_peered":"2023-10-14T12:19:44.950873+0000","last_clean":"2023-10-14T12:19:44.950873+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:44.950873+0000","last_undegraded":"2023-10-14T12:19:44.950873+0000","last_fullsized":"2023-10-14T12:19:44.950873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451564+0000","last_change":"2023-10-14T12:19:43.393781+0000","last_active":"2023-10-14T12:19:45.451564+0000","last_peered":"2023-10-14T12:19:45.451564+0000","last_clean":"2023-10-14T12:19:45.451564+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:19:45.451564+0000","last_undegraded":"2023-10-14T12:19:45.451564+0000","last_fullsized":"2023-10-14T12:19:45.451564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179754+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:45.179754+0000","last_peered":"2023-10-14T12:19:45.179754+0000","last_clean":"2023-10-14T12:19:45.179754+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:45.179754+0000","last_undegraded":"2023-10-14T12:19:45.179754+0000","last_fullsized":"2023-10-14T12:19:45.179754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:28:14.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451254+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:45.451254+0000","last_peered":"2023-10-14T12:19:45.451254+0000","last_clean":"2023-10-14T12:19:45.451254+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:45.451254+0000","last_undegraded":"2023-10-14T12:19:45.451254+0000","last_fullsized":"2023-10-14T12:19:45.451254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451567+0000","last_change":"2023-10-14T12:19:42.374484+0000","last_active":"2023-10-14T12:19:45.451567+0000","last_peered":"2023-10-14T12:19:45.451567+0000","last_clean":"2023-10-14T12:19:45.451567+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:19:45.451567+0000","last_undegraded":"2023-10-14T12:19:45.451567+0000","last_fullsized":"2023-10-14T12:19:45.451567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451711+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:45.451711+0000","last_peered":"2023-10-14T12:19:45.451711+0000","last_clean":"2023-10-14T12:19:45.451711+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:45.451711+0000","last_undegraded":"2023-10-14T12:19:45.451711+0000","last_fullsized":"2023-10-14T12:19:45.451711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:08.135041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374493+0000","last_change":"2023-10-14T12:19:42.374263+0000","last_active":"2023-10-14T12:19:44.374493+0000","last_peered":"2023-10-14T12:19:44.374493+0000","last_clean":"2023-10-14T12:19:44.374493+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:19:44.374493+0000","last_undegraded":"2023-10-14T12:19:44.374493+0000","last_fullsized":"2023-10-14T12:19:44.374493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:59.390912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452334+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:45.452334+0000","last_peered":"2023-10-14T12:19:45.452334+0000","last_clean":"2023-10-14T12:19:45.452334+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:45.452334+0000","last_undegraded":"2023-10-14T12:19:45.452334+0000","last_fullsized":"2023-10-14T12:19:45.452334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370652+0000","last_change":"2023-10-14T12:19:42.377643+0000","last_active":"2023-10-14T12:19:44.370652+0000","last_peered":"2023-10-14T12:19:44.370652+0000","last_clean":"2023-10-14T12:19:44.370652+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:44.370652+0000","last_undegraded":"2023-10-14T12:19:44.370652+0000","last_fullsized":"2023-10-14T12:19:44.370652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:00.046955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950565+0000","last_change":"2023-10-14T12:19:43.389426+0000","last_active":"2023-10-14T12:19:44.950565+0000","last_peered":"2023-10-14T12:19:44.950565+0000","last_clean":"2023-10-14T12:19:44.950565+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:19:44.950565+0000","last_undegraded":"2023-10-14T12:19:44.950565+0000","last_fullsized":"2023-10-14T12:19:44.950565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:52.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179883+0000","last_change":"2023-10-14T12:19:42.375646+0000","last_active":"2023-10-14T12:19:45.179883+0000","last_peered":"2023-10-14T12:19:45.179883+0000","last_clean":"2023-10-14T12:19:45.179883+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:19:45.179883+0000","last_undegraded":"2023-10-14T12:19:45.179883+0000","last_fullsized":"2023-10-14T12:19:45.179883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374300+0000","last_change":"2023-10-14T12:19:43.390502+0000","last_active":"2023-10-14T12:19:44.374300+0000","last_peered":"2023-10-14T12:19:44.374300+0000","last_clean":"2023-10-14T12:19:44.374300+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:19:44.374300+0000","last_undegraded":"2023-10-14T12:19:44.374300+0000","last_fullsized":"2023-10-14T12:19:44.374300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179837+0000","last_change":"2023-10-14T12:19:42.375014+0000","last_active":"2023-10-14T12:19:45.179837+0000","last_peered":"2023-10-14T12:19:45.179837+0000","last_clean":"2023-10-14T12:19:45.179837+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:19:45.179837+0000","last_undegraded":"2023-10-14T12:19:45.179837+0000","last_fullsized":"2023-10-14T12:19:45.179837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:36.593916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451210+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:45.451210+0000","last_peered":"2023-10-14T12:19:45.451210+0000","last_clean":"2023-10-14T12:19:45.451210+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:45.451210+0000","last_undegraded":"2023-10-14T12:19:45.451210+0000","last_fullsized":"2023-10-14T12:19:45.451210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373966+0000","last_change":"2023-10-14T12:19:42.373819+0000","last_active":"2023-10-14T12:19:44.373966+0000","last_peered":"2023-10-14T12:19:44.373966+0000","last_clean":"2023-10-14T12:19:44.373966+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:19:44.373966+0000","last_undegraded":"2023-10-14T12:19:44.373966+0000","last_fullsized":"2023-10-14T12:19:44.373966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451371+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:45.451371+0000","last_peered":"2023-10-14T12:19:45.451371+0000","last_clean":"2023-10-14T12:19:45.451371+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:45.451371+0000","last_undegraded":"2023-10-14T12:19:45.451371+0000","last_fullsized":"2023-10-14T12:19:45.451371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179741+0000","last_change":"2023-10-14T12:19:42.372089+0000","last_active":"2023-10-14T12:19:45.179741+0000","last_peered":"2023-10-14T12:19:45.179741+0000","last_clean":"2023-10-14T12:19:45.179741+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:19:45.179741+0000","last_undegraded":"2023-10-14T12:19:45.179741+0000","last_fullsized":"2023-10-14T12:19:45.179741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:22.438051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374586+0000","last_change":"2023-10-14T12:19:43.382324+0000","last_active":"2023-10-14T12:19:44.374586+0000","last_peered":"2023-10-14T12:19:44.374586+0000","last_clean":"2023-10-14T12:19:44.374586+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:19:44.374586+0000","last_undegraded":"2023-10-14T12:19:44.374586+0000","last_fullsized":"2023-10-14T12:19:44.374586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374708+0000","last_change":"2023-10-14T12:19:42.372382+0000","last_active":"2023-10-14T12:19:44.374708+0000","last_peered":"2023-10-14T12:19:44.374708+0000","last_clean":"2023-10-14T12:19:44.374708+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:19:44.374708+0000","last_undegraded":"2023-10-14T12:19:44.374708+0000","last_fullsized":"2023-10-14T12:19:44.374708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374844+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:44.374844+0000","last_peered":"2023-10-14T12:19:44.374844+0000","last_clean":"2023-10-14T12:19:44.374844+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:44.374844+0000","last_undegraded":"2023-10-14T12:19:44.374844+0000","last_fullsized":"2023-10-14T12:19:44.374844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:47:38.320770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451685+0000","last_change":"2023-10-14T12:19:42.376458+0000","last_active":"2023-10-14T12:19:45.451685+0000","last_peered":"2023-10-14T12:19:45.451685+0000","last_clean":"2023-10-14T12:19:45.451685+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:19:45.451685+0000","last_undegraded":"2023-10-14T12:19:45.451685+0000","last_fullsized":"2023-10-14T12:19:45.451685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374529+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:44.374529+0000","last_peered":"2023-10-14T12:19:44.374529+0000","last_clean":"2023-10-14T12:19:44.374529+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:44.374529+0000","last_undegraded":"2023-10-14T12:19:44.374529+0000","last_fullsized":"2023-10-14T12:19:44.374529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:38.603649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374572+0000","last_change":"2023-10-14T12:19:42.373797+0000","last_active":"2023-10-14T12:19:44.374572+0000","last_peered":"2023-10-14T12:19:44.374572+0000","last_clean":"2023-10-14T12:19:44.374572+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:19:44.374572+0000","last_undegraded":"2023-10-14T12:19:44.374572+0000","last_fullsized":"2023-10-14T12:19:44.374572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:21.195047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374459+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:44.374459+0000","last_peered":"2023-10-14T12:19:44.374459+0000","last_clean":"2023-10-14T12:19:44.374459+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:44.374459+0000","last_undegraded":"2023-10-14T12:19:44.374459+0000","last_fullsized":"2023-10-14T12:19:44.374459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374488+0000","last_change":"2023-10-14T12:19:42.371158+0000","last_active":"2023-10-14T12:19:44.374488+0000","last_peered":"2023-10-14T12:19:44.374488+0000","last_clean":"2023-10-14T12:19:44.374488+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:19:44.374488+0000","last_undegraded":"2023-10-14T12:19:44.374488+0000","last_fullsized":"2023-10-14T12:19:44.374488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:24.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451683+0000","last_change":"2023-10-14T12:19:43.380181+0000","last_active":"2023-10-14T12:19:45.451683+0000","last_peered":"2023-10-14T12:19:45.451683+0000","last_clean":"2023-10-14T12:19:45.451683+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:19:45.451683+0000","last_undegraded":"2023-10-14T12:19:45.451683+0000","last_fullsized":"2023-10-14T12:19:45.451683+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179895+0000","last_change":"2023-10-14T12:19:42.373775+0000","last_active":"2023-10-14T12:19:45.179895+0000","last_peered":"2023-10-14T12:19:45.179895+0000","last_clean":"2023-10-14T12:19:45.179895+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:19:45.179895+0000","last_undegraded":"2023-10-14T12:19:45.179895+0000","last_fullsized":"2023-10-14T12:19:45.179895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:26.463081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374439+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:44.374439+0000","last_peered":"2023-10-14T12:19:44.374439+0000","last_clean":"2023-10-14T12:19:44.374439+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:44.374439+0000","last_undegraded":"2023-10-14T12:19:44.374439+0000","last_fullsized":"2023-10-14T12:19:44.374439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451436+0000","last_change":"2023-10-14T12:19:42.373838+0000","last_active":"2023-10-14T12:19:45.451436+0000","last_peered":"2023-10-14T12:19:45.451436+0000","last_clean":"2023-10-14T12:19:45.451436+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:19:45.451436+0000","last_undegraded":"2023-10-14T12:19:45.451436+0000","last_fullsized":"2023-10-14T12:19:45.451436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950851+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:44.950851+0000","last_peered":"2023-10-14T12:19:44.950851+0000","last_clean":"2023-10-14T12:19:44.950851+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:44.950851+0000","last_undegraded":"2023-10-14T12:19:44.950851+0000","last_fullsized":"2023-10-14T12:19:44.950851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:23.757108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374044+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:44.374044+0000","last_peered":"2023-10-14T12:19:44.374044+0000","last_clean":"2023-10-14T12:19:44.374044+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:44.374044+0000","last_undegraded":"2023-10-14T12:19:44.374044+0000","last_fullsized":"2023-10-14T12:19:44.374044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:30.520521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451127+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:45.451127+0000","last_peered":"2023-10-14T12:19:45.451127+0000","last_clean":"2023-10-14T12:19:45.451127+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:45.451127+0000","last_undegraded":"2023-10-14T12:19:45.451127+0000","last_fullsized":"2023-10-14T12:19:45.451127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:31.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374022+0000","last_change":"2023-10-14T12:19:42.373204+0000","last_active":"2023-10-14T12:19:44.374022+0000","last_peered":"2023-10-14T12:19:44.374022+0000","last_clean":"2023-10-14T12:19:44.374022+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:19:44.374022+0000","last_undegraded":"2023-10-14T12:19:44.374022+0000","last_fullsized":"2023-10-14T12:19:44.374022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:40.688686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451830+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:45.451830+0000","last_peered":"2023-10-14T12:19:45.451830+0000","last_clean":"2023-10-14T12:19:45.451830+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:45.451830+0000","last_undegraded":"2023-10-14T12:19:45.451830+0000","last_fullsized":"2023-10-14T12:19:45.451830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:57.685224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452698+0000","last_change":"2023-10-14T12:19:42.376646+0000","last_active":"2023-10-14T12:19:45.452698+0000","last_peered":"2023-10-14T12:19:45.452698+0000","last_clean":"2023-10-14T12:19:45.452698+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:19:45.452698+0000","last_undegraded":"2023-10-14T12:19:45.452698+0000","last_fullsized":"2023-10-14T12:19:45.452698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374521+0000","last_change":"2023-10-14T12:19:43.388112+0000","last_active":"2023-10-14T12:19:44.374521+0000","last_peered":"2023-10-14T12:19:44.374521+0000","last_clean":"2023-10-14T12:19:44.374521+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:19:44.374521+0000","last_undegraded":"2023-10-14T12:19:44.374521+0000","last_fullsized":"2023-10-14T12:19:44.374521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:04.837973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179959+0000","last_change":"2023-10-14T12:19:42.373858+0000","last_active":"2023-10-14T12:19:45.179959+0000","last_peered":"2023-10-14T12:19:45.179959+0000","last_clean":"2023-10-14T12:19:45.179959+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:19:45.179959+0000","last_undegraded":"2023-10-14T12:19:45.179959+0000","last_fullsized":"2023-10-14T12:19:45.179959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:48.804179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452087+0000","last_change":"2023-10-14T12:19:43.388334+0000","last_active":"2023-10-14T12:19:45.452087+0000","last_peered":"2023-10-14T12:19:45.452087+0000","last_clean":"2023-10-14T12:19:45.452087+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:19:45.452087+0000","last_undegraded":"2023-10-14T12:19:45.452087+0000","last_fullsized":"2023-10-14T12:19:45.452087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179931+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:45.179931+0000","last_peered":"2023-10-14T12:19:45.179931+0000","last_clean":"2023-10-14T12:19:45.179931+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:45.179931+0000","last_undegraded":"2023-10-14T12:19:45.179931+0000","last_fullsized":"2023-10-14T12:19:45.179931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:12.099355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370543+0000","last_change":"2023-10-14T12:19:43.384205+0000","last_active":"2023-10-14T12:19:44.370543+0000","last_peered":"2023-10-14T12:19:44.370543+0000","last_clean":"2023-10-14T12:19:44.370543+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:19:44.370543+0000","last_undegraded":"2023-10-14T12:19:44.370543+0000","last_fullsized":"2023-10-14T12:19:44.370543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:37.599241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179917+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:45.179917+0000","last_peered":"2023-10-14T12:19:45.179917+0000","last_clean":"2023-10-14T12:19:45.179917+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:45.179917+0000","last_undegraded":"2023-10-14T12:19:45.179917+0000","last_fullsized":"2023-10-14T12:19:45.179917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:19.606346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370619+0000","last_change":"2023-10-14T12:19:43.388769+0000","last_active":"2023-10-14T12:19:44.370619+0000","last_peered":"2023-10-14T12:19:44.370619+0000","last_clean":"2023-10-14T12:19:44.370619+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:19:44.370619+0000","last_undegraded":"2023-10-14T12:19:44.370619+0000","last_fullsized":"2023-10-14T12:19:44.370619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:57.050730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451831+0000","last_change":"2023-10-14T12:19:42.378784+0000","last_active":"2023-10-14T12:19:45.451831+0000","last_peered":"2023-10-14T12:19:45.451831+0000","last_clean":"2023-10-14T12:19:45.451831+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:45.451831+0000","last_undegraded":"2023-10-14T12:19:45.451831+0000","last_fullsized":"2023-10-14T12:19:45.451831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370513+0000","last_change":"2023-10-14T12:19:43.390194+0000","last_active":"2023-10-14T12:19:44.370513+0000","last_peered":"2023-10-14T12:19:44.370513+0000","last_clean":"2023-10-14T12:19:44.370513+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:19:44.370513+0000","last_undegraded":"2023-10-14T12:19:44.370513+0000","last_fullsized":"2023-10-14T12:19:44.370513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:13.104681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179660+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:45.179660+0000","last_peered":"2023-10-14T12:19:45.179660+0000","last_clean":"2023-10-14T12:19:45.179660+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:45.179660+0000","last_undegraded":"2023-10-14T12:19:45.179660+0000","last_fullsized":"2023-10-14T12:19:45.179660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:05.965211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370406+0000","last_change":"2023-10-14T12:19:43.382787+0000","last_active":"2023-10-14T12:19:44.370406+0000","last_peered":"2023-10-14T12:19:44.370406+0000","last_clean":"2023-10-14T12:19:44.370406+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:19:44.370406+0000","last_undegraded":"2023-10-14T12:19:44.370406+0000","last_fullsized":"2023-10-14T12:19:44.370406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:49.121733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179805+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:45.179805+0000","last_peered":"2023-10-14T12:19:45.179805+0000","last_clean":"2023-10-14T12:19:45.179805+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:45.179805+0000","last_undegraded":"2023-10-14T12:19:45.179805+0000","last_fullsized":"2023-10-14T12:19:45.179805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:07:17.650999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950643+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:44.950643+0000","last_peered":"2023-10-14T12:19:44.950643+0000","last_clean":"2023-10-14T12:19:44.950643+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:44.950643+0000","last_undegraded":"2023-10-14T12:19:44.950643+0000","last_fullsized":"2023-10-14T12:19:44.950643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:00.396238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373934+0000","last_change":"2023-10-14T12:19:42.377594+0000","last_active":"2023-10-14T12:19:44.373934+0000","last_peered":"2023-10-14T12:19:44.373934+0000","last_clean":"2023-10-14T12:19:44.373934+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:44.373934+0000","last_undegraded":"2023-10-14T12:19:44.373934+0000","last_fullsized":"2023-10-14T12:19:44.373934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.919848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.370575+0000","last_change":"2023-10-14T12:19:43.388662+0000","last_active":"2023-10-14T12:19:44.370575+0000","last_peered":"2023-10-14T12:19:44.370575+0000","last_clean":"2023-10-14T12:19:44.370575+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:19:44.370575+0000","last_undegraded":"2023-10-14T12:19:44.370575+0000","last_fullsized":"2023-10-14T12:19:44.370575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:20.611672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452634+0000","last_change":"2023-10-14T12:19:42.377243+0000","last_active":"2023-10-14T12:19:45.452634+0000","last_peered":"2023-10-14T12:19:45.452634+0000","last_clean":"2023-10-14T12:19:45.452634+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:19:45.452634+0000","last_undegraded":"2023-10-14T12:19:45.452634+0000","last_fullsized":"2023-10-14T12:19:45.452634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374463+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:44.374463+0000","last_peered":"2023-10-14T12:19:44.374463+0000","last_clean":"2023-10-14T12:19:44.374463+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:44.374463+0000","last_undegraded":"2023-10-14T12:19:44.374463+0000","last_fullsized":"2023-10-14T12:19:44.374463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:07.165803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.502093+0000","last_change":"2023-10-14T12:19:42.378619+0000","last_active":"2023-10-14T12:19:45.502093+0000","last_peered":"2023-10-14T12:19:45.502093+0000","last_clean":"2023-10-14T12:19:45.502093+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:19:45.502093+0000","last_undegraded":"2023-10-14T12:19:45.502093+0000","last_fullsized":"2023-10-14T12:19:45.502093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451673+0000","last_change":"2023-10-14T12:19:43.389128+0000","last_active":"2023-10-14T12:19:45.451673+0000","last_peered":"2023-10-14T12:19:45.451673+0000","last_clean":"2023-10-14T12:19:45.451673+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:19:45.451673+0000","last_undegraded":"2023-10-14T12:19:45.451673+0000","last_fullsized":"2023-10-14T12:19:45.451673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451924+0000","last_change":"2023-10-14T12:19:42.371259+0000","last_active":"2023-10-14T12:19:45.451924+0000","last_peered":"2023-10-14T12:19:45.451924+0000","last_clean":"2023-10-14T12:19:45.451924+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:19:45.451924+0000","last_undegraded":"2023-10-14T12:19:45.451924+0000","last_fullsized":"2023-10-14T12:19:45.451924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451233+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:45.451233+0000","last_peered":"2023-10-14T12:19:45.451233+0000","last_clean":"2023-10-14T12:19:45.451233+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:45.451233+0000","last_undegraded":"2023-10-14T12:19:45.451233+0000","last_fullsized":"2023-10-14T12:19:45.451233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:34.925173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:55.116402+0000","last_change":"2023-10-14T12:19:55.116473+0000","last_active":"2023-10-14T12:19:55.116402+0000","last_peered":"2023-10-14T12:19:55.116402+0000","last_clean":"2023-10-14T12:19:55.116402+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:55.116402+0000","last_undegraded":"2023-10-14T12:19:55.116402+0000","last_fullsized":"2023-10-14T12:19:55.116402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_clean_scrub_stamp":"2023-10-14T12:19:55.116311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:25.522965+0000","scrub_duration":0.0019265339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451993+0000","last_change":"2023-10-14T12:19:43.388360+0000","last_active":"2023-10-14T12:19:45.451993+0000","last_peered":"2023-10-14T12:19:45.451993+0000","last_clean":"2023-10-14T12:19:45.451993+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:19:45.451993+0000","last_undegraded":"2023-10-14T12:19:45.451993+0000","last_fullsized":"2023-10-14T12:19:45.451993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451535+0000","last_change":"2023-10-14T12:19:42.376964+0000","last_active":"2023-10-14T12:19:45.451535+0000","last_peered":"2023-10-14T12:19:45.451535+0000","last_clean":"2023-10-14T12:19:45.451535+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:45.451535+0000","last_undegraded":"2023-10-14T12:19:45.451535+0000","last_fullsized":"2023-10-14T12:19:45.451535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.374083+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:44.374083+0000","last_peered":"2023-10-14T12:19:44.374083+0000","last_clean":"2023-10-14T12:19:44.374083+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:44.374083+0000","last_undegraded":"2023-10-14T12:19:44.374083+0000","last_fullsized":"2023-10-14T12:19:44.374083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:00.394125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179816+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:45.179816+0000","last_peered":"2023-10-14T12:19:45.179816+0000","last_clean":"2023-10-14T12:19:45.179816+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:45.179816+0000","last_undegraded":"2023-10-14T12:19:45.179816+0000","last_fullsized":"2023-10-14T12:19:45.179816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:09.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451226+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:45.451226+0000","last_peered":"2023-10-14T12:19:45.451226+0000","last_clean":"2023-10-14T12:19:45.451226+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:45.451226+0000","last_undegraded":"2023-10-14T12:19:45.451226+0000","last_fullsized":"2023-10-14T12:19:45.451226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:43:35.069664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.373897+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:44.373897+0000","last_peered":"2023-10-14T12:19:44.373897+0000","last_clean":"2023-10-14T12:19:44.373897+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:44.373897+0000","last_undegraded":"2023-10-14T12:19:44.373897+0000","last_fullsized":"2023-10-14T12:19:44.373897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:51.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:44.950724+0000","last_change":"2023-10-14T12:19:43.385662+0000","last_active":"2023-10-14T12:19:44.950724+0000","last_peered":"2023-10-14T12:19:44.950724+0000","last_clean":"2023-10-14T12:19:44.950724+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:19:44.950724+0000","last_undegraded":"2023-10-14T12:19:44.950724+0000","last_fullsized":"2023-10-14T12:19:44.950724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:34.085460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.179683+0000","last_change":"2023-10-14T12:19:42.371684+0000","last_active":"2023-10-14T12:19:45.179683+0000","last_peered":"2023-10-14T12:19:45.179683+0000","last_clean":"2023-10-14T12:19:45.179683+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:45.179683+0000","last_undegraded":"2023-10-14T12:19:45.179683+0000","last_fullsized":"2023-10-14T12:19:45.179683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:56.045404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T12:19:43.373248+0000","last_change":"2023-10-14T12:18:42.956132+0000","last_active":"2023-10-14T12:19:43.373248+0000","last_peered":"2023-10-14T12:19:43.373248+0000","last_clean":"2023-10-14T12:19:43.373248+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:19:43.373248+0000","last_undegraded":"2023-10-14T12:19:43.373248+0000","last_fullsized":"2023-10-14T12:19:43.373248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:18:41.449568+0000","last_clean_scrub_stamp":"2023-10-14T12:18:41.449568+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:47:12.236109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58899999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.627}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.443},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.38800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.313},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.495}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.434},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.625}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59099999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.379},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.54600000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.317},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70399999999999996}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.372},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.51000000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32400000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39700000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46600000000000003}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53600000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.376}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.437}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48699999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:19:58.654 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.654 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.654 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.655 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.655 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.656 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.656 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.656 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.657 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.657 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.657 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.658 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.658 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.659 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.659 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.659 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.660 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.660 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.660 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.661 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.661 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.662 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.662 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.662 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.663 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.663 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.664 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.664 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.664 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.665 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.665 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.665 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.666 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.666 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.667 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.667 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.667 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.668 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.668 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.669 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.669 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.669 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.670 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.670 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.670 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.671 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.671 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.672 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.672 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.672 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.673 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.673 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.673 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.674 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.674 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.674 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.675 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.675 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.676 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.676 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.676 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.677 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.677 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.677 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.678 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.678 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.679 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.679 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.679 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.680 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.680 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.680 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.681 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.681 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.682 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.682 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.682 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.683 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.683 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.683 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.684 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.684 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.685 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.685 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.685 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.686 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.686 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.686 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.687 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.687 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.688 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.688 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.688 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.689 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.689 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.689 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T12:18:41.449568+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=18, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:19:58.690 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:20:18.691 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:20:18.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.831+0000 7f6f8d637700 1 Processor -- start 2023-10-14T12:20:18.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.831+0000 7f6f8d637700 1 -- start start 2023-10-14T12:20:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f8d637700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f880b7050 0x7f6f8815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f8d637700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8815e4e0 con 0x7f6f8815dbc0 2023-10-14T12:20:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f8d637700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f880d28e0 con 0x7f6f880d3fc0 2023-10-14T12:20:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f8d637700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880b7560 con 0x7f6f880b7050 2023-10-14T12:20:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f877fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f880b7050 0x7f6f8815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f86ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6f8815dbc0 0x7f6f880d1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57382/0 (socket says 172.21.15.32:57382) 2023-10-14T12:20:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f877fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f880b7050 0x7f6f8815dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40362/0 (socket says 172.21.15.32:40362) 2023-10-14T12:20:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.832+0000 7f6f86ffd700 1 -- 172.21.15.32:0/2534629992 learned_addr learned my addr 172.21.15.32:0/2534629992 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:20:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f877fe700 1 -- 172.21.15.32:0/2534629992 >> v1:172.21.15.92:6789/0 conn(0x7f6f880d3fc0 legacy=0x7f6f880d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:20:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f877fe700 1 -- 172.21.15.32:0/2534629992 >> v1:172.21.15.32:6789/0 conn(0x7f6f8815dbc0 legacy=0x7f6f880d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f877fe700 1 -- 172.21.15.32:0/2534629992 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880b7840 con 0x7f6f880b7050 2023-10-14T12:20:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f85ffb700 1 -- 172.21.15.32:0/2534629992 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051852245 0 0) 0x7f6f8815e4e0 con 0x7f6f8815dbc0 2023-10-14T12:20:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f877fe700 1 --2- 172.21.15.32:0/2534629992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f880b7050 0x7f6f8815dfa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009d90 tx=0x7f6f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3c2e012af1751e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f85ffb700 1 -- 172.21.15.32:0/2534629992 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000e070 con 0x7f6f880b7050 2023-10-14T12:20:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f85ffb700 1 -- 172.21.15.32:0/2534629992 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000bb90 con 0x7f6f880b7050 2023-10-14T12:20:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f85ffb700 1 -- 172.21.15.32:0/2534629992 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80003a20 con 0x7f6f880b7050 2023-10-14T12:20:18.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f8d637700 1 -- 172.21.15.32:0/2534629992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f880b7050 msgr2=0x7f6f8815dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:18.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.833+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2534629992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f880b7050 0x7f6f8815dfa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009d90 tx=0x7f6f8000b330 comp rx=0 tx=0).stop 2023-10-14T12:20:18.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.834+0000 7f6f8d637700 1 -- 172.21.15.32:0/2534629992 shutdown_connections 2023-10-14T12:20:18.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.834+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2534629992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f880b7050 0x7f6f8815dfa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:18.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.834+0000 7f6f8d637700 1 -- 172.21.15.32:0/2534629992 >> 172.21.15.32:0/2534629992 conn(0x7f6f8809cb40 msgr2=0x7f6f880d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:20:18.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.834+0000 7f6f8d637700 1 -- 172.21.15.32:0/2534629992 shutdown_connections 2023-10-14T12:20:18.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.834+0000 7f6f8d637700 1 -- 172.21.15.32:0/2534629992 wait complete. 2023-10-14T12:20:18.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.835+0000 7f6f8d637700 1 Processor -- start 2023-10-14T12:20:18.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.835+0000 7f6f8d637700 1 -- start start 2023-10-14T12:20:18.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f8d637700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f880b7050 0x7f6f881e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:18.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f8d637700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f880d3fc0 0x7f6f881e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:18.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f8d637700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 0x7f6f8809ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:18.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f8d637700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f881e7e60 con 0x7f6f8815dbc0 2023-10-14T12:20:18.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f8d637700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8809eb40 con 0x7f6f880b7050 2023-10-14T12:20:18.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f8d637700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8809e6b0 con 0x7f6f880d3fc0 2023-10-14T12:20:18.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 0x7f6f8809ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:18.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 0x7f6f8809ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40368/0 (socket says 172.21.15.32:40368) 2023-10-14T12:20:18.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 -- 172.21.15.32:0/2617826832 learned_addr learned my addr 172.21.15.32:0/2617826832 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:20:18.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f86ffd700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f880b7050 0x7f6f881e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:18.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f867fc700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f880d3fc0 0x7f6f881e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:18.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 -- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f880d3fc0 msgr2=0x7f6f881e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:18.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f880d3fc0 0x7f6f881e8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:18.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 -- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f880b7050 msgr2=0x7f6f881e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:18.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f880b7050 0x7f6f881e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:18.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 -- 172.21.15.32:0/2617826832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80009a70 con 0x7f6f8815dbc0 2023-10-14T12:20:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f86ffd700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f880b7050 0x7f6f881e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:20:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.836+0000 7f6f877fe700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 0x7f6f8809ee60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b730 tx=0x7f6f80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.837+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80012630 con 0x7f6f8815dbc0 2023-10-14T12:20:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.837+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f800127b0 con 0x7f6f8815dbc0 2023-10-14T12:20:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.837+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f881e73e0 con 0x7f6f8815dbc0 2023-10-14T12:20:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.837+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80012b60 con 0x7f6f8815dbc0 2023-10-14T12:20:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.837+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f881e7b80 con 0x7f6f8815dbc0 2023-10-14T12:20:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.838+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8804ebb0 con 0x7f6f8815dbc0 2023-10-14T12:20:18.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.838+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f80012cc0 con 0x7f6f8815dbc0 2023-10-14T12:20:18.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.838+0000 7f6f7f7fe700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6f6806af00 0x7f6f6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:18.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.838+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6f8008c020 con 0x7f6f8815dbc0 2023-10-14T12:20:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.839+0000 7f6f86ffd700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6f6806af00 0x7f6f6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.839+0000 7f6f86ffd700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6f6806af00 0x7f6f6806d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f780016e0 tx=0x7f6f78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:18.843+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f8005abd0 con 0x7f6f8815dbc0 2023-10-14T12:20:19.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.038+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f880b7e00 con 0x7f6f6806af00 2023-10-14T12:20:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.046+0000 7f6f7f7fe700 1 -- 172.21.15.32:0/2617826832 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287902 (secure 0 0 0) 0x7f6f780013d0 con 0x7f6f6806af00 2023-10-14T12:20:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:20:19.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6f6806af00 msgr2=0x7f6f6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:19.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6f6806af00 0x7f6f6806d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f780016e0 tx=0x7f6f78009040 comp rx=0 tx=0).stop 2023-10-14T12:20:19.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 msgr2=0x7f6f8809ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:19.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 0x7f6f8809ee60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b730 tx=0x7f6f80004ad0 comp rx=0 tx=0).stop 2023-10-14T12:20:19.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 shutdown_connections 2023-10-14T12:20:19.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f8815dbc0 0x7f6f8809ee60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:19.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6f6806af00 0x7f6f6806d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:19.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f880b7050 0x7f6f881e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:19.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 --2- 172.21.15.32:0/2617826832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f880d3fc0 0x7f6f881e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:19.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 >> 172.21.15.32:0/2617826832 conn(0x7f6f8809cb40 msgr2=0x7f6f8806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:20:19.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 shutdown_connections 2023-10-14T12:20:19.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:19.050+0000 7f6f8d637700 1 -- 172.21.15.32:0/2617826832 wait complete. 2023-10-14T12:20:19.059 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:20:19.063 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-14T12:20:17.118228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224328,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750392,"statfs":{"total":773094113280,"available":772864401408,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451222+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:45.451222+0000","last_peered":"2023-10-14T12:19:45.451222+0000","last_clean":"2023-10-14T12:19:45.451222+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:45.451222+0000","last_undegraded":"2023-10-14T12:19:45.451222+0000","last_fullsized":"2023-10-14T12:19:45.451222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250778+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:45.250778+0000","last_peered":"2023-10-14T12:19:45.250778+0000","last_clean":"2023-10-14T12:19:45.250778+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:45.250778+0000","last_undegraded":"2023-10-14T12:19:45.250778+0000","last_fullsized":"2023-10-14T12:19:45.250778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175610+0000","last_change":"2023-10-14T12:19:43.389113+0000","last_active":"2023-10-14T12:19:45.175610+0000","last_peered":"2023-10-14T12:19:45.175610+0000","last_clean":"2023-10-14T12:19:45.175610+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:19:45.175610+0000","last_undegraded":"2023-10-14T12:19:45.175610+0000","last_fullsized":"2023-10-14T12:19:45.175610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.000369+0000","last_change":"2023-10-14T12:20:13.000426+0000","last_active":"2023-10-14T12:20:13.000369+0000","last_peered":"2023-10-14T12:20:13.000369+0000","last_clean":"2023-10-14T12:20:13.000369+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:20:13.000369+0000","last_undegraded":"2023-10-14T12:20:13.000369+0000","last_fullsized":"2023-10-14T12:20:13.000369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.000229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:12:06.144509+0000","scrub_duration":0.0019750879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.168113+0000","last_change":"2023-10-14T12:20:09.168161+0000","last_active":"2023-10-14T12:20:09.168113+0000","last_peered":"2023-10-14T12:20:09.168113+0000","last_clean":"2023-10-14T12:20:09.168113+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:20:09.168113+0000","last_undegraded":"2023-10-14T12:20:09.168113+0000","last_fullsized":"2023-10-14T12:20:09.168113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.168000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:08.509845+0000","scrub_duration":0.001546331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250668+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:45.250668+0000","last_peered":"2023-10-14T12:19:45.250668+0000","last_clean":"2023-10-14T12:19:45.250668+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:45.250668+0000","last_undegraded":"2023-10-14T12:19:45.250668+0000","last_fullsized":"2023-10-14T12:19:45.250668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.099856+0000","last_change":"2023-10-14T12:20:05.099899+0000","last_active":"2023-10-14T12:20:05.099856+0000","last_peered":"2023-10-14T12:20:05.099856+0000","last_clean":"2023-10-14T12:20:05.099856+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:20:05.099856+0000","last_undegraded":"2023-10-14T12:20:05.099856+0000","last_fullsized":"2023-10-14T12:20:05.099856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.099748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:03.711286+0000","scrub_duration":0.001409483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.155547+0000","last_change":"2023-10-14T12:20:03.155603+0000","last_active":"2023-10-14T12:20:03.155547+0000","last_peered":"2023-10-14T12:20:03.155547+0000","last_clean":"2023-10-14T12:20:03.155547+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:20:03.155547+0000","last_undegraded":"2023-10-14T12:20:03.155547+0000","last_fullsized":"2023-10-14T12:20:03.155547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:24.804563+0000","scrub_duration":0.001673566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452092+0000","last_change":"2023-10-14T12:19:43.388790+0000","last_active":"2023-10-14T12:19:45.452092+0000","last_peered":"2023-10-14T12:19:45.452092+0000","last_clean":"2023-10-14T12:19:45.452092+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:19:45.452092+0000","last_undegraded":"2023-10-14T12:19:45.452092+0000","last_fullsized":"2023-10-14T12:19:45.452092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.009920+0000","last_change":"2023-10-14T12:20:12.009966+0000","last_active":"2023-10-14T12:20:12.009920+0000","last_peered":"2023-10-14T12:20:12.009920+0000","last_clean":"2023-10-14T12:20:12.009920+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:20:12.009920+0000","last_undegraded":"2023-10-14T12:20:12.009920+0000","last_fullsized":"2023-10-14T12:20:12.009920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.009806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:30.037499+0000","scrub_duration":0.0015351309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175530+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:45.175530+0000","last_peered":"2023-10-14T12:19:45.175530+0000","last_clean":"2023-10-14T12:19:45.175530+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:45.175530+0000","last_undegraded":"2023-10-14T12:19:45.175530+0000","last_fullsized":"2023-10-14T12:19:45.175530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175572+0000","last_change":"2023-10-14T12:19:43.385243+0000","last_active":"2023-10-14T12:19:45.175572+0000","last_peered":"2023-10-14T12:19:45.175572+0000","last_clean":"2023-10-14T12:19:45.175572+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:19:45.175572+0000","last_undegraded":"2023-10-14T12:19:45.175572+0000","last_fullsized":"2023-10-14T12:19:45.175572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173789+0000","last_change":"2023-10-14T12:19:43.385288+0000","last_active":"2023-10-14T12:19:45.173789+0000","last_peered":"2023-10-14T12:19:45.173789+0000","last_clean":"2023-10-14T12:19:45.173789+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:19:45.173789+0000","last_undegraded":"2023-10-14T12:19:45.173789+0000","last_fullsized":"2023-10-14T12:19:45.173789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250679+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:45.250679+0000","last_peered":"2023-10-14T12:19:45.250679+0000","last_clean":"2023-10-14T12:19:45.250679+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:45.250679+0000","last_undegraded":"2023-10-14T12:19:45.250679+0000","last_fullsized":"2023-10-14T12:19:45.250679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175529+0000","last_change":"2023-10-14T12:19:43.385148+0000","last_active":"2023-10-14T12:19:45.175529+0000","last_peered":"2023-10-14T12:19:45.175529+0000","last_clean":"2023-10-14T12:19:45.175529+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:19:45.175529+0000","last_undegraded":"2023-10-14T12:19:45.175529+0000","last_fullsized":"2023-10-14T12:19:45.175529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175390+0000","last_change":"2023-10-14T12:19:43.384145+0000","last_active":"2023-10-14T12:19:45.175390+0000","last_peered":"2023-10-14T12:19:45.175390+0000","last_clean":"2023-10-14T12:19:45.175390+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:19:45.175390+0000","last_undegraded":"2023-10-14T12:19:45.175390+0000","last_fullsized":"2023-10-14T12:19:45.175390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.180615+0000","last_change":"2023-10-14T12:20:09.180663+0000","last_active":"2023-10-14T12:20:09.180615+0000","last_peered":"2023-10-14T12:20:09.180615+0000","last_clean":"2023-10-14T12:20:09.180615+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:20:09.180615+0000","last_undegraded":"2023-10-14T12:20:09.180615+0000","last_fullsized":"2023-10-14T12:20:09.180615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.180502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:59:31.918129+0000","scrub_duration":0.001560082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250768+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:45.250768+0000","last_peered":"2023-10-14T12:19:45.250768+0000","last_clean":"2023-10-14T12:19:45.250768+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:45.250768+0000","last_undegraded":"2023-10-14T12:19:45.250768+0000","last_fullsized":"2023-10-14T12:19:45.250768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250744+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:45.250744+0000","last_peered":"2023-10-14T12:19:45.250744+0000","last_clean":"2023-10-14T12:19:45.250744+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:45.250744+0000","last_undegraded":"2023-10-14T12:19:45.250744+0000","last_fullsized":"2023-10-14T12:19:45.250744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.173814+0000","last_change":"2023-10-14T12:19:43.389301+0000","last_active":"2023-10-14T12:19:45.173814+0000","last_peered":"2023-10-14T12:19:45.173814+0000","last_clean":"2023-10-14T12:19:45.173814+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:19:45.173814+0000","last_undegraded":"2023-10-14T12:19:45.173814+0000","last_fullsized":"2023-10-14T12:19:45.173814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451618+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:45.451618+0000","last_peered":"2023-10-14T12:19:45.451618+0000","last_clean":"2023-10-14T12:19:45.451618+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:45.451618+0000","last_undegraded":"2023-10-14T12:19:45.451618+0000","last_fullsized":"2023-10-14T12:19:45.451618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451591+0000","last_change":"2023-10-14T12:19:43.386331+0000","last_active":"2023-10-14T12:19:45.451591+0000","last_peered":"2023-10-14T12:19:45.451591+0000","last_clean":"2023-10-14T12:19:45.451591+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:19:45.451591+0000","last_undegraded":"2023-10-14T12:19:45.451591+0000","last_fullsized":"2023-10-14T12:19:45.451591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.151021+0000","last_change":"2023-10-14T12:20:07.151083+0000","last_active":"2023-10-14T12:20:07.151021+0000","last_peered":"2023-10-14T12:20:07.151021+0000","last_clean":"2023-10-14T12:20:07.151021+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:20:07.151021+0000","last_undegraded":"2023-10-14T12:20:07.151021+0000","last_fullsized":"2023-10-14T12:20:07.151021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.150921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.119523+0000","scrub_duration":0.002059576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.565408+0000","last_change":"2023-10-14T12:20:06.565489+0000","last_active":"2023-10-14T12:20:06.565408+0000","last_peered":"2023-10-14T12:20:06.565408+0000","last_clean":"2023-10-14T12:20:06.565408+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:20:06.565408+0000","last_undegraded":"2023-10-14T12:20:06.565408+0000","last_fullsized":"2023-10-14T12:20:06.565408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.565268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:58.810087+0000","scrub_duration":0.0023384180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.999329+0000","last_change":"2023-10-14T12:20:13.999395+0000","last_active":"2023-10-14T12:20:13.999329+0000","last_peered":"2023-10-14T12:20:13.999329+0000","last_clean":"2023-10-14T12:20:13.999329+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:20:13.999329+0000","last_undegraded":"2023-10-14T12:20:13.999329+0000","last_fullsized":"2023-10-14T12:20:13.999329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.999218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:37.632861+0000","scrub_duration":0.001812021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.983720+0000","last_change":"2023-10-14T12:19:58.983768+0000","last_active":"2023-10-14T12:19:58.983720+0000","last_peered":"2023-10-14T12:19:58.983720+0000","last_clean":"2023-10-14T12:19:58.983720+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:58.983720+0000","last_undegraded":"2023-10-14T12:19:58.983720+0000","last_fullsized":"2023-10-14T12:19:58.983720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.983621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:20.632775+0000","scrub_duration":0.0017119399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452281+0000","last_change":"2023-10-14T12:19:43.391913+0000","last_active":"2023-10-14T12:19:45.452281+0000","last_peered":"2023-10-14T12:19:45.452281+0000","last_clean":"2023-10-14T12:19:45.452281+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:19:45.452281+0000","last_undegraded":"2023-10-14T12:19:45.452281+0000","last_fullsized":"2023-10-14T12:19:45.452281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175591+0000","last_change":"2023-10-14T12:19:43.386830+0000","last_active":"2023-10-14T12:19:45.175591+0000","last_peered":"2023-10-14T12:19:45.175591+0000","last_clean":"2023-10-14T12:19:45.175591+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:19:45.175591+0000","last_undegraded":"2023-10-14T12:19:45.175591+0000","last_fullsized":"2023-10-14T12:19:45.175591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451625+0000","last_change":"2023-10-14T12:19:43.387908+0000","last_active":"2023-10-14T12:19:45.451625+0000","last_peered":"2023-10-14T12:19:45.451625+0000","last_clean":"2023-10-14T12:19:45.451625+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:19:45.451625+0000","last_undegraded":"2023-10-14T12:19:45.451625+0000","last_fullsized":"2023-10-14T12:19:45.451625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175473+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:45.175473+0000","last_peered":"2023-10-14T12:19:45.175473+0000","last_clean":"2023-10-14T12:19:45.175473+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:45.175473+0000","last_undegraded":"2023-10-14T12:19:45.175473+0000","last_fullsized":"2023-10-14T12:19:45.175473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451266+0000","last_change":"2023-10-14T12:19:43.380199+0000","last_active":"2023-10-14T12:19:45.451266+0000","last_peered":"2023-10-14T12:19:45.451266+0000","last_clean":"2023-10-14T12:19:45.451266+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:19:45.451266+0000","last_undegraded":"2023-10-14T12:19:45.451266+0000","last_fullsized":"2023-10-14T12:19:45.451266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175417+0000","last_change":"2023-10-14T12:19:43.389967+0000","last_active":"2023-10-14T12:19:45.175417+0000","last_peered":"2023-10-14T12:19:45.175417+0000","last_clean":"2023-10-14T12:19:45.175417+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:19:45.175417+0000","last_undegraded":"2023-10-14T12:19:45.175417+0000","last_fullsized":"2023-10-14T12:19:45.175417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.178018+0000","last_change":"2023-10-14T12:20:15.178066+0000","last_active":"2023-10-14T12:20:15.178018+0000","last_peered":"2023-10-14T12:20:15.178018+0000","last_clean":"2023-10-14T12:20:15.178018+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:20:15.178018+0000","last_undegraded":"2023-10-14T12:20:15.178018+0000","last_fullsized":"2023-10-14T12:20:15.178018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.177907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:13.789446+0000","scrub_duration":0.0021094970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451328+0000","last_change":"2023-10-14T12:19:42.372749+0000","last_active":"2023-10-14T12:19:45.451328+0000","last_peered":"2023-10-14T12:19:45.451328+0000","last_clean":"2023-10-14T12:19:45.451328+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:19:45.451328+0000","last_undegraded":"2023-10-14T12:19:45.451328+0000","last_fullsized":"2023-10-14T12:19:45.451328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451289+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:45.451289+0000","last_peered":"2023-10-14T12:19:45.451289+0000","last_clean":"2023-10-14T12:19:45.451289+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:45.451289+0000","last_undegraded":"2023-10-14T12:19:45.451289+0000","last_fullsized":"2023-10-14T12:19:45.451289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.072983+0000","last_change":"2023-10-14T12:20:05.073083+0000","last_active":"2023-10-14T12:20:05.072983+0000","last_peered":"2023-10-14T12:20:05.072983+0000","last_clean":"2023-10-14T12:20:05.072983+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:20:05.072983+0000","last_undegraded":"2023-10-14T12:20:05.072983+0000","last_fullsized":"2023-10-14T12:20:05.072983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.072872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:01.324353+0000","scrub_duration":0.0018346199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451756+0000","last_change":"2023-10-14T12:19:43.388261+0000","last_active":"2023-10-14T12:19:45.451756+0000","last_peered":"2023-10-14T12:19:45.451756+0000","last_clean":"2023-10-14T12:19:45.451756+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:19:45.451756+0000","last_undegraded":"2023-10-14T12:19:45.451756+0000","last_fullsized":"2023-10-14T12:19:45.451756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.917181+0000","last_change":"2023-10-14T12:20:04.917281+0000","last_active":"2023-10-14T12:20:04.917181+0000","last_peered":"2023-10-14T12:20:04.917181+0000","last_clean":"2023-10-14T12:20:04.917181+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:20:04.917181+0000","last_undegraded":"2023-10-14T12:20:04.917181+0000","last_fullsized":"2023-10-14T12:20:04.917181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.917043+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:22.944736+0000","scrub_duration":0.0021985300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.452334+0000","last_change":"2023-10-14T12:19:43.391940+0000","last_active":"2023-10-14T12:19:45.452334+0000","last_peered":"2023-10-14T12:19:45.452334+0000","last_clean":"2023-10-14T12:19:45.452334+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:19:45.452334+0000","last_undegraded":"2023-10-14T12:19:45.452334+0000","last_fullsized":"2023-10-14T12:19:45.452334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:56.143539+0000","last_change":"2023-10-14T12:19:56.143579+0000","last_active":"2023-10-14T12:19:56.143539+0000","last_peered":"2023-10-14T12:19:56.143539+0000","last_clean":"2023-10-14T12:19:56.143539+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:56.143539+0000","last_undegraded":"2023-10-14T12:19:56.143539+0000","last_fullsized":"2023-10-14T12:19:56.143539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_clean_scrub_stamp":"2023-10-14T12:19:56.143469+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:45.317148+0000","scrub_duration":0.0014353720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.169240+0000","last_change":"2023-10-14T12:20:12.169285+0000","last_active":"2023-10-14T12:20:12.169240+0000","last_peered":"2023-10-14T12:20:12.169240+0000","last_clean":"2023-10-14T12:20:12.169240+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:20:12.169240+0000","last_undegraded":"2023-10-14T12:20:12.169240+0000","last_fullsized":"2023-10-14T12:20:12.169240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.169111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:40.089199+0000","scrub_duration":0.001529844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.075374+0000","last_change":"2023-10-14T12:20:00.075474+0000","last_active":"2023-10-14T12:20:00.075374+0000","last_peered":"2023-10-14T12:20:00.075374+0000","last_clean":"2023-10-14T12:20:00.075374+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:20:00.075374+0000","last_undegraded":"2023-10-14T12:20:00.075374+0000","last_fullsized":"2023-10-14T12:20:00.075374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.075202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:24.888838+0000","scrub_duration":0.0020269469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.582106+0000","last_change":"2023-10-14T12:20:07.582203+0000","last_active":"2023-10-14T12:20:07.582106+0000","last_peered":"2023-10-14T12:20:07.582106+0000","last_clean":"2023-10-14T12:20:07.582106+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:20:07.582106+0000","last_undegraded":"2023-10-14T12:20:07.582106+0000","last_fullsized":"2023-10-14T12:20:07.582106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.581991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:25.609684+0000","scrub_duration":0.0024689830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.036968+0000","last_change":"2023-10-14T12:20:07.037030+0000","last_active":"2023-10-14T12:20:07.036968+0000","last_peered":"2023-10-14T12:20:07.036968+0000","last_clean":"2023-10-14T12:20:07.036968+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:20:07.036968+0000","last_undegraded":"2023-10-14T12:20:07.036968+0000","last_fullsized":"2023-10-14T12:20:07.036968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.036858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:03.288339+0000","scrub_duration":0.0028120160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451259+0000","last_change":"2023-10-14T12:19:43.385102+0000","last_active":"2023-10-14T12:19:45.451259+0000","last_peered":"2023-10-14T12:19:45.451259+0000","last_clean":"2023-10-14T12:19:45.451259+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:19:45.451259+0000","last_undegraded":"2023-10-14T12:19:45.451259+0000","last_fullsized":"2023-10-14T12:19:45.451259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.918650+0000","last_change":"2023-10-14T12:20:02.918708+0000","last_active":"2023-10-14T12:20:02.918650+0000","last_peered":"2023-10-14T12:20:02.918650+0000","last_clean":"2023-10-14T12:20:02.918650+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:20:02.918650+0000","last_undegraded":"2023-10-14T12:20:02.918650+0000","last_fullsized":"2023-10-14T12:20:02.918650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.918526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:31.370887+0000","scrub_duration":0.0015505899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451371+0000","last_change":"2023-10-14T12:19:43.387009+0000","last_active":"2023-10-14T12:19:45.451371+0000","last_peered":"2023-10-14T12:19:45.451371+0000","last_clean":"2023-10-14T12:19:45.451371+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:19:45.451371+0000","last_undegraded":"2023-10-14T12:19:45.451371+0000","last_fullsized":"2023-10-14T12:19:45.451371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.087258+0000","last_change":"2023-10-14T12:20:02.087309+0000","last_active":"2023-10-14T12:20:02.087258+0000","last_peered":"2023-10-14T12:20:02.087258+0000","last_clean":"2023-10-14T12:20:02.087258+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:20:02.087258+0000","last_undegraded":"2023-10-14T12:20:02.087258+0000","last_fullsized":"2023-10-14T12:20:02.087258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.087127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.572933+0000","scrub_duration":0.001469337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.549309+0000","last_change":"2023-10-14T12:20:13.549409+0000","last_active":"2023-10-14T12:20:13.549309+0000","last_peered":"2023-10-14T12:20:13.549309+0000","last_clean":"2023-10-14T12:20:13.549309+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:20:13.549309+0000","last_undegraded":"2023-10-14T12:20:13.549309+0000","last_fullsized":"2023-10-14T12:20:13.549309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.549155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:06.035279+0000","scrub_duration":0.0019478570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.817693+0000","last_change":"2023-10-14T12:20:12.817784+0000","last_active":"2023-10-14T12:20:12.817693+0000","last_peered":"2023-10-14T12:20:12.817693+0000","last_clean":"2023-10-14T12:20:12.817693+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:20:12.817693+0000","last_undegraded":"2023-10-14T12:20:12.817693+0000","last_fullsized":"2023-10-14T12:20:12.817693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.817563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:51.379754+0000","scrub_duration":0.002143697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250823+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:45.250823+0000","last_peered":"2023-10-14T12:19:45.250823+0000","last_clean":"2023-10-14T12:19:45.250823+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:45.250823+0000","last_undegraded":"2023-10-14T12:19:45.250823+0000","last_fullsized":"2023-10-14T12:19:45.250823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.014408+0000","last_change":"2023-10-14T12:20:02.014482+0000","last_active":"2023-10-14T12:20:02.014408+0000","last_peered":"2023-10-14T12:20:02.014408+0000","last_clean":"2023-10-14T12:20:02.014408+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:20:02.014408+0000","last_undegraded":"2023-10-14T12:20:02.014408+0000","last_fullsized":"2023-10-14T12:20:02.014408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.014280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.500085+0000","scrub_duration":0.0016626200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250700+0000","last_change":"2023-10-14T12:19:43.381541+0000","last_active":"2023-10-14T12:19:45.250700+0000","last_peered":"2023-10-14T12:19:45.250700+0000","last_clean":"2023-10-14T12:19:45.250700+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:19:45.250700+0000","last_undegraded":"2023-10-14T12:19:45.250700+0000","last_fullsized":"2023-10-14T12:19:45.250700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.528241+0000","last_change":"2023-10-14T12:20:04.528351+0000","last_active":"2023-10-14T12:20:04.528241+0000","last_peered":"2023-10-14T12:20:04.528241+0000","last_clean":"2023-10-14T12:20:04.528241+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:20:04.528241+0000","last_undegraded":"2023-10-14T12:20:04.528241+0000","last_fullsized":"2023-10-14T12:20:04.528241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.528122+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:18.750282+0000","scrub_duration":0.0023976879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175629+0000","last_change":"2023-10-14T12:19:43.389636+0000","last_active":"2023-10-14T12:19:45.175629+0000","last_peered":"2023-10-14T12:19:45.175629+0000","last_clean":"2023-10-14T12:19:45.175629+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:19:45.175629+0000","last_undegraded":"2023-10-14T12:19:45.175629+0000","last_fullsized":"2023-10-14T12:19:45.175629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.846992+0000","last_change":"2023-10-14T12:20:07.847108+0000","last_active":"2023-10-14T12:20:07.846992+0000","last_peered":"2023-10-14T12:20:07.846992+0000","last_clean":"2023-10-14T12:20:07.846992+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:20:07.846992+0000","last_undegraded":"2023-10-14T12:20:07.846992+0000","last_fullsized":"2023-10-14T12:20:07.846992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.846867+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:35.766956+0000","scrub_duration":0.002747167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.013554+0000","last_change":"2023-10-14T12:20:06.013605+0000","last_active":"2023-10-14T12:20:06.013554+0000","last_peered":"2023-10-14T12:20:06.013554+0000","last_clean":"2023-10-14T12:20:06.013554+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:20:06.013554+0000","last_undegraded":"2023-10-14T12:20:06.013554+0000","last_fullsized":"2023-10-14T12:20:06.013554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.013441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:04.624980+0000","scrub_duration":0.002025139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:08.025935+0000","last_change":"2023-10-14T12:20:08.025994+0000","last_active":"2023-10-14T12:20:08.025935+0000","last_peered":"2023-10-14T12:20:08.025935+0000","last_clean":"2023-10-14T12:20:08.025935+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:20:08.025935+0000","last_undegraded":"2023-10-14T12:20:08.025935+0000","last_fullsized":"2023-10-14T12:20:08.025935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_clean_scrub_stamp":"2023-10-14T12:20:08.025791+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.994394+0000","scrub_duration":0.0024040939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250689+0000","last_change":"2023-10-14T12:19:43.383311+0000","last_active":"2023-10-14T12:19:45.250689+0000","last_peered":"2023-10-14T12:19:45.250689+0000","last_clean":"2023-10-14T12:19:45.250689+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:19:45.250689+0000","last_undegraded":"2023-10-14T12:19:45.250689+0000","last_fullsized":"2023-10-14T12:19:45.250689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.970221+0000","last_change":"2023-10-14T12:20:01.970277+0000","last_active":"2023-10-14T12:20:01.970221+0000","last_peered":"2023-10-14T12:20:01.970221+0000","last_clean":"2023-10-14T12:20:01.970221+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:20:01.970221+0000","last_undegraded":"2023-10-14T12:20:01.970221+0000","last_fullsized":"2023-10-14T12:20:01.970221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.970091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:36.729323+0000","scrub_duration":0.0019624059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175401+0000","last_change":"2023-10-14T12:19:43.389792+0000","last_active":"2023-10-14T12:19:45.175401+0000","last_peered":"2023-10-14T12:19:45.175401+0000","last_clean":"2023-10-14T12:19:45.175401+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:19:45.175401+0000","last_undegraded":"2023-10-14T12:19:45.175401+0000","last_fullsized":"2023-10-14T12:19:45.175401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250656+0000","last_change":"2023-10-14T12:19:42.372927+0000","last_active":"2023-10-14T12:19:45.250656+0000","last_peered":"2023-10-14T12:19:45.250656+0000","last_clean":"2023-10-14T12:19:45.250656+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:19:45.250656+0000","last_undegraded":"2023-10-14T12:19:45.250656+0000","last_fullsized":"2023-10-14T12:19:45.250656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451177+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:45.451177+0000","last_peered":"2023-10-14T12:19:45.451177+0000","last_clean":"2023-10-14T12:19:45.451177+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:45.451177+0000","last_undegraded":"2023-10-14T12:19:45.451177+0000","last_fullsized":"2023-10-14T12:19:45.451177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.941556+0000","last_change":"2023-10-14T12:20:00.941615+0000","last_active":"2023-10-14T12:20:00.941556+0000","last_peered":"2023-10-14T12:20:00.941556+0000","last_clean":"2023-10-14T12:20:00.941556+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:20:00.941556+0000","last_undegraded":"2023-10-14T12:20:00.941556+0000","last_fullsized":"2023-10-14T12:20:00.941556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.941417+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:15.163577+0000","scrub_duration":0.0026495780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451876+0000","last_change":"2023-10-14T12:19:43.389253+0000","last_active":"2023-10-14T12:19:45.451876+0000","last_peered":"2023-10-14T12:19:45.451876+0000","last_clean":"2023-10-14T12:19:45.451876+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:19:45.451876+0000","last_undegraded":"2023-10-14T12:19:45.451876+0000","last_fullsized":"2023-10-14T12:19:45.451876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.923380+0000","last_change":"2023-10-14T12:20:02.923480+0000","last_active":"2023-10-14T12:20:02.923380+0000","last_peered":"2023-10-14T12:20:02.923380+0000","last_clean":"2023-10-14T12:20:02.923380+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:20:02.923380+0000","last_undegraded":"2023-10-14T12:20:02.923380+0000","last_fullsized":"2023-10-14T12:20:02.923380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.923263+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:27.039989+0000","scrub_duration":0.002081308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.512160+0000","last_change":"2023-10-14T12:20:11.512210+0000","last_active":"2023-10-14T12:20:11.512160+0000","last_peered":"2023-10-14T12:20:11.512160+0000","last_clean":"2023-10-14T12:20:11.512160+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:20:11.512160+0000","last_undegraded":"2023-10-14T12:20:11.512160+0000","last_fullsized":"2023-10-14T12:20:11.512160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.512033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:39.432121+0000","scrub_duration":0.001569207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.053293+0000","last_change":"2023-10-14T12:20:12.053387+0000","last_active":"2023-10-14T12:20:12.053293+0000","last_peered":"2023-10-14T12:20:12.053293+0000","last_clean":"2023-10-14T12:20:12.053293+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:20:12.053293+0000","last_undegraded":"2023-10-14T12:20:12.053293+0000","last_fullsized":"2023-10-14T12:20:12.053293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.053179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:27:00.788255+0000","scrub_duration":0.001905143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:10.038313+0000","last_change":"2023-10-14T12:20:10.038364+0000","last_active":"2023-10-14T12:20:10.038313+0000","last_peered":"2023-10-14T12:20:10.038313+0000","last_clean":"2023-10-14T12:20:10.038313+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:20:10.038313+0000","last_undegraded":"2023-10-14T12:20:10.038313+0000","last_fullsized":"2023-10-14T12:20:10.038313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_clean_scrub_stamp":"2023-10-14T12:20:10.038190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:02.283009+0000","scrub_duration":0.0020200909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451847+0000","last_change":"2023-10-14T12:19:42.370489+0000","last_active":"2023-10-14T12:19:45.451847+0000","last_peered":"2023-10-14T12:19:45.451847+0000","last_clean":"2023-10-14T12:19:45.451847+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:19:45.451847+0000","last_undegraded":"2023-10-14T12:19:45.451847+0000","last_fullsized":"2023-10-14T12:19:45.451847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.125144+0000","last_change":"2023-10-14T12:20:04.125193+0000","last_active":"2023-10-14T12:20:04.125144+0000","last_peered":"2023-10-14T12:20:04.125144+0000","last_clean":"2023-10-14T12:20:04.125144+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:20:04.125144+0000","last_undegraded":"2023-10-14T12:20:04.125144+0000","last_fullsized":"2023-10-14T12:20:04.125144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.125041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:29.907915+0000","scrub_duration":0.0022271499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451800+0000","last_change":"2023-10-14T12:19:42.374677+0000","last_active":"2023-10-14T12:19:45.451800+0000","last_peered":"2023-10-14T12:19:45.451800+0000","last_clean":"2023-10-14T12:19:45.451800+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:19:45.451800+0000","last_undegraded":"2023-10-14T12:19:45.451800+0000","last_fullsized":"2023-10-14T12:19:45.451800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.172564+0000","last_change":"2023-10-14T12:20:06.172642+0000","last_active":"2023-10-14T12:20:06.172564+0000","last_peered":"2023-10-14T12:20:06.172564+0000","last_clean":"2023-10-14T12:20:06.172564+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:20:06.172564+0000","last_undegraded":"2023-10-14T12:20:06.172564+0000","last_fullsized":"2023-10-14T12:20:06.172564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.172417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:47:16.064813+0000","scrub_duration":0.0020790610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.074695+0000","last_change":"2023-10-14T12:19:57.074734+0000","last_active":"2023-10-14T12:19:57.074695+0000","last_peered":"2023-10-14T12:19:57.074695+0000","last_clean":"2023-10-14T12:19:57.074695+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:57.074695+0000","last_undegraded":"2023-10-14T12:19:57.074695+0000","last_fullsized":"2023-10-14T12:19:57.074695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.074602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:15.118672+0000","scrub_duration":0.0016862929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:14.067511+0000","last_change":"2023-10-14T12:20:14.067566+0000","last_active":"2023-10-14T12:20:14.067511+0000","last_peered":"2023-10-14T12:20:14.067511+0000","last_clean":"2023-10-14T12:20:14.067511+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:20:14.067511+0000","last_undegraded":"2023-10-14T12:20:14.067511+0000","last_fullsized":"2023-10-14T12:20:14.067511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_clean_scrub_stamp":"2023-10-14T12:20:14.067382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:22:05.800674+0000","scrub_duration":0.0016258220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451383+0000","last_change":"2023-10-14T12:19:42.374459+0000","last_active":"2023-10-14T12:19:45.451383+0000","last_peered":"2023-10-14T12:19:45.451383+0000","last_clean":"2023-10-14T12:19:45.451383+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:19:45.451383+0000","last_undegraded":"2023-10-14T12:19:45.451383+0000","last_fullsized":"2023-10-14T12:19:45.451383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.201319+0000","last_change":"2023-10-14T12:20:02.201368+0000","last_active":"2023-10-14T12:20:02.201319+0000","last_peered":"2023-10-14T12:20:02.201319+0000","last_clean":"2023-10-14T12:20:02.201319+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:20:02.201319+0000","last_undegraded":"2023-10-14T12:20:02.201319+0000","last_fullsized":"2023-10-14T12:20:02.201319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.201208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:54.774214+0000","scrub_duration":0.001588955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451362+0000","last_change":"2023-10-14T12:19:42.370527+0000","last_active":"2023-10-14T12:19:45.451362+0000","last_peered":"2023-10-14T12:19:45.451362+0000","last_clean":"2023-10-14T12:19:45.451362+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:19:45.451362+0000","last_undegraded":"2023-10-14T12:19:45.451362+0000","last_fullsized":"2023-10-14T12:19:45.451362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175457+0000","last_change":"2023-10-14T12:19:43.383448+0000","last_active":"2023-10-14T12:19:45.175457+0000","last_peered":"2023-10-14T12:19:45.175457+0000","last_clean":"2023-10-14T12:19:45.175457+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:19:45.175457+0000","last_undegraded":"2023-10-14T12:19:45.175457+0000","last_fullsized":"2023-10-14T12:19:45.175457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.463746+0000","last_change":"2023-10-14T12:19:58.463793+0000","last_active":"2023-10-14T12:19:58.463746+0000","last_peered":"2023-10-14T12:19:58.463746+0000","last_clean":"2023-10-14T12:19:58.463746+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:58.463746+0000","last_undegraded":"2023-10-14T12:19:58.463746+0000","last_fullsized":"2023-10-14T12:19:58.463746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.463596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:47.198672+0000","scrub_duration":0.001612559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.156060+0000","last_change":"2023-10-14T12:20:03.156105+0000","last_active":"2023-10-14T12:20:03.156060+0000","last_peered":"2023-10-14T12:20:03.156060+0000","last_clean":"2023-10-14T12:20:03.156060+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:20:03.156060+0000","last_undegraded":"2023-10-14T12:20:03.156060+0000","last_fullsized":"2023-10-14T12:20:03.156060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:17.386190+0000","scrub_duration":0.0016035590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.968254+0000","last_change":"2023-10-14T12:20:03.968370+0000","last_active":"2023-10-14T12:20:03.968254+0000","last_peered":"2023-10-14T12:20:03.968254+0000","last_clean":"2023-10-14T12:20:03.968254+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:20:03.968254+0000","last_undegraded":"2023-10-14T12:20:03.968254+0000","last_fullsized":"2023-10-14T12:20:03.968254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.968116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:36.443571+0000","scrub_duration":0.0026487759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175692+0000","last_change":"2023-10-14T12:19:43.390487+0000","last_active":"2023-10-14T12:19:45.175692+0000","last_peered":"2023-10-14T12:19:45.175692+0000","last_clean":"2023-10-14T12:19:45.175692+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:19:45.175692+0000","last_undegraded":"2023-10-14T12:19:45.175692+0000","last_fullsized":"2023-10-14T12:19:45.175692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.011017+0000","last_change":"2023-10-14T12:20:01.011121+0000","last_active":"2023-10-14T12:20:01.011017+0000","last_peered":"2023-10-14T12:20:01.011017+0000","last_clean":"2023-10-14T12:20:01.011017+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:20:01.011017+0000","last_undegraded":"2023-10-14T12:20:01.011017+0000","last_fullsized":"2023-10-14T12:20:01.011017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.010896+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:52.744188+0000","scrub_duration":0.0018949170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.256992+0000","last_change":"2023-10-14T12:20:11.257086+0000","last_active":"2023-10-14T12:20:11.256992+0000","last_peered":"2023-10-14T12:20:11.256992+0000","last_clean":"2023-10-14T12:20:11.256992+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:20:11.256992+0000","last_undegraded":"2023-10-14T12:20:11.256992+0000","last_fullsized":"2023-10-14T12:20:11.256992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.256856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:59.991932+0000","scrub_duration":0.001750627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.985436+0000","last_change":"2023-10-14T12:20:04.985491+0000","last_active":"2023-10-14T12:20:04.985436+0000","last_peered":"2023-10-14T12:20:04.985436+0000","last_clean":"2023-10-14T12:20:04.985436+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:20:04.985436+0000","last_undegraded":"2023-10-14T12:20:04.985436+0000","last_fullsized":"2023-10-14T12:20:04.985436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.985328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:20.534941+0000","scrub_duration":0.0014889269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451271+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:45.451271+0000","last_peered":"2023-10-14T12:19:45.451271+0000","last_clean":"2023-10-14T12:19:45.451271+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:45.451271+0000","last_undegraded":"2023-10-14T12:19:45.451271+0000","last_fullsized":"2023-10-14T12:19:45.451271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:55.116402+0000","last_change":"2023-10-14T12:19:55.116473+0000","last_active":"2023-10-14T12:19:55.116402+0000","last_peered":"2023-10-14T12:19:55.116402+0000","last_clean":"2023-10-14T12:19:55.116402+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:55.116402+0000","last_undegraded":"2023-10-14T12:19:55.116402+0000","last_fullsized":"2023-10-14T12:19:55.116402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_clean_scrub_stamp":"2023-10-14T12:19:55.116311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:25.522965+0000","scrub_duration":0.0019265339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.175981+0000","last_change":"2023-10-14T12:20:13.176034+0000","last_active":"2023-10-14T12:20:13.175981+0000","last_peered":"2023-10-14T12:20:13.175981+0000","last_clean":"2023-10-14T12:20:13.175981+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:20:13.175981+0000","last_undegraded":"2023-10-14T12:20:13.175981+0000","last_fullsized":"2023-10-14T12:20:13.175981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.175828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:34.824982+0000","scrub_duration":0.0020181909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:59.061518+0000","last_change":"2023-10-14T12:19:59.061565+0000","last_active":"2023-10-14T12:19:59.061518+0000","last_peered":"2023-10-14T12:19:59.061518+0000","last_clean":"2023-10-14T12:19:59.061518+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:59.061518+0000","last_undegraded":"2023-10-14T12:19:59.061518+0000","last_fullsized":"2023-10-14T12:19:59.061518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_clean_scrub_stamp":"2023-10-14T12:19:59.061407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:19.122096+0000","scrub_duration":0.0015051039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250632+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:45.250632+0000","last_peered":"2023-10-14T12:19:45.250632+0000","last_clean":"2023-10-14T12:19:45.250632+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:45.250632+0000","last_undegraded":"2023-10-14T12:19:45.250632+0000","last_fullsized":"2023-10-14T12:19:45.250632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451405+0000","last_change":"2023-10-14T12:19:42.371643+0000","last_active":"2023-10-14T12:19:45.451405+0000","last_peered":"2023-10-14T12:19:45.451405+0000","last_clean":"2023-10-14T12:19:45.451405+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:19:45.451405+0000","last_undegraded":"2023-10-14T12:19:45.451405+0000","last_fullsized":"2023-10-14T12:19:45.451405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451267+0000","last_change":"2023-10-14T12:19:43.390837+0000","last_active":"2023-10-14T12:19:45.451267+0000","last_peered":"2023-10-14T12:19:45.451267+0000","last_clean":"2023-10-14T12:19:45.451267+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:19:45.451267+0000","last_undegraded":"2023-10-14T12:19:45.451267+0000","last_fullsized":"2023-10-14T12:19:45.451267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250598+0000","last_change":"2023-10-14T12:19:42.375560+0000","last_active":"2023-10-14T12:19:45.250598+0000","last_peered":"2023-10-14T12:19:45.250598+0000","last_clean":"2023-10-14T12:19:45.250598+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:19:45.250598+0000","last_undegraded":"2023-10-14T12:19:45.250598+0000","last_fullsized":"2023-10-14T12:19:45.250598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:41.346842+0000","last_clean_scrub_stamp":"2023-10-14T12:19:41.346842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.117751+0000","last_change":"2023-10-14T12:20:06.117804+0000","last_active":"2023-10-14T12:20:06.117751+0000","last_peered":"2023-10-14T12:20:06.117751+0000","last_clean":"2023-10-14T12:20:06.117751+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:20:06.117751+0000","last_undegraded":"2023-10-14T12:20:06.117751+0000","last_fullsized":"2023-10-14T12:20:06.117751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.117644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:32.686476+0000","scrub_duration":0.002186164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.913126+0000","last_change":"2023-10-14T12:19:57.913179+0000","last_active":"2023-10-14T12:19:57.913126+0000","last_peered":"2023-10-14T12:19:57.913126+0000","last_clean":"2023-10-14T12:19:57.913126+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:57.913126+0000","last_undegraded":"2023-10-14T12:19:57.913126+0000","last_fullsized":"2023-10-14T12:19:57.913126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.913003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:42:13.246060+0000","scrub_duration":0.001600925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.132634+0000","last_change":"2023-10-14T12:20:01.132718+0000","last_active":"2023-10-14T12:20:01.132634+0000","last_peered":"2023-10-14T12:20:01.132634+0000","last_clean":"2023-10-14T12:20:01.132634+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:20:01.132634+0000","last_undegraded":"2023-10-14T12:20:01.132634+0000","last_fullsized":"2023-10-14T12:20:01.132634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.132516+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:49.867592+0000","scrub_duration":0.0052765859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.41599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.628}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.439},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64500000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.50900000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.751}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.497},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.747},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.78500000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.66700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.55300000000000005}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.5},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.76400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.318},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.79800000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.78100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72399999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70999999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.752},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:20:19.070 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.070 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.071 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.071 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.072 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.072 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.072 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.073 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.073 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.074 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.074 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.075 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.075 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.075 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.076 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.076 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.077 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.077 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.077 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.078 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.078 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.079 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.079 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.080 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.081 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.081 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.082 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.083 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.083 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.084 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.085 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.085 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.086 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.086 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.087 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.087 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.087 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.088 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.089 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.089 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.090 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.090 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.091 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.091 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.094 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.095 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.095 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T12:19:41.346842+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:19.096 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:20:25.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:20:25.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:20:39.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:20:39.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.237+0000 7f467d261700 1 Processor -- start 2023-10-14T12:20:39.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 -- start start 2023-10-14T12:20:39.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f46780727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f467806c9b0 0x7f467806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f467815e1c0 0x7f467815e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467806d370 con 0x7f467815e1c0 2023-10-14T12:20:39.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4678071aa0 con 0x7f467806c9b0 2023-10-14T12:20:39.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f467d261700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467815f140 con 0x7f467815a580 2023-10-14T12:20:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.238+0000 7f46777fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f467815e1c0 0x7f467815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f467815e1c0 0x7f467815e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40376/0 (socket says 172.21.15.32:40376) 2023-10-14T12:20:39.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 -- 172.21.15.32:0/2329526312 learned_addr learned my addr 172.21.15.32:0/2329526312 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:20:39.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46767fc700 1 --2- 172.21.15.32:0/2329526312 >> v2:172.21.15.92:3300/0 conn(0x7f467806c9b0 0x7f467806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f4676ffd700 1 --2- 172.21.15.32:0/2329526312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f46780727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 -- 172.21.15.32:0/2329526312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 msgr2=0x7f46780727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:20:39.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 --2- 172.21.15.32:0/2329526312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f46780727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 -- 172.21.15.32:0/2329526312 >> v2:172.21.15.92:3300/0 conn(0x7f467806c9b0 msgr2=0x7f467806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:20:39.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 --2- 172.21.15.32:0/2329526312 >> v2:172.21.15.92:3300/0 conn(0x7f467806c9b0 0x7f467806ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 -- 172.21.15.32:0/2329526312 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467815eb90 con 0x7f467815e1c0 2023-10-14T12:20:39.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46767fc700 1 --2- 172.21.15.32:0/2329526312 >> v2:172.21.15.92:3300/0 conn(0x7f467806c9b0 0x7f467806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:20:39.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f46777fe700 1 --2- 172.21.15.32:0/2329526312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f467815e650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f467806ecc0 tx=0x7f467000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28668a6fa67bbf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:39.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f4675ffb700 1 -- 172.21.15.32:0/2329526312 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467000e070 con 0x7f467815e1c0 2023-10-14T12:20:39.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f4675ffb700 1 -- 172.21.15.32:0/2329526312 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000b9c0 con 0x7f467815e1c0 2023-10-14T12:20:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.239+0000 7f4675ffb700 1 -- 172.21.15.32:0/2329526312 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467000bd70 con 0x7f467815e1c0 2023-10-14T12:20:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 -- 172.21.15.32:0/2329526312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 msgr2=0x7f467815e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 --2- 172.21.15.32:0/2329526312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f467815e650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f467806ecc0 tx=0x7f467000b330 comp rx=0 tx=0).stop 2023-10-14T12:20:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 -- 172.21.15.32:0/2329526312 shutdown_connections 2023-10-14T12:20:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 --2- 172.21.15.32:0/2329526312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f467815e650 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 --2- 172.21.15.32:0/2329526312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f46780727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 --2- 172.21.15.32:0/2329526312 >> v2:172.21.15.92:3300/0 conn(0x7f467806c9b0 0x7f467806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 -- 172.21.15.32:0/2329526312 >> 172.21.15.32:0/2329526312 conn(0x7f467806afb0 msgr2=0x7f46780cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:20:39.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 -- 172.21.15.32:0/2329526312 shutdown_connections 2023-10-14T12:20:39.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.240+0000 7f467d261700 1 -- 172.21.15.32:0/2329526312 wait complete. 2023-10-14T12:20:39.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.241+0000 7f467d261700 1 Processor -- start 2023-10-14T12:20:39.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.241+0000 7f467d261700 1 -- start start 2023-10-14T12:20:39.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f467d261700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f467806c9b0 0x7f467815cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f467d261700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f4678164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f467d261700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f46781652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f467d261700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780cb4b0 con 0x7f467815e1c0 2023-10-14T12:20:39.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f467d261700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780ca930 con 0x7f467806c9b0 2023-10-14T12:20:39.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f467d261700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780cac10 con 0x7f467815a580 2023-10-14T12:20:39.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f46781652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f46781652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40382/0 (socket says 172.21.15.32:40382) 2023-10-14T12:20:39.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 -- 172.21.15.32:0/587876949 learned_addr learned my addr 172.21.15.32:0/587876949 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:20:39.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f4676ffd700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f467806c9b0 0x7f467815cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46767fc700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f4678164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 -- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 msgr2=0x7f4678164550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:39.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f4678164550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 -- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f467806c9b0 msgr2=0x7f467815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:39.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f467806c9b0 0x7f467815cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.242+0000 7f46777fe700 1 -- 172.21.15.32:0/587876949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670009b30 con 0x7f467815e1c0 2023-10-14T12:20:39.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.243+0000 7f46777fe700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f46781652f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f467806d620 tx=0x7f4670004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:39.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.243+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700099b0 con 0x7f467815e1c0 2023-10-14T12:20:39.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.243+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670004250 con 0x7f467815e1c0 2023-10-14T12:20:39.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.243+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46780caef0 con 0x7f467815e1c0 2023-10-14T12:20:39.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.243+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670004600 con 0x7f467815e1c0 2023-10-14T12:20:39.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.243+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46780ca5c0 con 0x7f467815e1c0 2023-10-14T12:20:39.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.244+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780c3aa0 con 0x7f467815e1c0 2023-10-14T12:20:39.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.244+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4670004760 con 0x7f467815e1c0 2023-10-14T12:20:39.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.245+0000 7f465f7fe700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f466406af00 0x7f466406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:39.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.245+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f467008a630 con 0x7f467815e1c0 2023-10-14T12:20:39.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.245+0000 7f4676ffd700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f466406af00 0x7f466406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:39.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.246+0000 7f4676ffd700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f466406af00 0x7f466406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f466c006b20 tx=0x7f466c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:39.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.249+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4670055750 con 0x7f467815e1c0 2023-10-14T12:20:39.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.449+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4678071cd0 con 0x7f466406af00 2023-10-14T12:20:39.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.458+0000 7f465f7fe700 1 -- 172.21.15.32:0/587876949 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289655 (secure 0 0 0) 0x7f466c009dc0 con 0x7f466406af00 2023-10-14T12:20:39.464 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:20:39.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f466406af00 msgr2=0x7f466406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:39.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f466406af00 0x7f466406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f466c006b20 tx=0x7f466c008040 comp rx=0 tx=0).stop 2023-10-14T12:20:39.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 msgr2=0x7f46781652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:39.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f46781652f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f467806d620 tx=0x7f4670004ad0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 shutdown_connections 2023-10-14T12:20:39.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467815e1c0 0x7f46781652f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f466406af00 0x7f466406d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f467806c9b0 0x7f467815cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 --2- 172.21.15.32:0/587876949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f467815a580 0x7f4678164550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:39.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 >> 172.21.15.32:0/587876949 conn(0x7f467806afb0 msgr2=0x7f46780c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:20:39.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 shutdown_connections 2023-10-14T12:20:39.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:39.462+0000 7f467d261700 1 -- 172.21.15.32:0/587876949 wait complete. 2023-10-14T12:20:39.470 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:20:39.475 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-10-14T12:20:39.123874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224328,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750392,"statfs":{"total":773094113280,"available":772864401408,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003302"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451222+0000","last_change":"2023-10-14T12:19:43.388378+0000","last_active":"2023-10-14T12:19:45.451222+0000","last_peered":"2023-10-14T12:19:45.451222+0000","last_clean":"2023-10-14T12:19:45.451222+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:19:45.451222+0000","last_undegraded":"2023-10-14T12:19:45.451222+0000","last_fullsized":"2023-10-14T12:19:45.451222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250778+0000","last_change":"2023-10-14T12:19:43.389091+0000","last_active":"2023-10-14T12:19:45.250778+0000","last_peered":"2023-10-14T12:19:45.250778+0000","last_clean":"2023-10-14T12:19:45.250778+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:19:45.250778+0000","last_undegraded":"2023-10-14T12:19:45.250778+0000","last_fullsized":"2023-10-14T12:19:45.250778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:20.557743+0000","last_change":"2023-10-14T12:20:20.557821+0000","last_active":"2023-10-14T12:20:20.557743+0000","last_peered":"2023-10-14T12:20:20.557743+0000","last_clean":"2023-10-14T12:20:20.557743+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:20:20.557743+0000","last_undegraded":"2023-10-14T12:20:20.557743+0000","last_fullsized":"2023-10-14T12:20:20.557743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:20.557621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:20.557621+0000","last_clean_scrub_stamp":"2023-10-14T12:20:20.557621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:12.490624+0000","scrub_duration":0.002131558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.000369+0000","last_change":"2023-10-14T12:20:13.000426+0000","last_active":"2023-10-14T12:20:13.000369+0000","last_peered":"2023-10-14T12:20:13.000369+0000","last_clean":"2023-10-14T12:20:13.000369+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:20:13.000369+0000","last_undegraded":"2023-10-14T12:20:13.000369+0000","last_fullsized":"2023-10-14T12:20:13.000369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.000229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:12:06.144509+0000","scrub_duration":0.0019750879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.168113+0000","last_change":"2023-10-14T12:20:09.168161+0000","last_active":"2023-10-14T12:20:09.168113+0000","last_peered":"2023-10-14T12:20:09.168113+0000","last_clean":"2023-10-14T12:20:09.168113+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:20:09.168113+0000","last_undegraded":"2023-10-14T12:20:09.168113+0000","last_fullsized":"2023-10-14T12:20:09.168113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.168000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:08.509845+0000","scrub_duration":0.001546331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250668+0000","last_change":"2023-10-14T12:19:43.385352+0000","last_active":"2023-10-14T12:19:45.250668+0000","last_peered":"2023-10-14T12:19:45.250668+0000","last_clean":"2023-10-14T12:19:45.250668+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:19:45.250668+0000","last_undegraded":"2023-10-14T12:19:45.250668+0000","last_fullsized":"2023-10-14T12:19:45.250668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.099856+0000","last_change":"2023-10-14T12:20:05.099899+0000","last_active":"2023-10-14T12:20:05.099856+0000","last_peered":"2023-10-14T12:20:05.099856+0000","last_clean":"2023-10-14T12:20:05.099856+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:20:05.099856+0000","last_undegraded":"2023-10-14T12:20:05.099856+0000","last_fullsized":"2023-10-14T12:20:05.099856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.099748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:03.711286+0000","scrub_duration":0.001409483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.155547+0000","last_change":"2023-10-14T12:20:03.155603+0000","last_active":"2023-10-14T12:20:03.155547+0000","last_peered":"2023-10-14T12:20:03.155547+0000","last_clean":"2023-10-14T12:20:03.155547+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:20:03.155547+0000","last_undegraded":"2023-10-14T12:20:03.155547+0000","last_fullsized":"2023-10-14T12:20:03.155547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:24.804563+0000","scrub_duration":0.001673566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:34.269244+0000","last_change":"2023-10-14T12:20:34.269329+0000","last_active":"2023-10-14T12:20:34.269244+0000","last_peered":"2023-10-14T12:20:34.269244+0000","last_clean":"2023-10-14T12:20:34.269244+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:20:34.269244+0000","last_undegraded":"2023-10-14T12:20:34.269244+0000","last_fullsized":"2023-10-14T12:20:34.269244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:34.269110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:34.269110+0000","last_clean_scrub_stamp":"2023-10-14T12:20:34.269110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:47.418608+0000","scrub_duration":0.0019946260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.009920+0000","last_change":"2023-10-14T12:20:12.009966+0000","last_active":"2023-10-14T12:20:12.009920+0000","last_peered":"2023-10-14T12:20:12.009920+0000","last_clean":"2023-10-14T12:20:12.009920+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:20:12.009920+0000","last_undegraded":"2023-10-14T12:20:12.009920+0000","last_fullsized":"2023-10-14T12:20:12.009920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.009806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:30.037499+0000","scrub_duration":0.0015351309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175530+0000","last_change":"2023-10-14T12:19:43.384985+0000","last_active":"2023-10-14T12:19:45.175530+0000","last_peered":"2023-10-14T12:19:45.175530+0000","last_clean":"2023-10-14T12:19:45.175530+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:19:45.175530+0000","last_undegraded":"2023-10-14T12:19:45.175530+0000","last_fullsized":"2023-10-14T12:19:45.175530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:26.531163+0000","last_change":"2023-10-14T12:20:26.531220+0000","last_active":"2023-10-14T12:20:26.531163+0000","last_peered":"2023-10-14T12:20:26.531163+0000","last_clean":"2023-10-14T12:20:26.531163+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:20:26.531163+0000","last_undegraded":"2023-10-14T12:20:26.531163+0000","last_fullsized":"2023-10-14T12:20:26.531163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:26.531030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:26.531030+0000","last_clean_scrub_stamp":"2023-10-14T12:20:26.531030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:06.572536+0000","scrub_duration":0.0019563380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.024673+0000","last_change":"2023-10-14T12:20:18.024718+0000","last_active":"2023-10-14T12:20:18.024673+0000","last_peered":"2023-10-14T12:20:18.024673+0000","last_clean":"2023-10-14T12:20:18.024673+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:20:18.024673+0000","last_undegraded":"2023-10-14T12:20:18.024673+0000","last_fullsized":"2023-10-14T12:20:18.024673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.024565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.024565+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.024565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:38.085254+0000","scrub_duration":0.0017125510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250679+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:45.250679+0000","last_peered":"2023-10-14T12:19:45.250679+0000","last_clean":"2023-10-14T12:19:45.250679+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:45.250679+0000","last_undegraded":"2023-10-14T12:19:45.250679+0000","last_fullsized":"2023-10-14T12:19:45.250679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.534302+0000","last_change":"2023-10-14T12:20:24.534379+0000","last_active":"2023-10-14T12:20:24.534302+0000","last_peered":"2023-10-14T12:20:24.534302+0000","last_clean":"2023-10-14T12:20:24.534302+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:20:24.534302+0000","last_undegraded":"2023-10-14T12:20:24.534302+0000","last_fullsized":"2023-10-14T12:20:24.534302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.534176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.534176+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.534176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:37.683674+0000","scrub_duration":0.0016716260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.193221+0000","last_change":"2023-10-14T12:20:18.193265+0000","last_active":"2023-10-14T12:20:18.193221+0000","last_peered":"2023-10-14T12:20:18.193221+0000","last_clean":"2023-10-14T12:20:18.193221+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:20:18.193221+0000","last_undegraded":"2023-10-14T12:20:18.193221+0000","last_fullsized":"2023-10-14T12:20:18.193221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.193108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.193108+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.193108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:59.870821+0000","scrub_duration":0.001714667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.180615+0000","last_change":"2023-10-14T12:20:09.180663+0000","last_active":"2023-10-14T12:20:09.180615+0000","last_peered":"2023-10-14T12:20:09.180615+0000","last_clean":"2023-10-14T12:20:09.180615+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:20:09.180615+0000","last_undegraded":"2023-10-14T12:20:09.180615+0000","last_fullsized":"2023-10-14T12:20:09.180615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.180502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:59:31.918129+0000","scrub_duration":0.001560082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250768+0000","last_change":"2023-10-14T12:19:43.383626+0000","last_active":"2023-10-14T12:19:45.250768+0000","last_peered":"2023-10-14T12:19:45.250768+0000","last_clean":"2023-10-14T12:19:45.250768+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:19:45.250768+0000","last_undegraded":"2023-10-14T12:19:45.250768+0000","last_fullsized":"2023-10-14T12:19:45.250768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250744+0000","last_change":"2023-10-14T12:19:43.385052+0000","last_active":"2023-10-14T12:19:45.250744+0000","last_peered":"2023-10-14T12:19:45.250744+0000","last_clean":"2023-10-14T12:19:45.250744+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:19:45.250744+0000","last_undegraded":"2023-10-14T12:19:45.250744+0000","last_fullsized":"2023-10-14T12:19:45.250744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:25.095733+0000","last_change":"2023-10-14T12:20:25.095813+0000","last_active":"2023-10-14T12:20:25.095733+0000","last_peered":"2023-10-14T12:20:25.095733+0000","last_clean":"2023-10-14T12:20:25.095733+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:20:25.095733+0000","last_undegraded":"2023-10-14T12:20:25.095733+0000","last_fullsized":"2023-10-14T12:20:25.095733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:25.095589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:25.095589+0000","last_clean_scrub_stamp":"2023-10-14T12:20:25.095589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:59.854820+0000","scrub_duration":0.0020046339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451618+0000","last_change":"2023-10-14T12:19:43.390924+0000","last_active":"2023-10-14T12:19:45.451618+0000","last_peered":"2023-10-14T12:19:45.451618+0000","last_clean":"2023-10-14T12:19:45.451618+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:19:45.451618+0000","last_undegraded":"2023-10-14T12:19:45.451618+0000","last_fullsized":"2023-10-14T12:19:45.451618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:25.158938+0000","last_change":"2023-10-14T12:20:25.159037+0000","last_active":"2023-10-14T12:20:25.158938+0000","last_peered":"2023-10-14T12:20:25.158938+0000","last_clean":"2023-10-14T12:20:25.158938+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:20:25.158938+0000","last_undegraded":"2023-10-14T12:20:25.158938+0000","last_fullsized":"2023-10-14T12:20:25.158938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:25.158825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:25.158825+0000","last_clean_scrub_stamp":"2023-10-14T12:20:25.158825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:17.644950+0000","scrub_duration":0.001945986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.151021+0000","last_change":"2023-10-14T12:20:07.151083+0000","last_active":"2023-10-14T12:20:07.151021+0000","last_peered":"2023-10-14T12:20:07.151021+0000","last_clean":"2023-10-14T12:20:07.151021+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:20:07.151021+0000","last_undegraded":"2023-10-14T12:20:07.151021+0000","last_fullsized":"2023-10-14T12:20:07.151021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.150921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.119523+0000","scrub_duration":0.002059576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.565408+0000","last_change":"2023-10-14T12:20:06.565489+0000","last_active":"2023-10-14T12:20:06.565408+0000","last_peered":"2023-10-14T12:20:06.565408+0000","last_clean":"2023-10-14T12:20:06.565408+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:20:06.565408+0000","last_undegraded":"2023-10-14T12:20:06.565408+0000","last_fullsized":"2023-10-14T12:20:06.565408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.565268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:58.810087+0000","scrub_duration":0.0023384180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.999329+0000","last_change":"2023-10-14T12:20:13.999395+0000","last_active":"2023-10-14T12:20:13.999329+0000","last_peered":"2023-10-14T12:20:13.999329+0000","last_clean":"2023-10-14T12:20:13.999329+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:20:13.999329+0000","last_undegraded":"2023-10-14T12:20:13.999329+0000","last_fullsized":"2023-10-14T12:20:13.999329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.999218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:37.632861+0000","scrub_duration":0.001812021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.983720+0000","last_change":"2023-10-14T12:19:58.983768+0000","last_active":"2023-10-14T12:19:58.983720+0000","last_peered":"2023-10-14T12:19:58.983720+0000","last_clean":"2023-10-14T12:19:58.983720+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:58.983720+0000","last_undegraded":"2023-10-14T12:19:58.983720+0000","last_fullsized":"2023-10-14T12:19:58.983720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.983621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:20.632775+0000","scrub_duration":0.0017119399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:19.977932+0000","last_change":"2023-10-14T12:20:19.978012+0000","last_active":"2023-10-14T12:20:19.977932+0000","last_peered":"2023-10-14T12:20:19.977932+0000","last_clean":"2023-10-14T12:20:19.977932+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:20:19.977932+0000","last_undegraded":"2023-10-14T12:20:19.977932+0000","last_fullsized":"2023-10-14T12:20:19.977932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:19.977782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:19.977782+0000","last_clean_scrub_stamp":"2023-10-14T12:20:19.977782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.759071+0000","scrub_duration":0.0022331830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:23.545929+0000","last_change":"2023-10-14T12:20:23.545994+0000","last_active":"2023-10-14T12:20:23.545929+0000","last_peered":"2023-10-14T12:20:23.545929+0000","last_clean":"2023-10-14T12:20:23.545929+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:20:23.545929+0000","last_undegraded":"2023-10-14T12:20:23.545929+0000","last_fullsized":"2023-10-14T12:20:23.545929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:23.545804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:23.545804+0000","last_clean_scrub_stamp":"2023-10-14T12:20:23.545804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:24.857034+0000","scrub_duration":0.0019879759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:29.245958+0000","last_change":"2023-10-14T12:20:29.246006+0000","last_active":"2023-10-14T12:20:29.245958+0000","last_peered":"2023-10-14T12:20:29.245958+0000","last_clean":"2023-10-14T12:20:29.245958+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:20:29.245958+0000","last_undegraded":"2023-10-14T12:20:29.245958+0000","last_fullsized":"2023-10-14T12:20:29.245958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:29.245840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:29.245840+0000","last_clean_scrub_stamp":"2023-10-14T12:20:29.245840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:35.737169+0000","scrub_duration":0.0020797989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.175473+0000","last_change":"2023-10-14T12:19:43.384348+0000","last_active":"2023-10-14T12:19:45.175473+0000","last_peered":"2023-10-14T12:19:45.175473+0000","last_clean":"2023-10-14T12:19:45.175473+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:19:45.175473+0000","last_undegraded":"2023-10-14T12:19:45.175473+0000","last_fullsized":"2023-10-14T12:19:45.175473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:29.788984+0000","last_change":"2023-10-14T12:20:29.789036+0000","last_active":"2023-10-14T12:20:29.788984+0000","last_peered":"2023-10-14T12:20:29.788984+0000","last_clean":"2023-10-14T12:20:29.788984+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:20:29.788984+0000","last_undegraded":"2023-10-14T12:20:29.788984+0000","last_fullsized":"2023-10-14T12:20:29.788984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:29.788879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:29.788879+0000","last_clean_scrub_stamp":"2023-10-14T12:20:29.788879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:53.905606+0000","scrub_duration":0.0020435869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:23.079067+0000","last_change":"2023-10-14T12:20:23.079118+0000","last_active":"2023-10-14T12:20:23.079067+0000","last_peered":"2023-10-14T12:20:23.079067+0000","last_clean":"2023-10-14T12:20:23.079067+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:20:23.079067+0000","last_undegraded":"2023-10-14T12:20:23.079067+0000","last_fullsized":"2023-10-14T12:20:23.079067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:23.078951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:23.078951+0000","last_clean_scrub_stamp":"2023-10-14T12:20:23.078951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:15.011954+0000","scrub_duration":0.0015491680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.178018+0000","last_change":"2023-10-14T12:20:15.178066+0000","last_active":"2023-10-14T12:20:15.178018+0000","last_peered":"2023-10-14T12:20:15.178018+0000","last_clean":"2023-10-14T12:20:15.178018+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:20:15.178018+0000","last_undegraded":"2023-10-14T12:20:15.178018+0000","last_fullsized":"2023-10-14T12:20:15.178018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.177907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:13.789446+0000","scrub_duration":0.0021094970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.863385+0000","last_change":"2023-10-14T12:20:24.863447+0000","last_active":"2023-10-14T12:20:24.863385+0000","last_peered":"2023-10-14T12:20:24.863385+0000","last_clean":"2023-10-14T12:20:24.863385+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:20:24.863385+0000","last_undegraded":"2023-10-14T12:20:24.863385+0000","last_fullsized":"2023-10-14T12:20:24.863385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-10-14T12:20:24.863277+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-10-14T12:20:24.863277+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.863277+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:44.527722+0000","scrub_duration":0.0040846679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451289+0000","last_change":"2023-10-14T12:19:43.389880+0000","last_active":"2023-10-14T12:19:45.451289+0000","last_peered":"2023-10-14T12:19:45.451289+0000","last_clean":"2023-10-14T12:19:45.451289+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:19:45.451289+0000","last_undegraded":"2023-10-14T12:19:45.451289+0000","last_fullsized":"2023-10-14T12:19:45.451289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.072983+0000","last_change":"2023-10-14T12:20:05.073083+0000","last_active":"2023-10-14T12:20:05.072983+0000","last_peered":"2023-10-14T12:20:05.072983+0000","last_clean":"2023-10-14T12:20:05.072983+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:20:05.072983+0000","last_undegraded":"2023-10-14T12:20:05.072983+0000","last_fullsized":"2023-10-14T12:20:05.072983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.072872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:01.324353+0000","scrub_duration":0.0018346199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:27.162635+0000","last_change":"2023-10-14T12:20:27.162691+0000","last_active":"2023-10-14T12:20:27.162635+0000","last_peered":"2023-10-14T12:20:27.162635+0000","last_clean":"2023-10-14T12:20:27.162635+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:20:27.162635+0000","last_undegraded":"2023-10-14T12:20:27.162635+0000","last_fullsized":"2023-10-14T12:20:27.162635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:27.162528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:27.162528+0000","last_clean_scrub_stamp":"2023-10-14T12:20:27.162528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:37.690610+0000","scrub_duration":0.001882274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.917181+0000","last_change":"2023-10-14T12:20:04.917281+0000","last_active":"2023-10-14T12:20:04.917181+0000","last_peered":"2023-10-14T12:20:04.917181+0000","last_clean":"2023-10-14T12:20:04.917181+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:20:04.917181+0000","last_undegraded":"2023-10-14T12:20:04.917181+0000","last_fullsized":"2023-10-14T12:20:04.917181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.917043+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:22.944736+0000","scrub_duration":0.0021985300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.960780+0000","last_change":"2023-10-14T12:20:18.960862+0000","last_active":"2023-10-14T12:20:18.960780+0000","last_peered":"2023-10-14T12:20:18.960780+0000","last_clean":"2023-10-14T12:20:18.960780+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:20:18.960780+0000","last_undegraded":"2023-10-14T12:20:18.960780+0000","last_fullsized":"2023-10-14T12:20:18.960780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.960681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.960681+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.960681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:25.452010+0000","scrub_duration":0.001547671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:56.143539+0000","last_change":"2023-10-14T12:19:56.143579+0000","last_active":"2023-10-14T12:19:56.143539+0000","last_peered":"2023-10-14T12:19:56.143539+0000","last_clean":"2023-10-14T12:19:56.143539+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:56.143539+0000","last_undegraded":"2023-10-14T12:19:56.143539+0000","last_fullsized":"2023-10-14T12:19:56.143539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_clean_scrub_stamp":"2023-10-14T12:19:56.143469+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:45.317148+0000","scrub_duration":0.0014353720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.169240+0000","last_change":"2023-10-14T12:20:12.169285+0000","last_active":"2023-10-14T12:20:12.169240+0000","last_peered":"2023-10-14T12:20:12.169240+0000","last_clean":"2023-10-14T12:20:12.169240+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:20:12.169240+0000","last_undegraded":"2023-10-14T12:20:12.169240+0000","last_fullsized":"2023-10-14T12:20:12.169240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.169111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:40.089199+0000","scrub_duration":0.001529844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.075374+0000","last_change":"2023-10-14T12:20:00.075474+0000","last_active":"2023-10-14T12:20:00.075374+0000","last_peered":"2023-10-14T12:20:00.075374+0000","last_clean":"2023-10-14T12:20:00.075374+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:20:00.075374+0000","last_undegraded":"2023-10-14T12:20:00.075374+0000","last_fullsized":"2023-10-14T12:20:00.075374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.075202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:24.888838+0000","scrub_duration":0.0020269469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.582106+0000","last_change":"2023-10-14T12:20:07.582203+0000","last_active":"2023-10-14T12:20:07.582106+0000","last_peered":"2023-10-14T12:20:07.582106+0000","last_clean":"2023-10-14T12:20:07.582106+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:20:07.582106+0000","last_undegraded":"2023-10-14T12:20:07.582106+0000","last_fullsized":"2023-10-14T12:20:07.582106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.581991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:25.609684+0000","scrub_duration":0.0024689830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.036968+0000","last_change":"2023-10-14T12:20:07.037030+0000","last_active":"2023-10-14T12:20:07.036968+0000","last_peered":"2023-10-14T12:20:07.036968+0000","last_clean":"2023-10-14T12:20:07.036968+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:20:07.036968+0000","last_undegraded":"2023-10-14T12:20:07.036968+0000","last_fullsized":"2023-10-14T12:20:07.036968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.036858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:03.288339+0000","scrub_duration":0.0028120160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.180648+0000","last_change":"2023-10-14T12:20:24.180746+0000","last_active":"2023-10-14T12:20:24.180648+0000","last_peered":"2023-10-14T12:20:24.180648+0000","last_clean":"2023-10-14T12:20:24.180648+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:20:24.180648+0000","last_undegraded":"2023-10-14T12:20:24.180648+0000","last_fullsized":"2023-10-14T12:20:24.180648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.180507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.180507+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.180507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:52.100595+0000","scrub_duration":0.001566139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.918650+0000","last_change":"2023-10-14T12:20:02.918708+0000","last_active":"2023-10-14T12:20:02.918650+0000","last_peered":"2023-10-14T12:20:02.918650+0000","last_clean":"2023-10-14T12:20:02.918650+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:20:02.918650+0000","last_undegraded":"2023-10-14T12:20:02.918650+0000","last_fullsized":"2023-10-14T12:20:02.918650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.918526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:31.370887+0000","scrub_duration":0.0015505899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:17.017122+0000","last_change":"2023-10-14T12:20:17.017174+0000","last_active":"2023-10-14T12:20:17.017122+0000","last_peered":"2023-10-14T12:20:17.017122+0000","last_clean":"2023-10-14T12:20:17.017122+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:20:17.017122+0000","last_undegraded":"2023-10-14T12:20:17.017122+0000","last_fullsized":"2023-10-14T12:20:17.017122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:17.016992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:17.016992+0000","last_clean_scrub_stamp":"2023-10-14T12:20:17.016992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:58.694705+0000","scrub_duration":0.0018999450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.087258+0000","last_change":"2023-10-14T12:20:02.087309+0000","last_active":"2023-10-14T12:20:02.087258+0000","last_peered":"2023-10-14T12:20:02.087258+0000","last_clean":"2023-10-14T12:20:02.087258+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:20:02.087258+0000","last_undegraded":"2023-10-14T12:20:02.087258+0000","last_fullsized":"2023-10-14T12:20:02.087258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.087127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.572933+0000","scrub_duration":0.001469337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.549309+0000","last_change":"2023-10-14T12:20:13.549409+0000","last_active":"2023-10-14T12:20:13.549309+0000","last_peered":"2023-10-14T12:20:13.549309+0000","last_clean":"2023-10-14T12:20:13.549309+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:20:13.549309+0000","last_undegraded":"2023-10-14T12:20:13.549309+0000","last_fullsized":"2023-10-14T12:20:13.549309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.549155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:06.035279+0000","scrub_duration":0.0019478570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.817693+0000","last_change":"2023-10-14T12:20:12.817784+0000","last_active":"2023-10-14T12:20:12.817693+0000","last_peered":"2023-10-14T12:20:12.817693+0000","last_clean":"2023-10-14T12:20:12.817693+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:20:12.817693+0000","last_undegraded":"2023-10-14T12:20:12.817693+0000","last_fullsized":"2023-10-14T12:20:12.817693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.817563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:51.379754+0000","scrub_duration":0.002143697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250823+0000","last_change":"2023-10-14T12:19:43.383569+0000","last_active":"2023-10-14T12:19:45.250823+0000","last_peered":"2023-10-14T12:19:45.250823+0000","last_clean":"2023-10-14T12:19:45.250823+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:19:45.250823+0000","last_undegraded":"2023-10-14T12:19:45.250823+0000","last_fullsized":"2023-10-14T12:19:45.250823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.014408+0000","last_change":"2023-10-14T12:20:02.014482+0000","last_active":"2023-10-14T12:20:02.014408+0000","last_peered":"2023-10-14T12:20:02.014408+0000","last_clean":"2023-10-14T12:20:02.014408+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:20:02.014408+0000","last_undegraded":"2023-10-14T12:20:02.014408+0000","last_fullsized":"2023-10-14T12:20:02.014408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.014280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.500085+0000","scrub_duration":0.0016626200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.875859+0000","last_change":"2023-10-14T12:20:22.875915+0000","last_active":"2023-10-14T12:20:22.875859+0000","last_peered":"2023-10-14T12:20:22.875859+0000","last_clean":"2023-10-14T12:20:22.875859+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:20:22.875859+0000","last_undegraded":"2023-10-14T12:20:22.875859+0000","last_fullsized":"2023-10-14T12:20:22.875859+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.875723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.875723+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.875723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:11.908494+0000","scrub_duration":0.002186679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.528241+0000","last_change":"2023-10-14T12:20:04.528351+0000","last_active":"2023-10-14T12:20:04.528241+0000","last_peered":"2023-10-14T12:20:04.528241+0000","last_clean":"2023-10-14T12:20:04.528241+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:20:04.528241+0000","last_undegraded":"2023-10-14T12:20:04.528241+0000","last_fullsized":"2023-10-14T12:20:04.528241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.528122+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:18.750282+0000","scrub_duration":0.0023976879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.568245+0000","last_change":"2023-10-14T12:20:22.568321+0000","last_active":"2023-10-14T12:20:22.568245+0000","last_peered":"2023-10-14T12:20:22.568245+0000","last_clean":"2023-10-14T12:20:22.568245+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:20:22.568245+0000","last_undegraded":"2023-10-14T12:20:22.568245+0000","last_fullsized":"2023-10-14T12:20:22.568245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.568140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.568140+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.568140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:34.165608+0000","scrub_duration":0.0021438989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.846992+0000","last_change":"2023-10-14T12:20:07.847108+0000","last_active":"2023-10-14T12:20:07.846992+0000","last_peered":"2023-10-14T12:20:07.846992+0000","last_clean":"2023-10-14T12:20:07.846992+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:20:07.846992+0000","last_undegraded":"2023-10-14T12:20:07.846992+0000","last_fullsized":"2023-10-14T12:20:07.846992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.846867+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:35.766956+0000","scrub_duration":0.002747167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.013554+0000","last_change":"2023-10-14T12:20:06.013605+0000","last_active":"2023-10-14T12:20:06.013554+0000","last_peered":"2023-10-14T12:20:06.013554+0000","last_clean":"2023-10-14T12:20:06.013554+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:20:06.013554+0000","last_undegraded":"2023-10-14T12:20:06.013554+0000","last_fullsized":"2023-10-14T12:20:06.013554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.013441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:04.624980+0000","scrub_duration":0.002025139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:08.025935+0000","last_change":"2023-10-14T12:20:08.025994+0000","last_active":"2023-10-14T12:20:08.025935+0000","last_peered":"2023-10-14T12:20:08.025935+0000","last_clean":"2023-10-14T12:20:08.025935+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:20:08.025935+0000","last_undegraded":"2023-10-14T12:20:08.025935+0000","last_fullsized":"2023-10-14T12:20:08.025935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_clean_scrub_stamp":"2023-10-14T12:20:08.025791+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.994394+0000","scrub_duration":0.0024040939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.847004+0000","last_change":"2023-10-14T12:20:24.847078+0000","last_active":"2023-10-14T12:20:24.847004+0000","last_peered":"2023-10-14T12:20:24.847004+0000","last_clean":"2023-10-14T12:20:24.847004+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:20:24.847004+0000","last_undegraded":"2023-10-14T12:20:24.847004+0000","last_fullsized":"2023-10-14T12:20:24.847004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.846839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.846839+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.846839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:32.412890+0000","scrub_duration":0.0017280290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.970221+0000","last_change":"2023-10-14T12:20:01.970277+0000","last_active":"2023-10-14T12:20:01.970221+0000","last_peered":"2023-10-14T12:20:01.970221+0000","last_clean":"2023-10-14T12:20:01.970221+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:20:01.970221+0000","last_undegraded":"2023-10-14T12:20:01.970221+0000","last_fullsized":"2023-10-14T12:20:01.970221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.970091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:36.729323+0000","scrub_duration":0.0019624059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:33.196839+0000","last_change":"2023-10-14T12:20:33.196904+0000","last_active":"2023-10-14T12:20:33.196839+0000","last_peered":"2023-10-14T12:20:33.196839+0000","last_clean":"2023-10-14T12:20:33.196839+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:20:33.196839+0000","last_undegraded":"2023-10-14T12:20:33.196839+0000","last_fullsized":"2023-10-14T12:20:33.196839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:33.196723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:33.196723+0000","last_clean_scrub_stamp":"2023-10-14T12:20:33.196723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:22.229493+0000","scrub_duration":0.0016797069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:16.786277+0000","last_change":"2023-10-14T12:20:16.786385+0000","last_active":"2023-10-14T12:20:16.786277+0000","last_peered":"2023-10-14T12:20:16.786277+0000","last_clean":"2023-10-14T12:20:16.786277+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:20:16.786277+0000","last_undegraded":"2023-10-14T12:20:16.786277+0000","last_fullsized":"2023-10-14T12:20:16.786277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:16.786137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:16.786137+0000","last_clean_scrub_stamp":"2023-10-14T12:20:16.786137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:47.081621+0000","scrub_duration":0.0022144949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451177+0000","last_change":"2023-10-14T12:19:43.391786+0000","last_active":"2023-10-14T12:19:45.451177+0000","last_peered":"2023-10-14T12:19:45.451177+0000","last_clean":"2023-10-14T12:19:45.451177+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:19:45.451177+0000","last_undegraded":"2023-10-14T12:19:45.451177+0000","last_fullsized":"2023-10-14T12:19:45.451177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.941556+0000","last_change":"2023-10-14T12:20:00.941615+0000","last_active":"2023-10-14T12:20:00.941556+0000","last_peered":"2023-10-14T12:20:00.941556+0000","last_clean":"2023-10-14T12:20:00.941556+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:20:00.941556+0000","last_undegraded":"2023-10-14T12:20:00.941556+0000","last_fullsized":"2023-10-14T12:20:00.941556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.941417+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:15.163577+0000","scrub_duration":0.0026495780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:32.331437+0000","last_change":"2023-10-14T12:20:32.331481+0000","last_active":"2023-10-14T12:20:32.331437+0000","last_peered":"2023-10-14T12:20:32.331437+0000","last_clean":"2023-10-14T12:20:32.331437+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:20:32.331437+0000","last_undegraded":"2023-10-14T12:20:32.331437+0000","last_fullsized":"2023-10-14T12:20:32.331437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:32.331320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:32.331320+0000","last_clean_scrub_stamp":"2023-10-14T12:20:32.331320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:21.364091+0000","scrub_duration":0.0015082679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.923380+0000","last_change":"2023-10-14T12:20:02.923480+0000","last_active":"2023-10-14T12:20:02.923380+0000","last_peered":"2023-10-14T12:20:02.923380+0000","last_clean":"2023-10-14T12:20:02.923380+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:20:02.923380+0000","last_undegraded":"2023-10-14T12:20:02.923380+0000","last_fullsized":"2023-10-14T12:20:02.923380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.923263+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:27.039989+0000","scrub_duration":0.002081308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.512160+0000","last_change":"2023-10-14T12:20:11.512210+0000","last_active":"2023-10-14T12:20:11.512160+0000","last_peered":"2023-10-14T12:20:11.512160+0000","last_clean":"2023-10-14T12:20:11.512160+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:20:11.512160+0000","last_undegraded":"2023-10-14T12:20:11.512160+0000","last_fullsized":"2023-10-14T12:20:11.512160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.512033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:39.432121+0000","scrub_duration":0.001569207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.053293+0000","last_change":"2023-10-14T12:20:12.053387+0000","last_active":"2023-10-14T12:20:12.053293+0000","last_peered":"2023-10-14T12:20:12.053293+0000","last_clean":"2023-10-14T12:20:12.053293+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:20:12.053293+0000","last_undegraded":"2023-10-14T12:20:12.053293+0000","last_fullsized":"2023-10-14T12:20:12.053293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.053179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:27:00.788255+0000","scrub_duration":0.001905143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:10.038313+0000","last_change":"2023-10-14T12:20:10.038364+0000","last_active":"2023-10-14T12:20:10.038313+0000","last_peered":"2023-10-14T12:20:10.038313+0000","last_clean":"2023-10-14T12:20:10.038313+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:20:10.038313+0000","last_undegraded":"2023-10-14T12:20:10.038313+0000","last_fullsized":"2023-10-14T12:20:10.038313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_clean_scrub_stamp":"2023-10-14T12:20:10.038190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:02.283009+0000","scrub_duration":0.0020200909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:17.073907+0000","last_change":"2023-10-14T12:20:17.074004+0000","last_active":"2023-10-14T12:20:17.073907+0000","last_peered":"2023-10-14T12:20:17.073907+0000","last_clean":"2023-10-14T12:20:17.073907+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:20:17.073907+0000","last_undegraded":"2023-10-14T12:20:17.073907+0000","last_fullsized":"2023-10-14T12:20:17.073907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-14T12:20:17.073763+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-14T12:20:17.073763+0000","last_clean_scrub_stamp":"2023-10-14T12:20:17.073763+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.295923+0000","scrub_duration":0.0037557010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.125144+0000","last_change":"2023-10-14T12:20:04.125193+0000","last_active":"2023-10-14T12:20:04.125144+0000","last_peered":"2023-10-14T12:20:04.125144+0000","last_clean":"2023-10-14T12:20:04.125144+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:20:04.125144+0000","last_undegraded":"2023-10-14T12:20:04.125144+0000","last_fullsized":"2023-10-14T12:20:04.125144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.125041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:29.907915+0000","scrub_duration":0.0022271499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.070420+0000","last_change":"2023-10-14T12:20:18.070489+0000","last_active":"2023-10-14T12:20:18.070420+0000","last_peered":"2023-10-14T12:20:18.070420+0000","last_clean":"2023-10-14T12:20:18.070420+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:20:18.070420+0000","last_undegraded":"2023-10-14T12:20:18.070420+0000","last_fullsized":"2023-10-14T12:20:18.070420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.070307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.070307+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.070307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:10.315126+0000","scrub_duration":0.001942086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.172564+0000","last_change":"2023-10-14T12:20:06.172642+0000","last_active":"2023-10-14T12:20:06.172564+0000","last_peered":"2023-10-14T12:20:06.172564+0000","last_clean":"2023-10-14T12:20:06.172564+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:20:06.172564+0000","last_undegraded":"2023-10-14T12:20:06.172564+0000","last_fullsized":"2023-10-14T12:20:06.172564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.172417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:47:16.064813+0000","scrub_duration":0.0020790610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.074695+0000","last_change":"2023-10-14T12:19:57.074734+0000","last_active":"2023-10-14T12:19:57.074695+0000","last_peered":"2023-10-14T12:19:57.074695+0000","last_clean":"2023-10-14T12:19:57.074695+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:57.074695+0000","last_undegraded":"2023-10-14T12:19:57.074695+0000","last_fullsized":"2023-10-14T12:19:57.074695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.074602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:15.118672+0000","scrub_duration":0.0016862929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:14.067511+0000","last_change":"2023-10-14T12:20:14.067566+0000","last_active":"2023-10-14T12:20:14.067511+0000","last_peered":"2023-10-14T12:20:14.067511+0000","last_clean":"2023-10-14T12:20:14.067511+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:20:14.067511+0000","last_undegraded":"2023-10-14T12:20:14.067511+0000","last_fullsized":"2023-10-14T12:20:14.067511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_clean_scrub_stamp":"2023-10-14T12:20:14.067382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:22:05.800674+0000","scrub_duration":0.0016258220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.768858+0000","last_change":"2023-10-14T12:20:15.768905+0000","last_active":"2023-10-14T12:20:15.768858+0000","last_peered":"2023-10-14T12:20:15.768858+0000","last_clean":"2023-10-14T12:20:15.768858+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:20:15.768858+0000","last_undegraded":"2023-10-14T12:20:15.768858+0000","last_fullsized":"2023-10-14T12:20:15.768858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.768735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.768735+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.768735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:40.582371+0000","scrub_duration":0.001862566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.201319+0000","last_change":"2023-10-14T12:20:02.201368+0000","last_active":"2023-10-14T12:20:02.201319+0000","last_peered":"2023-10-14T12:20:02.201319+0000","last_clean":"2023-10-14T12:20:02.201319+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:20:02.201319+0000","last_undegraded":"2023-10-14T12:20:02.201319+0000","last_fullsized":"2023-10-14T12:20:02.201319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.201208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:54.774214+0000","scrub_duration":0.001588955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:16.062592+0000","last_change":"2023-10-14T12:20:16.062632+0000","last_active":"2023-10-14T12:20:16.062592+0000","last_peered":"2023-10-14T12:20:16.062592+0000","last_clean":"2023-10-14T12:20:16.062592+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:20:16.062592+0000","last_undegraded":"2023-10-14T12:20:16.062592+0000","last_fullsized":"2023-10-14T12:20:16.062592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:16.062457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:16.062457+0000","last_clean_scrub_stamp":"2023-10-14T12:20:16.062457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:37.711611+0000","scrub_duration":0.00184312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:34.205648+0000","last_change":"2023-10-14T12:20:34.205693+0000","last_active":"2023-10-14T12:20:34.205648+0000","last_peered":"2023-10-14T12:20:34.205648+0000","last_clean":"2023-10-14T12:20:34.205648+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:20:34.205648+0000","last_undegraded":"2023-10-14T12:20:34.205648+0000","last_fullsized":"2023-10-14T12:20:34.205648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:34.205532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:34.205532+0000","last_clean_scrub_stamp":"2023-10-14T12:20:34.205532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:41.771583+0000","scrub_duration":0.0015735370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.463746+0000","last_change":"2023-10-14T12:19:58.463793+0000","last_active":"2023-10-14T12:19:58.463746+0000","last_peered":"2023-10-14T12:19:58.463746+0000","last_clean":"2023-10-14T12:19:58.463746+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:58.463746+0000","last_undegraded":"2023-10-14T12:19:58.463746+0000","last_fullsized":"2023-10-14T12:19:58.463746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.463596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:47.198672+0000","scrub_duration":0.001612559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.156060+0000","last_change":"2023-10-14T12:20:03.156105+0000","last_active":"2023-10-14T12:20:03.156060+0000","last_peered":"2023-10-14T12:20:03.156060+0000","last_clean":"2023-10-14T12:20:03.156060+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:20:03.156060+0000","last_undegraded":"2023-10-14T12:20:03.156060+0000","last_fullsized":"2023-10-14T12:20:03.156060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:17.386190+0000","scrub_duration":0.0016035590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.968254+0000","last_change":"2023-10-14T12:20:03.968370+0000","last_active":"2023-10-14T12:20:03.968254+0000","last_peered":"2023-10-14T12:20:03.968254+0000","last_clean":"2023-10-14T12:20:03.968254+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:20:03.968254+0000","last_undegraded":"2023-10-14T12:20:03.968254+0000","last_fullsized":"2023-10-14T12:20:03.968254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.968116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:36.443571+0000","scrub_duration":0.0026487759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.570382+0000","last_change":"2023-10-14T12:20:15.570427+0000","last_active":"2023-10-14T12:20:15.570382+0000","last_peered":"2023-10-14T12:20:15.570382+0000","last_clean":"2023-10-14T12:20:15.570382+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:20:15.570382+0000","last_undegraded":"2023-10-14T12:20:15.570382+0000","last_fullsized":"2023-10-14T12:20:15.570382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.570262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.570262+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.570262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:26.098345+0000","scrub_duration":0.0020248649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.011017+0000","last_change":"2023-10-14T12:20:01.011121+0000","last_active":"2023-10-14T12:20:01.011017+0000","last_peered":"2023-10-14T12:20:01.011017+0000","last_clean":"2023-10-14T12:20:01.011017+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:20:01.011017+0000","last_undegraded":"2023-10-14T12:20:01.011017+0000","last_fullsized":"2023-10-14T12:20:01.011017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.010896+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:52.744188+0000","scrub_duration":0.0018949170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.256992+0000","last_change":"2023-10-14T12:20:11.257086+0000","last_active":"2023-10-14T12:20:11.256992+0000","last_peered":"2023-10-14T12:20:11.256992+0000","last_clean":"2023-10-14T12:20:11.256992+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:20:11.256992+0000","last_undegraded":"2023-10-14T12:20:11.256992+0000","last_fullsized":"2023-10-14T12:20:11.256992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.256856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:59.991932+0000","scrub_duration":0.001750627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.985436+0000","last_change":"2023-10-14T12:20:04.985491+0000","last_active":"2023-10-14T12:20:04.985436+0000","last_peered":"2023-10-14T12:20:04.985436+0000","last_clean":"2023-10-14T12:20:04.985436+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:20:04.985436+0000","last_undegraded":"2023-10-14T12:20:04.985436+0000","last_fullsized":"2023-10-14T12:20:04.985436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.985328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:20.534941+0000","scrub_duration":0.0014889269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.451271+0000","last_change":"2023-10-14T12:19:43.389458+0000","last_active":"2023-10-14T12:19:45.451271+0000","last_peered":"2023-10-14T12:19:45.451271+0000","last_clean":"2023-10-14T12:19:45.451271+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:19:45.451271+0000","last_undegraded":"2023-10-14T12:19:45.451271+0000","last_fullsized":"2023-10-14T12:19:45.451271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:55.116402+0000","last_change":"2023-10-14T12:19:55.116473+0000","last_active":"2023-10-14T12:19:55.116402+0000","last_peered":"2023-10-14T12:19:55.116402+0000","last_clean":"2023-10-14T12:19:55.116402+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:55.116402+0000","last_undegraded":"2023-10-14T12:19:55.116402+0000","last_fullsized":"2023-10-14T12:19:55.116402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_clean_scrub_stamp":"2023-10-14T12:19:55.116311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:25.522965+0000","scrub_duration":0.0019265339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.175981+0000","last_change":"2023-10-14T12:20:13.176034+0000","last_active":"2023-10-14T12:20:13.175981+0000","last_peered":"2023-10-14T12:20:13.175981+0000","last_clean":"2023-10-14T12:20:13.175981+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:20:13.175981+0000","last_undegraded":"2023-10-14T12:20:13.175981+0000","last_fullsized":"2023-10-14T12:20:13.175981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.175828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:34.824982+0000","scrub_duration":0.0020181909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:59.061518+0000","last_change":"2023-10-14T12:19:59.061565+0000","last_active":"2023-10-14T12:19:59.061518+0000","last_peered":"2023-10-14T12:19:59.061518+0000","last_clean":"2023-10-14T12:19:59.061518+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:59.061518+0000","last_undegraded":"2023-10-14T12:19:59.061518+0000","last_fullsized":"2023-10-14T12:19:59.061518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_clean_scrub_stamp":"2023-10-14T12:19:59.061407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:19.122096+0000","scrub_duration":0.0015051039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250632+0000","last_change":"2023-10-14T12:19:43.382166+0000","last_active":"2023-10-14T12:19:45.250632+0000","last_peered":"2023-10-14T12:19:45.250632+0000","last_clean":"2023-10-14T12:19:45.250632+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:19:45.250632+0000","last_undegraded":"2023-10-14T12:19:45.250632+0000","last_fullsized":"2023-10-14T12:19:45.250632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.131386+0000","last_change":"2023-10-14T12:20:22.131442+0000","last_active":"2023-10-14T12:20:22.131386+0000","last_peered":"2023-10-14T12:20:22.131386+0000","last_clean":"2023-10-14T12:20:22.131386+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:20:22.131386+0000","last_undegraded":"2023-10-14T12:20:22.131386+0000","last_fullsized":"2023-10-14T12:20:22.131386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.131261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.131261+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.131261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:40.158954+0000","scrub_duration":0.0015560909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:31.304487+0000","last_change":"2023-10-14T12:20:31.304565+0000","last_active":"2023-10-14T12:20:31.304487+0000","last_peered":"2023-10-14T12:20:31.304487+0000","last_clean":"2023-10-14T12:20:31.304487+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:20:31.304487+0000","last_undegraded":"2023-10-14T12:20:31.304487+0000","last_fullsized":"2023-10-14T12:20:31.304487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:31.304373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:31.304373+0000","last_clean_scrub_stamp":"2023-10-14T12:20:31.304373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:47:57.856372+0000","scrub_duration":0.0020094499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:20.882534+0000","last_change":"2023-10-14T12:20:20.882578+0000","last_active":"2023-10-14T12:20:20.882534+0000","last_peered":"2023-10-14T12:20:20.882534+0000","last_clean":"2023-10-14T12:20:20.882534+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:20:20.882534+0000","last_undegraded":"2023-10-14T12:20:20.882534+0000","last_fullsized":"2023-10-14T12:20:20.882534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:20.882431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:20.882431+0000","last_clean_scrub_stamp":"2023-10-14T12:20:20.882431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:13.663721+0000","scrub_duration":0.0020522230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.117751+0000","last_change":"2023-10-14T12:20:06.117804+0000","last_active":"2023-10-14T12:20:06.117751+0000","last_peered":"2023-10-14T12:20:06.117751+0000","last_clean":"2023-10-14T12:20:06.117751+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:20:06.117751+0000","last_undegraded":"2023-10-14T12:20:06.117751+0000","last_fullsized":"2023-10-14T12:20:06.117751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.117644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:32.686476+0000","scrub_duration":0.002186164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.913126+0000","last_change":"2023-10-14T12:19:57.913179+0000","last_active":"2023-10-14T12:19:57.913126+0000","last_peered":"2023-10-14T12:19:57.913126+0000","last_clean":"2023-10-14T12:19:57.913126+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:57.913126+0000","last_undegraded":"2023-10-14T12:19:57.913126+0000","last_fullsized":"2023-10-14T12:19:57.913126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.913003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:42:13.246060+0000","scrub_duration":0.001600925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.132634+0000","last_change":"2023-10-14T12:20:01.132718+0000","last_active":"2023-10-14T12:20:01.132634+0000","last_peered":"2023-10-14T12:20:01.132634+0000","last_clean":"2023-10-14T12:20:01.132634+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:20:01.132634+0000","last_undegraded":"2023-10-14T12:20:01.132634+0000","last_fullsized":"2023-10-14T12:20:01.132634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.132516+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:49.867592+0000","scrub_duration":0.0052765859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71399999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72999999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.746}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.67700000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":9.2170000000000005,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.623},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:19:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.503},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.38900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.497},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.749}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.90300000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.878}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.438},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.52800000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.80200000000000005}]},{"osd":7,"last update":"Sat Oct 14 12:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":10.282,"5min":10.282,"15min":10.282},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":11.042,"5min":11.042,"15min":11.042},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.073,"5min":14.073,"15min":14.073},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.069000000000001,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.385999999999999,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":10.239000000000001,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.501}]},{"osd":4,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":10.971,"5min":10.971,"15min":10.971},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":10.497,"5min":10.497,"15min":10.497},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.77,"15min":1.77},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":20.931999999999999,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.96599999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":10.467000000000001,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":20.972000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:19:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.435,"5min":10.435,"15min":10.435},"last":0.84099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.438},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.34200000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.75},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 12:19:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52100000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:20:39.482 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.482 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.483 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.483 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.484 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.484 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.485 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.485 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.485 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.486 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.486 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.487 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.488 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.488 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:39.489 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:20:55.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:20:55.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:20:59.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:20:59.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.628+0000 7f6c64a08700 1 Processor -- start 2023-10-14T12:20:59.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.628+0000 7f6c64a08700 1 -- start start 2023-10-14T12:20:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.629+0000 7f6c64a08700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 0x7f6c600cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.629+0000 7f6c64a08700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6c600b0580 0x7f6c600ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.629+0000 7f6c64a08700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600b0a80 con 0x7f6c600ce620 2023-10-14T12:20:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.629+0000 7f6c64a08700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c600ccee0 con 0x7f6c600b0580 2023-10-14T12:20:59.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.629+0000 7f6c64a08700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600cd1c0 con 0x7f6c6015f050 2023-10-14T12:20:59.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6c600b0580 0x7f6c600ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:59.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5e59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 0x7f6c600cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6c600b0580 0x7f6c600ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.32:44654/0 (socket says 172.21.15.32:44654) 2023-10-14T12:20:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5e59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 0x7f6c600cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.32:46078/0 (socket says 172.21.15.32:46078) 2023-10-14T12:20:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 -- 172.21.15.32:0/2366276150 learned_addr learned my addr 172.21.15.32:0/2366276150 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:20:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 -- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 msgr2=0x7f6c600cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:20:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 --2- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 0x7f6c600cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 -- 172.21.15.32:0/2366276150 >> v1:172.21.15.92:6789/0 conn(0x7f6c600ce620 legacy=0x7f6c600cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 -- 172.21.15.32:0/2366276150 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600cd4a0 con 0x7f6c600b0580 2023-10-14T12:20:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5e59c700 1 --2- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 0x7f6c600cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:20:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5dd9b700 1 --2- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c600ce0e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c500098f0 tx=0x7f6c50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad4c0767ffe9fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5d59a700 1 -- 172.21.15.32:0/2366276150 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50011830 con 0x7f6c600b0580 2023-10-14T12:20:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5d59a700 1 -- 172.21.15.32:0/2366276150 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50011990 con 0x7f6c600b0580 2023-10-14T12:20:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.630+0000 7f6c5d59a700 1 -- 172.21.15.32:0/2366276150 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50011d20 con 0x7f6c600b0580 2023-10-14T12:20:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 -- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 msgr2=0x7f6c600ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 --2- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c600ce0e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c500098f0 tx=0x7f6c50009c00 comp rx=0 tx=0).stop 2023-10-14T12:20:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 -- 172.21.15.32:0/2366276150 shutdown_connections 2023-10-14T12:20:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 --2- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c6015f050 0x7f6c600cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 --2- 172.21.15.32:0/2366276150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c600ce0e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 -- 172.21.15.32:0/2366276150 >> 172.21.15.32:0/2366276150 conn(0x7f6c600d1620 msgr2=0x7f6c600d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:20:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 -- 172.21.15.32:0/2366276150 shutdown_connections 2023-10-14T12:20:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.631+0000 7f6c64a08700 1 -- 172.21.15.32:0/2366276150 wait complete. 2023-10-14T12:20:59.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.632+0000 7f6c64a08700 1 Processor -- start 2023-10-14T12:20:59.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.632+0000 7f6c64a08700 1 -- start start 2023-10-14T12:20:59.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c64a08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c601f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:59.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c64a08700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c600ce620 0x7f6c601f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:59.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c64a08700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 0x7f6c6015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:59.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c64a08700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6006b950 con 0x7f6c6015f050 2023-10-14T12:20:59.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c64a08700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c601f70d0 con 0x7f6c600b0580 2023-10-14T12:20:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c64a08700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c601f73b0 con 0x7f6c600ce620 2023-10-14T12:20:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c5ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 0x7f6c6015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c5ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 0x7f6c6015d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40394/0 (socket says 172.21.15.32:40394) 2023-10-14T12:20:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.633+0000 7f6c5ed9d700 1 -- 172.21.15.32:0/455185222 learned_addr learned my addr 172.21.15.32:0/455185222 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:20:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5dd9b700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c600ce620 0x7f6c601f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5e59c700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c601f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5ed9d700 1 -- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c600ce620 msgr2=0x7f6c601f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:59.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5ed9d700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c600ce620 0x7f6c601f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5ed9d700 1 -- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 msgr2=0x7f6c601f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:59.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5ed9d700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c601f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5ed9d700 1 -- 172.21.15.32:0/455185222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540094a0 con 0x7f6c6015f050 2023-10-14T12:20:59.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c5ed9d700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 0x7f6c6015d650 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800cc50 tx=0x7f6c5800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:59.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58003c00 con 0x7f6c6015f050 2023-10-14T12:20:59.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58003d60 con 0x7f6c6015f050 2023-10-14T12:20:59.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c50009550 con 0x7f6c6015f050 2023-10-14T12:20:59.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800aab0 con 0x7f6c6015f050 2023-10-14T12:20:59.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.634+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6006bbf0 con 0x7f6c6015f050 2023-10-14T12:20:59.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.635+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60067d20 con 0x7f6c6015f050 2023-10-14T12:20:59.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.636+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c5800ac10 con 0x7f6c6015f050 2023-10-14T12:20:59.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.636+0000 7f6c4effd700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6c4006af00 0x7f6c4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:20:59.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.636+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6c580895d0 con 0x7f6c6015f050 2023-10-14T12:20:59.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.636+0000 7f6c5e59c700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6c4006af00 0x7f6c4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:20:59.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.637+0000 7f6c5e59c700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6c4006af00 0x7f6c4006d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009d70 tx=0x7f6c54009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:20:59.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.641+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c58054660 con 0x7f6c6015f050 2023-10-14T12:20:59.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.836+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c6015f430 con 0x7f6c4006af00 2023-10-14T12:20:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.845+0000 7f6c4effd700 1 -- 172.21.15.32:0/455185222 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290786 (secure 0 0 0) 0x7f6c540099c0 con 0x7f6c4006af00 2023-10-14T12:20:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:20:59.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6c4006af00 msgr2=0x7f6c4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:59.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6c4006af00 0x7f6c4006d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009d70 tx=0x7f6c54009210 comp rx=0 tx=0).stop 2023-10-14T12:20:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 msgr2=0x7f6c6015d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:20:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 0x7f6c6015d650 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800cc50 tx=0x7f6c5800cf60 comp rx=0 tx=0).stop 2023-10-14T12:20:59.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 shutdown_connections 2023-10-14T12:20:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c6015f050 0x7f6c6015d650 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f6c4006af00 0x7f6c4006d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c600b0580 0x7f6c601f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 --2- 172.21.15.32:0/455185222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c600ce620 0x7f6c601f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:20:59.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 >> 172.21.15.32:0/455185222 conn(0x7f6c600d1620 msgr2=0x7f6c600d1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:20:59.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 shutdown_connections 2023-10-14T12:20:59.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:20:59.848+0000 7f6c64a08700 1 -- 172.21.15.32:0/455185222 wait complete. 2023-10-14T12:20:59.858 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:20:59.861 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-14T12:20:59.129052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224328,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750392,"statfs":{"total":773094113280,"available":772864401408,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003243"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:39.684459+0000","last_change":"2023-10-14T12:20:39.684505+0000","last_active":"2023-10-14T12:20:39.684459+0000","last_peered":"2023-10-14T12:20:39.684459+0000","last_clean":"2023-10-14T12:20:39.684459+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:20:39.684459+0000","last_undegraded":"2023-10-14T12:20:39.684459+0000","last_fullsized":"2023-10-14T12:20:39.684459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:39.684346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:39.684346+0000","last_clean_scrub_stamp":"2023-10-14T12:20:39.684346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:38.295884+0000","scrub_duration":0.00153739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:36.978354+0000","last_change":"2023-10-14T12:20:36.978439+0000","last_active":"2023-10-14T12:20:36.978354+0000","last_peered":"2023-10-14T12:20:36.978354+0000","last_clean":"2023-10-14T12:20:36.978354+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:20:36.978354+0000","last_undegraded":"2023-10-14T12:20:36.978354+0000","last_fullsized":"2023-10-14T12:20:36.978354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:36.978224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:36.978224+0000","last_clean_scrub_stamp":"2023-10-14T12:20:36.978224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:38.862798+0000","scrub_duration":0.0016748819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:20.557743+0000","last_change":"2023-10-14T12:20:20.557821+0000","last_active":"2023-10-14T12:20:20.557743+0000","last_peered":"2023-10-14T12:20:20.557743+0000","last_clean":"2023-10-14T12:20:20.557743+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:20:20.557743+0000","last_undegraded":"2023-10-14T12:20:20.557743+0000","last_fullsized":"2023-10-14T12:20:20.557743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:20.557621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:20.557621+0000","last_clean_scrub_stamp":"2023-10-14T12:20:20.557621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:12.490624+0000","scrub_duration":0.002131558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.000369+0000","last_change":"2023-10-14T12:20:13.000426+0000","last_active":"2023-10-14T12:20:13.000369+0000","last_peered":"2023-10-14T12:20:13.000369+0000","last_clean":"2023-10-14T12:20:13.000369+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:20:13.000369+0000","last_undegraded":"2023-10-14T12:20:13.000369+0000","last_fullsized":"2023-10-14T12:20:13.000369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.000229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:12:06.144509+0000","scrub_duration":0.0019750879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.168113+0000","last_change":"2023-10-14T12:20:09.168161+0000","last_active":"2023-10-14T12:20:09.168113+0000","last_peered":"2023-10-14T12:20:09.168113+0000","last_clean":"2023-10-14T12:20:09.168113+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:20:09.168113+0000","last_undegraded":"2023-10-14T12:20:09.168113+0000","last_fullsized":"2023-10-14T12:20:09.168113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.168000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:08.509845+0000","scrub_duration":0.001546331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:54.845063+0000","last_change":"2023-10-14T12:20:54.845166+0000","last_active":"2023-10-14T12:20:54.845063+0000","last_peered":"2023-10-14T12:20:54.845063+0000","last_clean":"2023-10-14T12:20:54.845063+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:20:54.845063+0000","last_undegraded":"2023-10-14T12:20:54.845063+0000","last_fullsized":"2023-10-14T12:20:54.845063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:54.844929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:54.844929+0000","last_clean_scrub_stamp":"2023-10-14T12:20:54.844929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:05.517702+0000","scrub_duration":0.0021068189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.099856+0000","last_change":"2023-10-14T12:20:05.099899+0000","last_active":"2023-10-14T12:20:05.099856+0000","last_peered":"2023-10-14T12:20:05.099856+0000","last_clean":"2023-10-14T12:20:05.099856+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:20:05.099856+0000","last_undegraded":"2023-10-14T12:20:05.099856+0000","last_fullsized":"2023-10-14T12:20:05.099856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.099748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:03.711286+0000","scrub_duration":0.001409483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.155547+0000","last_change":"2023-10-14T12:20:03.155603+0000","last_active":"2023-10-14T12:20:03.155547+0000","last_peered":"2023-10-14T12:20:03.155547+0000","last_clean":"2023-10-14T12:20:03.155547+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:20:03.155547+0000","last_undegraded":"2023-10-14T12:20:03.155547+0000","last_fullsized":"2023-10-14T12:20:03.155547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:24.804563+0000","scrub_duration":0.001673566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:34.269244+0000","last_change":"2023-10-14T12:20:34.269329+0000","last_active":"2023-10-14T12:20:34.269244+0000","last_peered":"2023-10-14T12:20:34.269244+0000","last_clean":"2023-10-14T12:20:34.269244+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:20:34.269244+0000","last_undegraded":"2023-10-14T12:20:34.269244+0000","last_fullsized":"2023-10-14T12:20:34.269244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:34.269110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:34.269110+0000","last_clean_scrub_stamp":"2023-10-14T12:20:34.269110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:47.418608+0000","scrub_duration":0.0019946260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.009920+0000","last_change":"2023-10-14T12:20:12.009966+0000","last_active":"2023-10-14T12:20:12.009920+0000","last_peered":"2023-10-14T12:20:12.009920+0000","last_clean":"2023-10-14T12:20:12.009920+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:20:12.009920+0000","last_undegraded":"2023-10-14T12:20:12.009920+0000","last_fullsized":"2023-10-14T12:20:12.009920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.009806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:30.037499+0000","scrub_duration":0.0015351309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:35.189438+0000","last_change":"2023-10-14T12:20:35.189486+0000","last_active":"2023-10-14T12:20:35.189438+0000","last_peered":"2023-10-14T12:20:35.189438+0000","last_clean":"2023-10-14T12:20:35.189438+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:20:35.189438+0000","last_undegraded":"2023-10-14T12:20:35.189438+0000","last_fullsized":"2023-10-14T12:20:35.189438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:35.189293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:35.189293+0000","last_clean_scrub_stamp":"2023-10-14T12:20:35.189293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:51:44.592819+0000","scrub_duration":0.0023706579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:26.531163+0000","last_change":"2023-10-14T12:20:26.531220+0000","last_active":"2023-10-14T12:20:26.531163+0000","last_peered":"2023-10-14T12:20:26.531163+0000","last_clean":"2023-10-14T12:20:26.531163+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:20:26.531163+0000","last_undegraded":"2023-10-14T12:20:26.531163+0000","last_fullsized":"2023-10-14T12:20:26.531163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:26.531030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:26.531030+0000","last_clean_scrub_stamp":"2023-10-14T12:20:26.531030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:06.572536+0000","scrub_duration":0.0019563380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.024673+0000","last_change":"2023-10-14T12:20:18.024718+0000","last_active":"2023-10-14T12:20:18.024673+0000","last_peered":"2023-10-14T12:20:18.024673+0000","last_clean":"2023-10-14T12:20:18.024673+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:20:18.024673+0000","last_undegraded":"2023-10-14T12:20:18.024673+0000","last_fullsized":"2023-10-14T12:20:18.024673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.024565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.024565+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.024565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:38.085254+0000","scrub_duration":0.0017125510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:45.250679+0000","last_change":"2023-10-14T12:19:43.380433+0000","last_active":"2023-10-14T12:19:45.250679+0000","last_peered":"2023-10-14T12:19:45.250679+0000","last_clean":"2023-10-14T12:19:45.250679+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:19:45.250679+0000","last_undegraded":"2023-10-14T12:19:45.250679+0000","last_fullsized":"2023-10-14T12:19:45.250679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:42.352168+0000","last_clean_scrub_stamp":"2023-10-14T12:19:42.352168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.534302+0000","last_change":"2023-10-14T12:20:24.534379+0000","last_active":"2023-10-14T12:20:24.534302+0000","last_peered":"2023-10-14T12:20:24.534302+0000","last_clean":"2023-10-14T12:20:24.534302+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:20:24.534302+0000","last_undegraded":"2023-10-14T12:20:24.534302+0000","last_fullsized":"2023-10-14T12:20:24.534302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.534176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.534176+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.534176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:37.683674+0000","scrub_duration":0.0016716260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.193221+0000","last_change":"2023-10-14T12:20:18.193265+0000","last_active":"2023-10-14T12:20:18.193221+0000","last_peered":"2023-10-14T12:20:18.193221+0000","last_clean":"2023-10-14T12:20:18.193221+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:20:18.193221+0000","last_undegraded":"2023-10-14T12:20:18.193221+0000","last_fullsized":"2023-10-14T12:20:18.193221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.193108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.193108+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.193108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:59.870821+0000","scrub_duration":0.001714667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.180615+0000","last_change":"2023-10-14T12:20:09.180663+0000","last_active":"2023-10-14T12:20:09.180615+0000","last_peered":"2023-10-14T12:20:09.180615+0000","last_clean":"2023-10-14T12:20:09.180615+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:20:09.180615+0000","last_undegraded":"2023-10-14T12:20:09.180615+0000","last_fullsized":"2023-10-14T12:20:09.180615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.180502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:59:31.918129+0000","scrub_duration":0.001560082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:42.897083+0000","last_change":"2023-10-14T12:20:42.897137+0000","last_active":"2023-10-14T12:20:42.897083+0000","last_peered":"2023-10-14T12:20:42.897083+0000","last_clean":"2023-10-14T12:20:42.897083+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:20:42.897083+0000","last_undegraded":"2023-10-14T12:20:42.897083+0000","last_fullsized":"2023-10-14T12:20:42.897083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:42.896962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:42.896962+0000","last_clean_scrub_stamp":"2023-10-14T12:20:42.896962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:27.262123+0000","scrub_duration":0.001660894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:41.909357+0000","last_change":"2023-10-14T12:20:41.909432+0000","last_active":"2023-10-14T12:20:41.909357+0000","last_peered":"2023-10-14T12:20:41.909357+0000","last_clean":"2023-10-14T12:20:41.909357+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:20:41.909357+0000","last_undegraded":"2023-10-14T12:20:41.909357+0000","last_fullsized":"2023-10-14T12:20:41.909357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:41.909181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:41.909181+0000","last_clean_scrub_stamp":"2023-10-14T12:20:41.909181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:44.213902+0000","scrub_duration":0.0017362969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:25.095733+0000","last_change":"2023-10-14T12:20:25.095813+0000","last_active":"2023-10-14T12:20:25.095733+0000","last_peered":"2023-10-14T12:20:25.095733+0000","last_clean":"2023-10-14T12:20:25.095733+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:20:25.095733+0000","last_undegraded":"2023-10-14T12:20:25.095733+0000","last_fullsized":"2023-10-14T12:20:25.095733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:25.095589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:25.095589+0000","last_clean_scrub_stamp":"2023-10-14T12:20:25.095589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:59.854820+0000","scrub_duration":0.0020046339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:37.342413+0000","last_change":"2023-10-14T12:20:37.342465+0000","last_active":"2023-10-14T12:20:37.342413+0000","last_peered":"2023-10-14T12:20:37.342413+0000","last_clean":"2023-10-14T12:20:37.342413+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:20:37.342413+0000","last_undegraded":"2023-10-14T12:20:37.342413+0000","last_fullsized":"2023-10-14T12:20:37.342413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:37.342309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:37.342309+0000","last_clean_scrub_stamp":"2023-10-14T12:20:37.342309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:39.226883+0000","scrub_duration":0.0019210589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:25.158938+0000","last_change":"2023-10-14T12:20:25.159037+0000","last_active":"2023-10-14T12:20:25.158938+0000","last_peered":"2023-10-14T12:20:25.158938+0000","last_clean":"2023-10-14T12:20:25.158938+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:20:25.158938+0000","last_undegraded":"2023-10-14T12:20:25.158938+0000","last_fullsized":"2023-10-14T12:20:25.158938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:25.158825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:25.158825+0000","last_clean_scrub_stamp":"2023-10-14T12:20:25.158825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:17.644950+0000","scrub_duration":0.001945986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.151021+0000","last_change":"2023-10-14T12:20:07.151083+0000","last_active":"2023-10-14T12:20:07.151021+0000","last_peered":"2023-10-14T12:20:07.151021+0000","last_clean":"2023-10-14T12:20:07.151021+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:20:07.151021+0000","last_undegraded":"2023-10-14T12:20:07.151021+0000","last_fullsized":"2023-10-14T12:20:07.151021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.150921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.119523+0000","scrub_duration":0.002059576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.565408+0000","last_change":"2023-10-14T12:20:06.565489+0000","last_active":"2023-10-14T12:20:06.565408+0000","last_peered":"2023-10-14T12:20:06.565408+0000","last_clean":"2023-10-14T12:20:06.565408+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:20:06.565408+0000","last_undegraded":"2023-10-14T12:20:06.565408+0000","last_fullsized":"2023-10-14T12:20:06.565408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.565268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:58.810087+0000","scrub_duration":0.0023384180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.999329+0000","last_change":"2023-10-14T12:20:13.999395+0000","last_active":"2023-10-14T12:20:13.999329+0000","last_peered":"2023-10-14T12:20:13.999329+0000","last_clean":"2023-10-14T12:20:13.999329+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:20:13.999329+0000","last_undegraded":"2023-10-14T12:20:13.999329+0000","last_fullsized":"2023-10-14T12:20:13.999329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.999218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:37.632861+0000","scrub_duration":0.001812021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.983720+0000","last_change":"2023-10-14T12:19:58.983768+0000","last_active":"2023-10-14T12:19:58.983720+0000","last_peered":"2023-10-14T12:19:58.983720+0000","last_clean":"2023-10-14T12:19:58.983720+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:58.983720+0000","last_undegraded":"2023-10-14T12:19:58.983720+0000","last_fullsized":"2023-10-14T12:19:58.983720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.983621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:20.632775+0000","scrub_duration":0.0017119399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:19.977932+0000","last_change":"2023-10-14T12:20:19.978012+0000","last_active":"2023-10-14T12:20:19.977932+0000","last_peered":"2023-10-14T12:20:19.977932+0000","last_clean":"2023-10-14T12:20:19.977932+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:20:19.977932+0000","last_undegraded":"2023-10-14T12:20:19.977932+0000","last_fullsized":"2023-10-14T12:20:19.977932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:19.977782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:19.977782+0000","last_clean_scrub_stamp":"2023-10-14T12:20:19.977782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.759071+0000","scrub_duration":0.0022331830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:23.545929+0000","last_change":"2023-10-14T12:20:23.545994+0000","last_active":"2023-10-14T12:20:23.545929+0000","last_peered":"2023-10-14T12:20:23.545929+0000","last_clean":"2023-10-14T12:20:23.545929+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:20:23.545929+0000","last_undegraded":"2023-10-14T12:20:23.545929+0000","last_fullsized":"2023-10-14T12:20:23.545929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:23.545804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:23.545804+0000","last_clean_scrub_stamp":"2023-10-14T12:20:23.545804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:24.857034+0000","scrub_duration":0.0019879759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:29.245958+0000","last_change":"2023-10-14T12:20:29.246006+0000","last_active":"2023-10-14T12:20:29.245958+0000","last_peered":"2023-10-14T12:20:29.245958+0000","last_clean":"2023-10-14T12:20:29.245958+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:20:29.245958+0000","last_undegraded":"2023-10-14T12:20:29.245958+0000","last_fullsized":"2023-10-14T12:20:29.245958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:29.245840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:29.245840+0000","last_clean_scrub_stamp":"2023-10-14T12:20:29.245840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:35.737169+0000","scrub_duration":0.0020797989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:39.276579+0000","last_change":"2023-10-14T12:20:39.276649+0000","last_active":"2023-10-14T12:20:39.276579+0000","last_peered":"2023-10-14T12:20:39.276579+0000","last_clean":"2023-10-14T12:20:39.276579+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:20:39.276579+0000","last_undegraded":"2023-10-14T12:20:39.276579+0000","last_fullsized":"2023-10-14T12:20:39.276579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:39.276444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:39.276444+0000","last_clean_scrub_stamp":"2023-10-14T12:20:39.276444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:40.967083+0000","scrub_duration":0.0016520549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:29.788984+0000","last_change":"2023-10-14T12:20:29.789036+0000","last_active":"2023-10-14T12:20:29.788984+0000","last_peered":"2023-10-14T12:20:29.788984+0000","last_clean":"2023-10-14T12:20:29.788984+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:20:29.788984+0000","last_undegraded":"2023-10-14T12:20:29.788984+0000","last_fullsized":"2023-10-14T12:20:29.788984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:29.788879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:29.788879+0000","last_clean_scrub_stamp":"2023-10-14T12:20:29.788879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:53.905606+0000","scrub_duration":0.0020435869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:23.079067+0000","last_change":"2023-10-14T12:20:23.079118+0000","last_active":"2023-10-14T12:20:23.079067+0000","last_peered":"2023-10-14T12:20:23.079067+0000","last_clean":"2023-10-14T12:20:23.079067+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:20:23.079067+0000","last_undegraded":"2023-10-14T12:20:23.079067+0000","last_fullsized":"2023-10-14T12:20:23.079067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:23.078951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:23.078951+0000","last_clean_scrub_stamp":"2023-10-14T12:20:23.078951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:15.011954+0000","scrub_duration":0.0015491680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.178018+0000","last_change":"2023-10-14T12:20:15.178066+0000","last_active":"2023-10-14T12:20:15.178018+0000","last_peered":"2023-10-14T12:20:15.178018+0000","last_clean":"2023-10-14T12:20:15.178018+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:20:15.178018+0000","last_undegraded":"2023-10-14T12:20:15.178018+0000","last_fullsized":"2023-10-14T12:20:15.178018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.177907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:13.789446+0000","scrub_duration":0.0021094970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.863385+0000","last_change":"2023-10-14T12:20:24.863447+0000","last_active":"2023-10-14T12:20:24.863385+0000","last_peered":"2023-10-14T12:20:24.863385+0000","last_clean":"2023-10-14T12:20:24.863385+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:20:24.863385+0000","last_undegraded":"2023-10-14T12:20:24.863385+0000","last_fullsized":"2023-10-14T12:20:24.863385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-10-14T12:20:24.863277+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-10-14T12:20:24.863277+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.863277+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:44.527722+0000","scrub_duration":0.0040846679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:37.696708+0000","last_change":"2023-10-14T12:20:37.696753+0000","last_active":"2023-10-14T12:20:37.696708+0000","last_peered":"2023-10-14T12:20:37.696708+0000","last_clean":"2023-10-14T12:20:37.696708+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:20:37.696708+0000","last_undegraded":"2023-10-14T12:20:37.696708+0000","last_fullsized":"2023-10-14T12:20:37.696708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:37.696599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:37.696599+0000","last_clean_scrub_stamp":"2023-10-14T12:20:37.696599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:27:26.431675+0000","scrub_duration":0.001573161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.072983+0000","last_change":"2023-10-14T12:20:05.073083+0000","last_active":"2023-10-14T12:20:05.072983+0000","last_peered":"2023-10-14T12:20:05.072983+0000","last_clean":"2023-10-14T12:20:05.072983+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:20:05.072983+0000","last_undegraded":"2023-10-14T12:20:05.072983+0000","last_fullsized":"2023-10-14T12:20:05.072983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.072872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:01.324353+0000","scrub_duration":0.0018346199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:27.162635+0000","last_change":"2023-10-14T12:20:27.162691+0000","last_active":"2023-10-14T12:20:27.162635+0000","last_peered":"2023-10-14T12:20:27.162635+0000","last_clean":"2023-10-14T12:20:27.162635+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:20:27.162635+0000","last_undegraded":"2023-10-14T12:20:27.162635+0000","last_fullsized":"2023-10-14T12:20:27.162635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:27.162528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:27.162528+0000","last_clean_scrub_stamp":"2023-10-14T12:20:27.162528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:37.690610+0000","scrub_duration":0.001882274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.917181+0000","last_change":"2023-10-14T12:20:04.917281+0000","last_active":"2023-10-14T12:20:04.917181+0000","last_peered":"2023-10-14T12:20:04.917181+0000","last_clean":"2023-10-14T12:20:04.917181+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:20:04.917181+0000","last_undegraded":"2023-10-14T12:20:04.917181+0000","last_fullsized":"2023-10-14T12:20:04.917181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.917043+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:22.944736+0000","scrub_duration":0.0021985300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.960780+0000","last_change":"2023-10-14T12:20:18.960862+0000","last_active":"2023-10-14T12:20:18.960780+0000","last_peered":"2023-10-14T12:20:18.960780+0000","last_clean":"2023-10-14T12:20:18.960780+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:20:18.960780+0000","last_undegraded":"2023-10-14T12:20:18.960780+0000","last_fullsized":"2023-10-14T12:20:18.960780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.960681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.960681+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.960681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:25.452010+0000","scrub_duration":0.001547671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:56.143539+0000","last_change":"2023-10-14T12:19:56.143579+0000","last_active":"2023-10-14T12:19:56.143539+0000","last_peered":"2023-10-14T12:19:56.143539+0000","last_clean":"2023-10-14T12:19:56.143539+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:56.143539+0000","last_undegraded":"2023-10-14T12:19:56.143539+0000","last_fullsized":"2023-10-14T12:19:56.143539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_clean_scrub_stamp":"2023-10-14T12:19:56.143469+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:45.317148+0000","scrub_duration":0.0014353720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.169240+0000","last_change":"2023-10-14T12:20:12.169285+0000","last_active":"2023-10-14T12:20:12.169240+0000","last_peered":"2023-10-14T12:20:12.169240+0000","last_clean":"2023-10-14T12:20:12.169240+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:20:12.169240+0000","last_undegraded":"2023-10-14T12:20:12.169240+0000","last_fullsized":"2023-10-14T12:20:12.169240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.169111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:40.089199+0000","scrub_duration":0.001529844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.075374+0000","last_change":"2023-10-14T12:20:00.075474+0000","last_active":"2023-10-14T12:20:00.075374+0000","last_peered":"2023-10-14T12:20:00.075374+0000","last_clean":"2023-10-14T12:20:00.075374+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:20:00.075374+0000","last_undegraded":"2023-10-14T12:20:00.075374+0000","last_fullsized":"2023-10-14T12:20:00.075374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.075202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:24.888838+0000","scrub_duration":0.0020269469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.582106+0000","last_change":"2023-10-14T12:20:07.582203+0000","last_active":"2023-10-14T12:20:07.582106+0000","last_peered":"2023-10-14T12:20:07.582106+0000","last_clean":"2023-10-14T12:20:07.582106+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:20:07.582106+0000","last_undegraded":"2023-10-14T12:20:07.582106+0000","last_fullsized":"2023-10-14T12:20:07.582106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.581991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:25.609684+0000","scrub_duration":0.0024689830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.036968+0000","last_change":"2023-10-14T12:20:07.037030+0000","last_active":"2023-10-14T12:20:07.036968+0000","last_peered":"2023-10-14T12:20:07.036968+0000","last_clean":"2023-10-14T12:20:07.036968+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:20:07.036968+0000","last_undegraded":"2023-10-14T12:20:07.036968+0000","last_fullsized":"2023-10-14T12:20:07.036968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.036858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:03.288339+0000","scrub_duration":0.0028120160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.180648+0000","last_change":"2023-10-14T12:20:24.180746+0000","last_active":"2023-10-14T12:20:24.180648+0000","last_peered":"2023-10-14T12:20:24.180648+0000","last_clean":"2023-10-14T12:20:24.180648+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:20:24.180648+0000","last_undegraded":"2023-10-14T12:20:24.180648+0000","last_fullsized":"2023-10-14T12:20:24.180648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.180507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.180507+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.180507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:52.100595+0000","scrub_duration":0.001566139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.918650+0000","last_change":"2023-10-14T12:20:02.918708+0000","last_active":"2023-10-14T12:20:02.918650+0000","last_peered":"2023-10-14T12:20:02.918650+0000","last_clean":"2023-10-14T12:20:02.918650+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:20:02.918650+0000","last_undegraded":"2023-10-14T12:20:02.918650+0000","last_fullsized":"2023-10-14T12:20:02.918650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.918526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:31.370887+0000","scrub_duration":0.0015505899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:17.017122+0000","last_change":"2023-10-14T12:20:17.017174+0000","last_active":"2023-10-14T12:20:17.017122+0000","last_peered":"2023-10-14T12:20:17.017122+0000","last_clean":"2023-10-14T12:20:17.017122+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:20:17.017122+0000","last_undegraded":"2023-10-14T12:20:17.017122+0000","last_fullsized":"2023-10-14T12:20:17.017122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:17.016992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:17.016992+0000","last_clean_scrub_stamp":"2023-10-14T12:20:17.016992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:58.694705+0000","scrub_duration":0.0018999450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.087258+0000","last_change":"2023-10-14T12:20:02.087309+0000","last_active":"2023-10-14T12:20:02.087258+0000","last_peered":"2023-10-14T12:20:02.087258+0000","last_clean":"2023-10-14T12:20:02.087258+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:20:02.087258+0000","last_undegraded":"2023-10-14T12:20:02.087258+0000","last_fullsized":"2023-10-14T12:20:02.087258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.087127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.572933+0000","scrub_duration":0.001469337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.549309+0000","last_change":"2023-10-14T12:20:13.549409+0000","last_active":"2023-10-14T12:20:13.549309+0000","last_peered":"2023-10-14T12:20:13.549309+0000","last_clean":"2023-10-14T12:20:13.549309+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:20:13.549309+0000","last_undegraded":"2023-10-14T12:20:13.549309+0000","last_fullsized":"2023-10-14T12:20:13.549309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.549155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:06.035279+0000","scrub_duration":0.0019478570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.817693+0000","last_change":"2023-10-14T12:20:12.817784+0000","last_active":"2023-10-14T12:20:12.817693+0000","last_peered":"2023-10-14T12:20:12.817693+0000","last_clean":"2023-10-14T12:20:12.817693+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:20:12.817693+0000","last_undegraded":"2023-10-14T12:20:12.817693+0000","last_fullsized":"2023-10-14T12:20:12.817693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.817563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:51.379754+0000","scrub_duration":0.002143697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:38.967774+0000","last_change":"2023-10-14T12:20:38.967826+0000","last_active":"2023-10-14T12:20:38.967774+0000","last_peered":"2023-10-14T12:20:38.967774+0000","last_clean":"2023-10-14T12:20:38.967774+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:20:38.967774+0000","last_undegraded":"2023-10-14T12:20:38.967774+0000","last_fullsized":"2023-10-14T12:20:38.967774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:38.967648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:38.967648+0000","last_clean_scrub_stamp":"2023-10-14T12:20:38.967648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:14.703557+0000","scrub_duration":0.00162258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.014408+0000","last_change":"2023-10-14T12:20:02.014482+0000","last_active":"2023-10-14T12:20:02.014408+0000","last_peered":"2023-10-14T12:20:02.014408+0000","last_clean":"2023-10-14T12:20:02.014408+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:20:02.014408+0000","last_undegraded":"2023-10-14T12:20:02.014408+0000","last_fullsized":"2023-10-14T12:20:02.014408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.014280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.500085+0000","scrub_duration":0.0016626200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.875859+0000","last_change":"2023-10-14T12:20:22.875915+0000","last_active":"2023-10-14T12:20:22.875859+0000","last_peered":"2023-10-14T12:20:22.875859+0000","last_clean":"2023-10-14T12:20:22.875859+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:20:22.875859+0000","last_undegraded":"2023-10-14T12:20:22.875859+0000","last_fullsized":"2023-10-14T12:20:22.875859+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.875723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.875723+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.875723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:11.908494+0000","scrub_duration":0.002186679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.528241+0000","last_change":"2023-10-14T12:20:04.528351+0000","last_active":"2023-10-14T12:20:04.528241+0000","last_peered":"2023-10-14T12:20:04.528241+0000","last_clean":"2023-10-14T12:20:04.528241+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:20:04.528241+0000","last_undegraded":"2023-10-14T12:20:04.528241+0000","last_fullsized":"2023-10-14T12:20:04.528241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.528122+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:18.750282+0000","scrub_duration":0.0023976879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.568245+0000","last_change":"2023-10-14T12:20:22.568321+0000","last_active":"2023-10-14T12:20:22.568245+0000","last_peered":"2023-10-14T12:20:22.568245+0000","last_clean":"2023-10-14T12:20:22.568245+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:20:22.568245+0000","last_undegraded":"2023-10-14T12:20:22.568245+0000","last_fullsized":"2023-10-14T12:20:22.568245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.568140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.568140+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.568140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:34.165608+0000","scrub_duration":0.0021438989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.846992+0000","last_change":"2023-10-14T12:20:07.847108+0000","last_active":"2023-10-14T12:20:07.846992+0000","last_peered":"2023-10-14T12:20:07.846992+0000","last_clean":"2023-10-14T12:20:07.846992+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:20:07.846992+0000","last_undegraded":"2023-10-14T12:20:07.846992+0000","last_fullsized":"2023-10-14T12:20:07.846992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.846867+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:35.766956+0000","scrub_duration":0.002747167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.013554+0000","last_change":"2023-10-14T12:20:06.013605+0000","last_active":"2023-10-14T12:20:06.013554+0000","last_peered":"2023-10-14T12:20:06.013554+0000","last_clean":"2023-10-14T12:20:06.013554+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:20:06.013554+0000","last_undegraded":"2023-10-14T12:20:06.013554+0000","last_fullsized":"2023-10-14T12:20:06.013554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.013441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:04.624980+0000","scrub_duration":0.002025139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:08.025935+0000","last_change":"2023-10-14T12:20:08.025994+0000","last_active":"2023-10-14T12:20:08.025935+0000","last_peered":"2023-10-14T12:20:08.025935+0000","last_clean":"2023-10-14T12:20:08.025935+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:20:08.025935+0000","last_undegraded":"2023-10-14T12:20:08.025935+0000","last_fullsized":"2023-10-14T12:20:08.025935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_clean_scrub_stamp":"2023-10-14T12:20:08.025791+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.994394+0000","scrub_duration":0.0024040939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.847004+0000","last_change":"2023-10-14T12:20:24.847078+0000","last_active":"2023-10-14T12:20:24.847004+0000","last_peered":"2023-10-14T12:20:24.847004+0000","last_clean":"2023-10-14T12:20:24.847004+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:20:24.847004+0000","last_undegraded":"2023-10-14T12:20:24.847004+0000","last_fullsized":"2023-10-14T12:20:24.847004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.846839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.846839+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.846839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:32.412890+0000","scrub_duration":0.0017280290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.970221+0000","last_change":"2023-10-14T12:20:01.970277+0000","last_active":"2023-10-14T12:20:01.970221+0000","last_peered":"2023-10-14T12:20:01.970221+0000","last_clean":"2023-10-14T12:20:01.970221+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:20:01.970221+0000","last_undegraded":"2023-10-14T12:20:01.970221+0000","last_fullsized":"2023-10-14T12:20:01.970221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.970091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:36.729323+0000","scrub_duration":0.0019624059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:33.196839+0000","last_change":"2023-10-14T12:20:33.196904+0000","last_active":"2023-10-14T12:20:33.196839+0000","last_peered":"2023-10-14T12:20:33.196839+0000","last_clean":"2023-10-14T12:20:33.196839+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:20:33.196839+0000","last_undegraded":"2023-10-14T12:20:33.196839+0000","last_fullsized":"2023-10-14T12:20:33.196839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:33.196723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:33.196723+0000","last_clean_scrub_stamp":"2023-10-14T12:20:33.196723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:22.229493+0000","scrub_duration":0.0016797069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:16.786277+0000","last_change":"2023-10-14T12:20:16.786385+0000","last_active":"2023-10-14T12:20:16.786277+0000","last_peered":"2023-10-14T12:20:16.786277+0000","last_clean":"2023-10-14T12:20:16.786277+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:20:16.786277+0000","last_undegraded":"2023-10-14T12:20:16.786277+0000","last_fullsized":"2023-10-14T12:20:16.786277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:16.786137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:16.786137+0000","last_clean_scrub_stamp":"2023-10-14T12:20:16.786137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:47.081621+0000","scrub_duration":0.0022144949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:45.626909+0000","last_change":"2023-10-14T12:20:45.626958+0000","last_active":"2023-10-14T12:20:45.626909+0000","last_peered":"2023-10-14T12:20:45.626909+0000","last_clean":"2023-10-14T12:20:45.626909+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:20:45.626909+0000","last_undegraded":"2023-10-14T12:20:45.626909+0000","last_fullsized":"2023-10-14T12:20:45.626909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:45.626785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:45.626785+0000","last_clean_scrub_stamp":"2023-10-14T12:20:45.626785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:03.654478+0000","scrub_duration":0.0015257549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.941556+0000","last_change":"2023-10-14T12:20:00.941615+0000","last_active":"2023-10-14T12:20:00.941556+0000","last_peered":"2023-10-14T12:20:00.941556+0000","last_clean":"2023-10-14T12:20:00.941556+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:20:00.941556+0000","last_undegraded":"2023-10-14T12:20:00.941556+0000","last_fullsized":"2023-10-14T12:20:00.941556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.941417+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:15.163577+0000","scrub_duration":0.0026495780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:32.331437+0000","last_change":"2023-10-14T12:20:32.331481+0000","last_active":"2023-10-14T12:20:32.331437+0000","last_peered":"2023-10-14T12:20:32.331437+0000","last_clean":"2023-10-14T12:20:32.331437+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:20:32.331437+0000","last_undegraded":"2023-10-14T12:20:32.331437+0000","last_fullsized":"2023-10-14T12:20:32.331437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:32.331320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:32.331320+0000","last_clean_scrub_stamp":"2023-10-14T12:20:32.331320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:21.364091+0000","scrub_duration":0.0015082679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.923380+0000","last_change":"2023-10-14T12:20:02.923480+0000","last_active":"2023-10-14T12:20:02.923380+0000","last_peered":"2023-10-14T12:20:02.923380+0000","last_clean":"2023-10-14T12:20:02.923380+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:20:02.923380+0000","last_undegraded":"2023-10-14T12:20:02.923380+0000","last_fullsized":"2023-10-14T12:20:02.923380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.923263+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:27.039989+0000","scrub_duration":0.002081308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.512160+0000","last_change":"2023-10-14T12:20:11.512210+0000","last_active":"2023-10-14T12:20:11.512160+0000","last_peered":"2023-10-14T12:20:11.512160+0000","last_clean":"2023-10-14T12:20:11.512160+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:20:11.512160+0000","last_undegraded":"2023-10-14T12:20:11.512160+0000","last_fullsized":"2023-10-14T12:20:11.512160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.512033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:39.432121+0000","scrub_duration":0.001569207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.053293+0000","last_change":"2023-10-14T12:20:12.053387+0000","last_active":"2023-10-14T12:20:12.053293+0000","last_peered":"2023-10-14T12:20:12.053293+0000","last_clean":"2023-10-14T12:20:12.053293+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:20:12.053293+0000","last_undegraded":"2023-10-14T12:20:12.053293+0000","last_fullsized":"2023-10-14T12:20:12.053293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.053179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:27:00.788255+0000","scrub_duration":0.001905143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:10.038313+0000","last_change":"2023-10-14T12:20:10.038364+0000","last_active":"2023-10-14T12:20:10.038313+0000","last_peered":"2023-10-14T12:20:10.038313+0000","last_clean":"2023-10-14T12:20:10.038313+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:20:10.038313+0000","last_undegraded":"2023-10-14T12:20:10.038313+0000","last_fullsized":"2023-10-14T12:20:10.038313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_clean_scrub_stamp":"2023-10-14T12:20:10.038190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:02.283009+0000","scrub_duration":0.0020200909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:17.073907+0000","last_change":"2023-10-14T12:20:17.074004+0000","last_active":"2023-10-14T12:20:17.073907+0000","last_peered":"2023-10-14T12:20:17.073907+0000","last_clean":"2023-10-14T12:20:17.073907+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:20:17.073907+0000","last_undegraded":"2023-10-14T12:20:17.073907+0000","last_fullsized":"2023-10-14T12:20:17.073907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-14T12:20:17.073763+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-14T12:20:17.073763+0000","last_clean_scrub_stamp":"2023-10-14T12:20:17.073763+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.295923+0000","scrub_duration":0.0037557010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.125144+0000","last_change":"2023-10-14T12:20:04.125193+0000","last_active":"2023-10-14T12:20:04.125144+0000","last_peered":"2023-10-14T12:20:04.125144+0000","last_clean":"2023-10-14T12:20:04.125144+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:20:04.125144+0000","last_undegraded":"2023-10-14T12:20:04.125144+0000","last_fullsized":"2023-10-14T12:20:04.125144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.125041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:29.907915+0000","scrub_duration":0.0022271499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.070420+0000","last_change":"2023-10-14T12:20:18.070489+0000","last_active":"2023-10-14T12:20:18.070420+0000","last_peered":"2023-10-14T12:20:18.070420+0000","last_clean":"2023-10-14T12:20:18.070420+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:20:18.070420+0000","last_undegraded":"2023-10-14T12:20:18.070420+0000","last_fullsized":"2023-10-14T12:20:18.070420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.070307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.070307+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.070307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:10.315126+0000","scrub_duration":0.001942086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.172564+0000","last_change":"2023-10-14T12:20:06.172642+0000","last_active":"2023-10-14T12:20:06.172564+0000","last_peered":"2023-10-14T12:20:06.172564+0000","last_clean":"2023-10-14T12:20:06.172564+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:20:06.172564+0000","last_undegraded":"2023-10-14T12:20:06.172564+0000","last_fullsized":"2023-10-14T12:20:06.172564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.172417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:47:16.064813+0000","scrub_duration":0.0020790610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.074695+0000","last_change":"2023-10-14T12:19:57.074734+0000","last_active":"2023-10-14T12:19:57.074695+0000","last_peered":"2023-10-14T12:19:57.074695+0000","last_clean":"2023-10-14T12:19:57.074695+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:57.074695+0000","last_undegraded":"2023-10-14T12:19:57.074695+0000","last_fullsized":"2023-10-14T12:19:57.074695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.074602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:15.118672+0000","scrub_duration":0.0016862929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:14.067511+0000","last_change":"2023-10-14T12:20:14.067566+0000","last_active":"2023-10-14T12:20:14.067511+0000","last_peered":"2023-10-14T12:20:14.067511+0000","last_clean":"2023-10-14T12:20:14.067511+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:20:14.067511+0000","last_undegraded":"2023-10-14T12:20:14.067511+0000","last_fullsized":"2023-10-14T12:20:14.067511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_clean_scrub_stamp":"2023-10-14T12:20:14.067382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:22:05.800674+0000","scrub_duration":0.0016258220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.768858+0000","last_change":"2023-10-14T12:20:15.768905+0000","last_active":"2023-10-14T12:20:15.768858+0000","last_peered":"2023-10-14T12:20:15.768858+0000","last_clean":"2023-10-14T12:20:15.768858+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:20:15.768858+0000","last_undegraded":"2023-10-14T12:20:15.768858+0000","last_fullsized":"2023-10-14T12:20:15.768858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.768735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.768735+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.768735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:40.582371+0000","scrub_duration":0.001862566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.201319+0000","last_change":"2023-10-14T12:20:02.201368+0000","last_active":"2023-10-14T12:20:02.201319+0000","last_peered":"2023-10-14T12:20:02.201319+0000","last_clean":"2023-10-14T12:20:02.201319+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:20:02.201319+0000","last_undegraded":"2023-10-14T12:20:02.201319+0000","last_fullsized":"2023-10-14T12:20:02.201319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.201208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:54.774214+0000","scrub_duration":0.001588955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:16.062592+0000","last_change":"2023-10-14T12:20:16.062632+0000","last_active":"2023-10-14T12:20:16.062592+0000","last_peered":"2023-10-14T12:20:16.062592+0000","last_clean":"2023-10-14T12:20:16.062592+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:20:16.062592+0000","last_undegraded":"2023-10-14T12:20:16.062592+0000","last_fullsized":"2023-10-14T12:20:16.062592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:16.062457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:16.062457+0000","last_clean_scrub_stamp":"2023-10-14T12:20:16.062457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:37.711611+0000","scrub_duration":0.00184312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:34.205648+0000","last_change":"2023-10-14T12:20:34.205693+0000","last_active":"2023-10-14T12:20:34.205648+0000","last_peered":"2023-10-14T12:20:34.205648+0000","last_clean":"2023-10-14T12:20:34.205648+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:20:34.205648+0000","last_undegraded":"2023-10-14T12:20:34.205648+0000","last_fullsized":"2023-10-14T12:20:34.205648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:34.205532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:34.205532+0000","last_clean_scrub_stamp":"2023-10-14T12:20:34.205532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:41.771583+0000","scrub_duration":0.0015735370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.463746+0000","last_change":"2023-10-14T12:19:58.463793+0000","last_active":"2023-10-14T12:19:58.463746+0000","last_peered":"2023-10-14T12:19:58.463746+0000","last_clean":"2023-10-14T12:19:58.463746+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:58.463746+0000","last_undegraded":"2023-10-14T12:19:58.463746+0000","last_fullsized":"2023-10-14T12:19:58.463746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.463596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:47.198672+0000","scrub_duration":0.001612559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.156060+0000","last_change":"2023-10-14T12:20:03.156105+0000","last_active":"2023-10-14T12:20:03.156060+0000","last_peered":"2023-10-14T12:20:03.156060+0000","last_clean":"2023-10-14T12:20:03.156060+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:20:03.156060+0000","last_undegraded":"2023-10-14T12:20:03.156060+0000","last_fullsized":"2023-10-14T12:20:03.156060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:17.386190+0000","scrub_duration":0.0016035590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.968254+0000","last_change":"2023-10-14T12:20:03.968370+0000","last_active":"2023-10-14T12:20:03.968254+0000","last_peered":"2023-10-14T12:20:03.968254+0000","last_clean":"2023-10-14T12:20:03.968254+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:20:03.968254+0000","last_undegraded":"2023-10-14T12:20:03.968254+0000","last_fullsized":"2023-10-14T12:20:03.968254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.968116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:36.443571+0000","scrub_duration":0.0026487759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.570382+0000","last_change":"2023-10-14T12:20:15.570427+0000","last_active":"2023-10-14T12:20:15.570382+0000","last_peered":"2023-10-14T12:20:15.570382+0000","last_clean":"2023-10-14T12:20:15.570382+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:20:15.570382+0000","last_undegraded":"2023-10-14T12:20:15.570382+0000","last_fullsized":"2023-10-14T12:20:15.570382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.570262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.570262+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.570262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:26.098345+0000","scrub_duration":0.0020248649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.011017+0000","last_change":"2023-10-14T12:20:01.011121+0000","last_active":"2023-10-14T12:20:01.011017+0000","last_peered":"2023-10-14T12:20:01.011017+0000","last_clean":"2023-10-14T12:20:01.011017+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:20:01.011017+0000","last_undegraded":"2023-10-14T12:20:01.011017+0000","last_fullsized":"2023-10-14T12:20:01.011017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.010896+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:52.744188+0000","scrub_duration":0.0018949170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.256992+0000","last_change":"2023-10-14T12:20:11.257086+0000","last_active":"2023-10-14T12:20:11.256992+0000","last_peered":"2023-10-14T12:20:11.256992+0000","last_clean":"2023-10-14T12:20:11.256992+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:20:11.256992+0000","last_undegraded":"2023-10-14T12:20:11.256992+0000","last_fullsized":"2023-10-14T12:20:11.256992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.256856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:59.991932+0000","scrub_duration":0.001750627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.985436+0000","last_change":"2023-10-14T12:20:04.985491+0000","last_active":"2023-10-14T12:20:04.985436+0000","last_peered":"2023-10-14T12:20:04.985436+0000","last_clean":"2023-10-14T12:20:04.985436+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:20:04.985436+0000","last_undegraded":"2023-10-14T12:20:04.985436+0000","last_fullsized":"2023-10-14T12:20:04.985436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.985328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:20.534941+0000","scrub_duration":0.0014889269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:43.659195+0000","last_change":"2023-10-14T12:20:43.659279+0000","last_active":"2023-10-14T12:20:43.659195+0000","last_peered":"2023-10-14T12:20:43.659195+0000","last_clean":"2023-10-14T12:20:43.659195+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:20:43.659195+0000","last_undegraded":"2023-10-14T12:20:43.659195+0000","last_fullsized":"2023-10-14T12:20:43.659195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:43.659066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:43.659066+0000","last_clean_scrub_stamp":"2023-10-14T12:20:43.659066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:35.903885+0000","scrub_duration":0.0023725920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:55.116402+0000","last_change":"2023-10-14T12:19:55.116473+0000","last_active":"2023-10-14T12:19:55.116402+0000","last_peered":"2023-10-14T12:19:55.116402+0000","last_clean":"2023-10-14T12:19:55.116402+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:55.116402+0000","last_undegraded":"2023-10-14T12:19:55.116402+0000","last_fullsized":"2023-10-14T12:19:55.116402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_clean_scrub_stamp":"2023-10-14T12:19:55.116311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:25.522965+0000","scrub_duration":0.0019265339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.175981+0000","last_change":"2023-10-14T12:20:13.176034+0000","last_active":"2023-10-14T12:20:13.175981+0000","last_peered":"2023-10-14T12:20:13.175981+0000","last_clean":"2023-10-14T12:20:13.175981+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:20:13.175981+0000","last_undegraded":"2023-10-14T12:20:13.175981+0000","last_fullsized":"2023-10-14T12:20:13.175981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.175828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:34.824982+0000","scrub_duration":0.0020181909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:59.061518+0000","last_change":"2023-10-14T12:19:59.061565+0000","last_active":"2023-10-14T12:19:59.061518+0000","last_peered":"2023-10-14T12:19:59.061518+0000","last_clean":"2023-10-14T12:19:59.061518+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:59.061518+0000","last_undegraded":"2023-10-14T12:19:59.061518+0000","last_fullsized":"2023-10-14T12:19:59.061518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_clean_scrub_stamp":"2023-10-14T12:19:59.061407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:19.122096+0000","scrub_duration":0.0015051039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:51.782136+0000","last_change":"2023-10-14T12:20:51.782209+0000","last_active":"2023-10-14T12:20:51.782136+0000","last_peered":"2023-10-14T12:20:51.782136+0000","last_clean":"2023-10-14T12:20:51.782136+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:20:51.782136+0000","last_undegraded":"2023-10-14T12:20:51.782136+0000","last_fullsized":"2023-10-14T12:20:51.782136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:51.781951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:51.781951+0000","last_clean_scrub_stamp":"2023-10-14T12:20:51.781951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:25:53.539228+0000","scrub_duration":0.0018121000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.131386+0000","last_change":"2023-10-14T12:20:22.131442+0000","last_active":"2023-10-14T12:20:22.131386+0000","last_peered":"2023-10-14T12:20:22.131386+0000","last_clean":"2023-10-14T12:20:22.131386+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:20:22.131386+0000","last_undegraded":"2023-10-14T12:20:22.131386+0000","last_fullsized":"2023-10-14T12:20:22.131386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.131261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.131261+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.131261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:40.158954+0000","scrub_duration":0.0015560909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:31.304487+0000","last_change":"2023-10-14T12:20:31.304565+0000","last_active":"2023-10-14T12:20:31.304487+0000","last_peered":"2023-10-14T12:20:31.304487+0000","last_clean":"2023-10-14T12:20:31.304487+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:20:31.304487+0000","last_undegraded":"2023-10-14T12:20:31.304487+0000","last_fullsized":"2023-10-14T12:20:31.304487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:31.304373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:31.304373+0000","last_clean_scrub_stamp":"2023-10-14T12:20:31.304373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:47:57.856372+0000","scrub_duration":0.0020094499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:20.882534+0000","last_change":"2023-10-14T12:20:20.882578+0000","last_active":"2023-10-14T12:20:20.882534+0000","last_peered":"2023-10-14T12:20:20.882534+0000","last_clean":"2023-10-14T12:20:20.882534+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:20:20.882534+0000","last_undegraded":"2023-10-14T12:20:20.882534+0000","last_fullsized":"2023-10-14T12:20:20.882534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:20.882431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:20.882431+0000","last_clean_scrub_stamp":"2023-10-14T12:20:20.882431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:13.663721+0000","scrub_duration":0.0020522230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.117751+0000","last_change":"2023-10-14T12:20:06.117804+0000","last_active":"2023-10-14T12:20:06.117751+0000","last_peered":"2023-10-14T12:20:06.117751+0000","last_clean":"2023-10-14T12:20:06.117751+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:20:06.117751+0000","last_undegraded":"2023-10-14T12:20:06.117751+0000","last_fullsized":"2023-10-14T12:20:06.117751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.117644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:32.686476+0000","scrub_duration":0.002186164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.913126+0000","last_change":"2023-10-14T12:19:57.913179+0000","last_active":"2023-10-14T12:19:57.913126+0000","last_peered":"2023-10-14T12:19:57.913126+0000","last_clean":"2023-10-14T12:19:57.913126+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:57.913126+0000","last_undegraded":"2023-10-14T12:19:57.913126+0000","last_fullsized":"2023-10-14T12:19:57.913126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.913003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:42:13.246060+0000","scrub_duration":0.001600925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":186,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.132718+0000","last_change":"2023-10-14T12:20:01.132718+0000","last_active":"2023-10-14T12:20:01.132718+0000","last_peered":"2023-10-14T12:20:01.132718+0000","last_clean":"2023-10-14T12:20:01.132718+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:20:01.132718+0000","last_undegraded":"2023-10-14T12:20:01.132718+0000","last_fullsized":"2023-10-14T12:20:01.132718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.132516+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:49.867592+0000","scrub_duration":0.0052765859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.42099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84799999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80200000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57499999999999996,"15min":0.56999999999999995},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90100000000000002,"5min":1.056,"15min":1.056},"last":0.63}]},{"osd":3,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71099999999999997,"5min":1.411,"15min":1.411},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81499999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":1.45,"15min":1.45},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78800000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.74199999999999999,"5min":1.268,"15min":1.268},"last":0.76000000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":1.284,"15min":1.284},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77600000000000002,"5min":1.216,"15min":1.216},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.877,"15min":0.93500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.63},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.74399999999999999,"5min":1.452,"15min":1.452},"last":0.746}]},{"osd":4,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.49299999999999999,"15min":0.50600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.077,"15min":1.077},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":1.859,"15min":1.859},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78700000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.37},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.32300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54200000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.438},{"interface":"front","average":{"1min":0.505,"5min":0.441,"15min":0.42999999999999999},"min":{"1min":0.371,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.60799999999999998,"15min":0.59499999999999997},"min":{"1min":0.57099999999999995,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77700000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.54900000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.498,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.33700000000000002},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64200000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.71199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.76800000000000002,"15min":0.83799999999999997},"min":{"1min":0.248,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52800000000000002,"5min":10.282,"15min":10.282},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.81699999999999995,"15min":0.88100000000000001},"min":{"1min":0.34300000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61499999999999999,"5min":11.042,"15min":11.042},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.96699999999999997,"15min":1.0640000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52500000000000002,"5min":14.073,"15min":14.073},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.85899999999999999,"15min":0.92600000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.626,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.94199999999999995,"15min":1.022},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.91600000000000004,"15min":0.99299999999999999},"min":{"1min":0.317,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78200000000000003,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.016,"15min":1.077},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":10.971,"15min":10.971},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":1.034,"15min":1.1080000000000001},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":10.497,"15min":10.497},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":1.5449999999999999,"15min":1.6950000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":1.087,"15min":1.157},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.96599999999999997,"5min":10.935,"15min":10.935},"last":0.51800000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":1.0649999999999999,"15min":1.135},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.94699999999999995,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.6140000000000001,"15min":1.7689999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88200000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":1.073,"15min":1.1419999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.997,"5min":11.013,"15min":11.013},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":1.087,"15min":1.155},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91400000000000003,"5min":10.435,"15min":10.435},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.23599999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.28199999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.378},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.497,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.32100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.36199999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.60799999999999998,"5min":1.113,"15min":1.113},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.443,"15min":0.437},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.497},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.52900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61599999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":1.198,"15min":1.198},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84499999999999997,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.75,"5min":1.282,"15min":1.282},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.57499999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":1.3,"15min":1.3},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.46000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64600000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85399999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.626,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":0.78800000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.998,"15min":0.998},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.37},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35499999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.437},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.76700000000000002,"5min":1.044,"15min":1.044},"last":0.41199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:20:59.869 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T12:19:42.352168+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=19, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:20:59.870 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:21:19.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:21:20.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.008+0000 7f8442b0a700 1 Processor -- start 2023-10-14T12:21:20.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.009+0000 7f8442b0a700 1 -- start start 2023-10-14T12:21:20.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.009+0000 7f8442b0a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f843c15ab10 0x7f843c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.009+0000 7f8442b0a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c0cfe30 0x7f843c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.009+0000 7f8442b0a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c15e7a0 con 0x7f843c0b1f50 2023-10-14T12:21:20.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.009+0000 7f8442b0a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c15f730 con 0x7f843c15ab10 2023-10-14T12:21:20.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.009+0000 7f8442b0a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0b29a0 con 0x7f843c0cfe30 2023-10-14T12:21:20.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84408a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f843c15ab10 0x7f843c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84410a7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c0cfe30 0x7f843c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f843bfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f843c0b1f50 0x7f843c0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.32:56298/0 (socket says 172.21.15.32:56298) 2023-10-14T12:21:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f843bfff700 1 -- 172.21.15.32:0/2778373102 learned_addr learned my addr 172.21.15.32:0/2778373102 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:21:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84408a6700 1 -- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c0cfe30 msgr2=0x7f843c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:21:20.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84408a6700 1 --2- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c0cfe30 0x7f843c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84408a6700 1 -- 172.21.15.32:0/2778373102 >> v1:172.21.15.92:6789/0 conn(0x7f843c0b1f50 legacy=0x7f843c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84408a6700 1 -- 172.21.15.32:0/2778373102 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0b2c80 con 0x7f843c15ab10 2023-10-14T12:21:20.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84410a7700 1 --2- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c0cfe30 0x7f843c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:21:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.010+0000 7f84408a6700 1 --2- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c15ab10 0x7f843c15f1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8430009840 tx=0x7f8430009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76a9cd8b3177d1f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f843b7fe700 1 -- 172.21.15.32:0/2778373102 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430011830 con 0x7f843c15ab10 2023-10-14T12:21:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f843b7fe700 1 -- 172.21.15.32:0/2778373102 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430011990 con 0x7f843c15ab10 2023-10-14T12:21:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f843b7fe700 1 -- 172.21.15.32:0/2778373102 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430011d20 con 0x7f843c15ab10 2023-10-14T12:21:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 -- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c15ab10 msgr2=0x7f843c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 --2- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c15ab10 0x7f843c15f1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8430009840 tx=0x7f8430009b50 comp rx=0 tx=0).stop 2023-10-14T12:21:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 -- 172.21.15.32:0/2778373102 shutdown_connections 2023-10-14T12:21:20.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 --2- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c0cfe30 0x7f843c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 --2- 172.21.15.32:0/2778373102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c15ab10 0x7f843c15f1f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 -- 172.21.15.32:0/2778373102 >> 172.21.15.32:0/2778373102 conn(0x7f843c06dae0 msgr2=0x7f843c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:21:20.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 -- 172.21.15.32:0/2778373102 shutdown_connections 2023-10-14T12:21:20.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.011+0000 7f8442b0a700 1 -- 172.21.15.32:0/2778373102 wait complete. 2023-10-14T12:21:20.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.012+0000 7f8442b0a700 1 Processor -- start 2023-10-14T12:21:20.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 -- start start 2023-10-14T12:21:20.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 0x7f843c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c0cfe30 0x7f843c1f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c15ab10 0x7f843c0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c75a0 con 0x7f843c0b1f50 2023-10-14T12:21:20.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c77b0 con 0x7f843c0cfe30 2023-10-14T12:21:20.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.013+0000 7f8442b0a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c7a90 con 0x7f843c15ab10 2023-10-14T12:21:20.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 0x7f843c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 0x7f843c146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40404/0 (socket says 172.21.15.32:40404) 2023-10-14T12:21:20.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 -- 172.21.15.32:0/3490706030 learned_addr learned my addr 172.21.15.32:0/3490706030 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:21:20.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f843bfff700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c0cfe30 0x7f843c1f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84410a7700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c15ab10 0x7f843c0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 -- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c15ab10 msgr2=0x7f843c0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c15ab10 0x7f843c0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 -- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c0cfe30 msgr2=0x7f843c1f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c0cfe30 0x7f843c1f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 -- 172.21.15.32:0/3490706030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434009a70 con 0x7f843c0b1f50 2023-10-14T12:21:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84408a6700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 0x7f843c146a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8430009fd0 tx=0x7f8430004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300036a0 con 0x7f843c0b1f50 2023-10-14T12:21:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843001f070 con 0x7f843c0b1f50 2023-10-14T12:21:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84300094a0 con 0x7f843c0b1f50 2023-10-14T12:21:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430003a40 con 0x7f843c0b1f50 2023-10-14T12:21:20.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.014+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c0c8050 con 0x7f843c0b1f50 2023-10-14T12:21:20.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.015+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c067d20 con 0x7f843c0b1f50 2023-10-14T12:21:20.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.016+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8430003ba0 con 0x7f843c0b1f50 2023-10-14T12:21:20.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.016+0000 7f84397fa700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f842006af00 0x7f842006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.016+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8430021070 con 0x7f843c0b1f50 2023-10-14T12:21:20.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.016+0000 7f843bfff700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f842006af00 0x7f842006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.017+0000 7f843bfff700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f842006af00 0x7f842006d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f843c0c4190 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.021+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8430055ed0 con 0x7f843c0b1f50 2023-10-14T12:21:20.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.218+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 --> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f843c15ecd0 con 0x7f842006af00 2023-10-14T12:21:20.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.227+0000 7f84397fa700 1 -- 172.21.15.32:0/3490706030 <== mgr.4101 v2:172.21.15.92:6832/2571467497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290760 (secure 0 0 0) 0x7f8428001d50 con 0x7f842006af00 2023-10-14T12:21:20.233 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:21:20.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f842006af00 msgr2=0x7f842006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f842006af00 0x7f842006d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f843c0c4190 tx=0x7f8428009040 comp rx=0 tx=0).stop 2023-10-14T12:21:20.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 msgr2=0x7f843c146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 0x7f843c146a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8430009fd0 tx=0x7f8430004750 comp rx=0 tx=0).stop 2023-10-14T12:21:20.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 shutdown_connections 2023-10-14T12:21:20.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f843c15ab10 0x7f843c0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f843c0b1f50 0x7f843c146a40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f842006af00 0x7f842006d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 --2- 172.21.15.32:0/3490706030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f843c0cfe30 0x7f843c1f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 >> 172.21.15.32:0/3490706030 conn(0x7f843c06dae0 msgr2=0x7f843c0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:21:20.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 shutdown_connections 2023-10-14T12:21:20.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.230+0000 7f8442b0a700 1 -- 172.21.15.32:0/3490706030 wait complete. 2023-10-14T12:21:20.239 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-14T12:21:20.245 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-10-14T12:21:19.134072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224328,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750392,"statfs":{"total":773094113280,"available":772864401408,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003026"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:39.684459+0000","last_change":"2023-10-14T12:20:39.684505+0000","last_active":"2023-10-14T12:20:39.684459+0000","last_peered":"2023-10-14T12:20:39.684459+0000","last_clean":"2023-10-14T12:20:39.684459+0000","last_became_active":"2023-10-14T12:19:43.388099+0000","last_became_peered":"2023-10-14T12:19:43.388099+0000","last_unstale":"2023-10-14T12:20:39.684459+0000","last_undegraded":"2023-10-14T12:20:39.684459+0000","last_fullsized":"2023-10-14T12:20:39.684459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:39.684346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:39.684346+0000","last_clean_scrub_stamp":"2023-10-14T12:20:39.684346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:38.295884+0000","scrub_duration":0.00153739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:36.978354+0000","last_change":"2023-10-14T12:20:36.978439+0000","last_active":"2023-10-14T12:20:36.978354+0000","last_peered":"2023-10-14T12:20:36.978354+0000","last_clean":"2023-10-14T12:20:36.978354+0000","last_became_active":"2023-10-14T12:19:43.388738+0000","last_became_peered":"2023-10-14T12:19:43.388738+0000","last_unstale":"2023-10-14T12:20:36.978354+0000","last_undegraded":"2023-10-14T12:20:36.978354+0000","last_fullsized":"2023-10-14T12:20:36.978354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:36.978224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:36.978224+0000","last_clean_scrub_stamp":"2023-10-14T12:20:36.978224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:38.862798+0000","scrub_duration":0.0016748819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:20.557743+0000","last_change":"2023-10-14T12:20:20.557821+0000","last_active":"2023-10-14T12:20:20.557743+0000","last_peered":"2023-10-14T12:20:20.557743+0000","last_clean":"2023-10-14T12:20:20.557743+0000","last_became_active":"2023-10-14T12:19:43.388456+0000","last_became_peered":"2023-10-14T12:19:43.388456+0000","last_unstale":"2023-10-14T12:20:20.557743+0000","last_undegraded":"2023-10-14T12:20:20.557743+0000","last_fullsized":"2023-10-14T12:20:20.557743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:20.557621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:20.557621+0000","last_clean_scrub_stamp":"2023-10-14T12:20:20.557621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:12.490624+0000","scrub_duration":0.002131558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.000369+0000","last_change":"2023-10-14T12:20:13.000426+0000","last_active":"2023-10-14T12:20:13.000369+0000","last_peered":"2023-10-14T12:20:13.000369+0000","last_clean":"2023-10-14T12:20:13.000369+0000","last_became_active":"2023-10-14T12:19:43.390427+0000","last_became_peered":"2023-10-14T12:19:43.390427+0000","last_unstale":"2023-10-14T12:20:13.000369+0000","last_undegraded":"2023-10-14T12:20:13.000369+0000","last_fullsized":"2023-10-14T12:20:13.000369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.000229+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.000229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:12:06.144509+0000","scrub_duration":0.0019750879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.168113+0000","last_change":"2023-10-14T12:20:09.168161+0000","last_active":"2023-10-14T12:20:09.168113+0000","last_peered":"2023-10-14T12:20:09.168113+0000","last_clean":"2023-10-14T12:20:09.168113+0000","last_became_active":"2023-10-14T12:19:43.379163+0000","last_became_peered":"2023-10-14T12:19:43.379163+0000","last_unstale":"2023-10-14T12:20:09.168113+0000","last_undegraded":"2023-10-14T12:20:09.168113+0000","last_fullsized":"2023-10-14T12:20:09.168113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.168000+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.168000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:38:08.509845+0000","scrub_duration":0.001546331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:54.845063+0000","last_change":"2023-10-14T12:20:54.845166+0000","last_active":"2023-10-14T12:20:54.845063+0000","last_peered":"2023-10-14T12:20:54.845063+0000","last_clean":"2023-10-14T12:20:54.845063+0000","last_became_active":"2023-10-14T12:19:43.385039+0000","last_became_peered":"2023-10-14T12:19:43.385039+0000","last_unstale":"2023-10-14T12:20:54.845063+0000","last_undegraded":"2023-10-14T12:20:54.845063+0000","last_fullsized":"2023-10-14T12:20:54.845063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:54.844929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:54.844929+0000","last_clean_scrub_stamp":"2023-10-14T12:20:54.844929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:05.517702+0000","scrub_duration":0.0021068189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.099856+0000","last_change":"2023-10-14T12:20:05.099899+0000","last_active":"2023-10-14T12:20:05.099856+0000","last_peered":"2023-10-14T12:20:05.099856+0000","last_clean":"2023-10-14T12:20:05.099856+0000","last_became_active":"2023-10-14T12:19:43.381557+0000","last_became_peered":"2023-10-14T12:19:43.381557+0000","last_unstale":"2023-10-14T12:20:05.099856+0000","last_undegraded":"2023-10-14T12:20:05.099856+0000","last_fullsized":"2023-10-14T12:20:05.099856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:05.099748+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.099748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:03.711286+0000","scrub_duration":0.001409483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.155547+0000","last_change":"2023-10-14T12:20:03.155603+0000","last_active":"2023-10-14T12:20:03.155547+0000","last_peered":"2023-10-14T12:20:03.155547+0000","last_clean":"2023-10-14T12:20:03.155547+0000","last_became_active":"2023-10-14T12:19:43.382350+0000","last_became_peered":"2023-10-14T12:19:43.382350+0000","last_unstale":"2023-10-14T12:20:03.155547+0000","last_undegraded":"2023-10-14T12:20:03.155547+0000","last_fullsized":"2023-10-14T12:20:03.155547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155409+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:24.804563+0000","scrub_duration":0.001673566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:34.269244+0000","last_change":"2023-10-14T12:20:34.269329+0000","last_active":"2023-10-14T12:20:34.269244+0000","last_peered":"2023-10-14T12:20:34.269244+0000","last_clean":"2023-10-14T12:20:34.269244+0000","last_became_active":"2023-10-14T12:19:43.388321+0000","last_became_peered":"2023-10-14T12:19:43.388321+0000","last_unstale":"2023-10-14T12:20:34.269244+0000","last_undegraded":"2023-10-14T12:20:34.269244+0000","last_fullsized":"2023-10-14T12:20:34.269244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:34.269110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:34.269110+0000","last_clean_scrub_stamp":"2023-10-14T12:20:34.269110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:47.418608+0000","scrub_duration":0.0019946260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.009920+0000","last_change":"2023-10-14T12:20:12.009966+0000","last_active":"2023-10-14T12:20:12.009920+0000","last_peered":"2023-10-14T12:20:12.009920+0000","last_clean":"2023-10-14T12:20:12.009920+0000","last_became_active":"2023-10-14T12:19:43.382381+0000","last_became_peered":"2023-10-14T12:19:43.382381+0000","last_unstale":"2023-10-14T12:20:12.009920+0000","last_undegraded":"2023-10-14T12:20:12.009920+0000","last_fullsized":"2023-10-14T12:20:12.009920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.009806+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.009806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:30.037499+0000","scrub_duration":0.0015351309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:35.189438+0000","last_change":"2023-10-14T12:20:35.189486+0000","last_active":"2023-10-14T12:20:35.189438+0000","last_peered":"2023-10-14T12:20:35.189438+0000","last_clean":"2023-10-14T12:20:35.189438+0000","last_became_active":"2023-10-14T12:19:43.384690+0000","last_became_peered":"2023-10-14T12:19:43.384690+0000","last_unstale":"2023-10-14T12:20:35.189438+0000","last_undegraded":"2023-10-14T12:20:35.189438+0000","last_fullsized":"2023-10-14T12:20:35.189438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:35.189293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:35.189293+0000","last_clean_scrub_stamp":"2023-10-14T12:20:35.189293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:51:44.592819+0000","scrub_duration":0.0023706579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:26.531163+0000","last_change":"2023-10-14T12:20:26.531220+0000","last_active":"2023-10-14T12:20:26.531163+0000","last_peered":"2023-10-14T12:20:26.531163+0000","last_clean":"2023-10-14T12:20:26.531163+0000","last_became_active":"2023-10-14T12:19:43.384760+0000","last_became_peered":"2023-10-14T12:19:43.384760+0000","last_unstale":"2023-10-14T12:20:26.531163+0000","last_undegraded":"2023-10-14T12:20:26.531163+0000","last_fullsized":"2023-10-14T12:20:26.531163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:26.531030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:26.531030+0000","last_clean_scrub_stamp":"2023-10-14T12:20:26.531030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:06.572536+0000","scrub_duration":0.0019563380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.024673+0000","last_change":"2023-10-14T12:20:18.024718+0000","last_active":"2023-10-14T12:20:18.024673+0000","last_peered":"2023-10-14T12:20:18.024673+0000","last_clean":"2023-10-14T12:20:18.024673+0000","last_became_active":"2023-10-14T12:19:43.382370+0000","last_became_peered":"2023-10-14T12:19:43.382370+0000","last_unstale":"2023-10-14T12:20:18.024673+0000","last_undegraded":"2023-10-14T12:20:18.024673+0000","last_fullsized":"2023-10-14T12:20:18.024673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.024565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.024565+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.024565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:38.085254+0000","scrub_duration":0.0017125510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:56.854099+0000","last_change":"2023-10-14T12:20:56.854197+0000","last_active":"2023-10-14T12:20:56.854099+0000","last_peered":"2023-10-14T12:20:56.854099+0000","last_clean":"2023-10-14T12:20:56.854099+0000","last_became_active":"2023-10-14T12:19:43.380141+0000","last_became_peered":"2023-10-14T12:19:43.380141+0000","last_unstale":"2023-10-14T12:20:56.854099+0000","last_undegraded":"2023-10-14T12:20:56.854099+0000","last_fullsized":"2023-10-14T12:20:56.854099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:56.853973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:56.853973+0000","last_clean_scrub_stamp":"2023-10-14T12:20:56.853973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:36.807196+0000","scrub_duration":0.0018466330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.534302+0000","last_change":"2023-10-14T12:20:24.534379+0000","last_active":"2023-10-14T12:20:24.534302+0000","last_peered":"2023-10-14T12:20:24.534302+0000","last_clean":"2023-10-14T12:20:24.534302+0000","last_became_active":"2023-10-14T12:19:43.384786+0000","last_became_peered":"2023-10-14T12:19:43.384786+0000","last_unstale":"2023-10-14T12:20:24.534302+0000","last_undegraded":"2023-10-14T12:20:24.534302+0000","last_fullsized":"2023-10-14T12:20:24.534302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.534176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.534176+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.534176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:37.683674+0000","scrub_duration":0.0016716260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.193221+0000","last_change":"2023-10-14T12:20:18.193265+0000","last_active":"2023-10-14T12:20:18.193221+0000","last_peered":"2023-10-14T12:20:18.193221+0000","last_clean":"2023-10-14T12:20:18.193221+0000","last_became_active":"2023-10-14T12:19:43.383835+0000","last_became_peered":"2023-10-14T12:19:43.383835+0000","last_unstale":"2023-10-14T12:20:18.193221+0000","last_undegraded":"2023-10-14T12:20:18.193221+0000","last_fullsized":"2023-10-14T12:20:18.193221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.193108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.193108+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.193108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:59.870821+0000","scrub_duration":0.001714667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:09.180615+0000","last_change":"2023-10-14T12:20:09.180663+0000","last_active":"2023-10-14T12:20:09.180615+0000","last_peered":"2023-10-14T12:20:09.180615+0000","last_clean":"2023-10-14T12:20:09.180615+0000","last_became_active":"2023-10-14T12:19:43.380938+0000","last_became_peered":"2023-10-14T12:19:43.380938+0000","last_unstale":"2023-10-14T12:20:09.180615+0000","last_undegraded":"2023-10-14T12:20:09.180615+0000","last_fullsized":"2023-10-14T12:20:09.180615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:09.180502+0000","last_clean_scrub_stamp":"2023-10-14T12:20:09.180502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:59:31.918129+0000","scrub_duration":0.001560082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:42.897083+0000","last_change":"2023-10-14T12:20:42.897137+0000","last_active":"2023-10-14T12:20:42.897083+0000","last_peered":"2023-10-14T12:20:42.897083+0000","last_clean":"2023-10-14T12:20:42.897083+0000","last_became_active":"2023-10-14T12:19:43.383315+0000","last_became_peered":"2023-10-14T12:19:43.383315+0000","last_unstale":"2023-10-14T12:20:42.897083+0000","last_undegraded":"2023-10-14T12:20:42.897083+0000","last_fullsized":"2023-10-14T12:20:42.897083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:42.896962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:42.896962+0000","last_clean_scrub_stamp":"2023-10-14T12:20:42.896962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:27.262123+0000","scrub_duration":0.001660894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:41.909357+0000","last_change":"2023-10-14T12:20:41.909432+0000","last_active":"2023-10-14T12:20:41.909357+0000","last_peered":"2023-10-14T12:20:41.909357+0000","last_clean":"2023-10-14T12:20:41.909357+0000","last_became_active":"2023-10-14T12:19:43.384693+0000","last_became_peered":"2023-10-14T12:19:43.384693+0000","last_unstale":"2023-10-14T12:20:41.909357+0000","last_undegraded":"2023-10-14T12:20:41.909357+0000","last_fullsized":"2023-10-14T12:20:41.909357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:41.909181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:41.909181+0000","last_clean_scrub_stamp":"2023-10-14T12:20:41.909181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:24:44.213902+0000","scrub_duration":0.0017362969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:25.095733+0000","last_change":"2023-10-14T12:20:25.095813+0000","last_active":"2023-10-14T12:20:25.095733+0000","last_peered":"2023-10-14T12:20:25.095733+0000","last_clean":"2023-10-14T12:20:25.095733+0000","last_became_active":"2023-10-14T12:19:43.388936+0000","last_became_peered":"2023-10-14T12:19:43.388936+0000","last_unstale":"2023-10-14T12:20:25.095733+0000","last_undegraded":"2023-10-14T12:20:25.095733+0000","last_fullsized":"2023-10-14T12:20:25.095733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:25.095589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:25.095589+0000","last_clean_scrub_stamp":"2023-10-14T12:20:25.095589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:59.854820+0000","scrub_duration":0.0020046339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:37.342413+0000","last_change":"2023-10-14T12:20:37.342465+0000","last_active":"2023-10-14T12:20:37.342413+0000","last_peered":"2023-10-14T12:20:37.342413+0000","last_clean":"2023-10-14T12:20:37.342413+0000","last_became_active":"2023-10-14T12:19:43.390484+0000","last_became_peered":"2023-10-14T12:19:43.390484+0000","last_unstale":"2023-10-14T12:20:37.342413+0000","last_undegraded":"2023-10-14T12:20:37.342413+0000","last_fullsized":"2023-10-14T12:20:37.342413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:37.342309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:37.342309+0000","last_clean_scrub_stamp":"2023-10-14T12:20:37.342309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:39.226883+0000","scrub_duration":0.0019210589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:25.158938+0000","last_change":"2023-10-14T12:20:25.159037+0000","last_active":"2023-10-14T12:20:25.158938+0000","last_peered":"2023-10-14T12:20:25.158938+0000","last_clean":"2023-10-14T12:20:25.158938+0000","last_became_active":"2023-10-14T12:19:43.385991+0000","last_became_peered":"2023-10-14T12:19:43.385991+0000","last_unstale":"2023-10-14T12:20:25.158938+0000","last_undegraded":"2023-10-14T12:20:25.158938+0000","last_fullsized":"2023-10-14T12:20:25.158938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:25.158825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:25.158825+0000","last_clean_scrub_stamp":"2023-10-14T12:20:25.158825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:17.644950+0000","scrub_duration":0.001945986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.151021+0000","last_change":"2023-10-14T12:20:07.151083+0000","last_active":"2023-10-14T12:20:07.151021+0000","last_peered":"2023-10-14T12:20:07.151021+0000","last_clean":"2023-10-14T12:20:07.151021+0000","last_became_active":"2023-10-14T12:19:43.383293+0000","last_became_peered":"2023-10-14T12:19:43.383293+0000","last_unstale":"2023-10-14T12:20:07.151021+0000","last_undegraded":"2023-10-14T12:20:07.151021+0000","last_fullsized":"2023-10-14T12:20:07.151021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.150921+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.150921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.119523+0000","scrub_duration":0.002059576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.565408+0000","last_change":"2023-10-14T12:20:06.565489+0000","last_active":"2023-10-14T12:20:06.565408+0000","last_peered":"2023-10-14T12:20:06.565408+0000","last_clean":"2023-10-14T12:20:06.565408+0000","last_became_active":"2023-10-14T12:19:43.381657+0000","last_became_peered":"2023-10-14T12:19:43.381657+0000","last_unstale":"2023-10-14T12:20:06.565408+0000","last_undegraded":"2023-10-14T12:20:06.565408+0000","last_fullsized":"2023-10-14T12:20:06.565408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.565268+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.565268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:58.810087+0000","scrub_duration":0.0023384180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.999329+0000","last_change":"2023-10-14T12:20:13.999395+0000","last_active":"2023-10-14T12:20:13.999329+0000","last_peered":"2023-10-14T12:20:13.999329+0000","last_clean":"2023-10-14T12:20:13.999329+0000","last_became_active":"2023-10-14T12:19:43.382663+0000","last_became_peered":"2023-10-14T12:19:43.382663+0000","last_unstale":"2023-10-14T12:20:13.999329+0000","last_undegraded":"2023-10-14T12:20:13.999329+0000","last_fullsized":"2023-10-14T12:20:13.999329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.999218+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.999218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:37.632861+0000","scrub_duration":0.001812021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.983720+0000","last_change":"2023-10-14T12:19:58.983768+0000","last_active":"2023-10-14T12:19:58.983720+0000","last_peered":"2023-10-14T12:19:58.983720+0000","last_clean":"2023-10-14T12:19:58.983720+0000","last_became_active":"2023-10-14T12:19:43.380460+0000","last_became_peered":"2023-10-14T12:19:43.380460+0000","last_unstale":"2023-10-14T12:19:58.983720+0000","last_undegraded":"2023-10-14T12:19:58.983720+0000","last_fullsized":"2023-10-14T12:19:58.983720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.983621+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.983621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:20.632775+0000","scrub_duration":0.0017119399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:19.977932+0000","last_change":"2023-10-14T12:20:19.978012+0000","last_active":"2023-10-14T12:20:19.977932+0000","last_peered":"2023-10-14T12:20:19.977932+0000","last_clean":"2023-10-14T12:20:19.977932+0000","last_became_active":"2023-10-14T12:19:43.390620+0000","last_became_peered":"2023-10-14T12:19:43.390620+0000","last_unstale":"2023-10-14T12:20:19.977932+0000","last_undegraded":"2023-10-14T12:20:19.977932+0000","last_fullsized":"2023-10-14T12:20:19.977932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:19.977782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:19.977782+0000","last_clean_scrub_stamp":"2023-10-14T12:20:19.977782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.759071+0000","scrub_duration":0.0022331830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:23.545929+0000","last_change":"2023-10-14T12:20:23.545994+0000","last_active":"2023-10-14T12:20:23.545929+0000","last_peered":"2023-10-14T12:20:23.545929+0000","last_clean":"2023-10-14T12:20:23.545929+0000","last_became_active":"2023-10-14T12:19:43.386529+0000","last_became_peered":"2023-10-14T12:19:43.386529+0000","last_unstale":"2023-10-14T12:20:23.545929+0000","last_undegraded":"2023-10-14T12:20:23.545929+0000","last_fullsized":"2023-10-14T12:20:23.545929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:23.545804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:23.545804+0000","last_clean_scrub_stamp":"2023-10-14T12:20:23.545804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:24.857034+0000","scrub_duration":0.0019879759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:29.245958+0000","last_change":"2023-10-14T12:20:29.246006+0000","last_active":"2023-10-14T12:20:29.245958+0000","last_peered":"2023-10-14T12:20:29.245958+0000","last_clean":"2023-10-14T12:20:29.245958+0000","last_became_active":"2023-10-14T12:19:43.387635+0000","last_became_peered":"2023-10-14T12:19:43.387635+0000","last_unstale":"2023-10-14T12:20:29.245958+0000","last_undegraded":"2023-10-14T12:20:29.245958+0000","last_fullsized":"2023-10-14T12:20:29.245958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:29.245840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:29.245840+0000","last_clean_scrub_stamp":"2023-10-14T12:20:29.245840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:35.737169+0000","scrub_duration":0.0020797989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:39.276579+0000","last_change":"2023-10-14T12:20:39.276649+0000","last_active":"2023-10-14T12:20:39.276579+0000","last_peered":"2023-10-14T12:20:39.276579+0000","last_clean":"2023-10-14T12:20:39.276579+0000","last_became_active":"2023-10-14T12:19:43.383898+0000","last_became_peered":"2023-10-14T12:19:43.383898+0000","last_unstale":"2023-10-14T12:20:39.276579+0000","last_undegraded":"2023-10-14T12:20:39.276579+0000","last_fullsized":"2023-10-14T12:20:39.276579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:39.276444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:39.276444+0000","last_clean_scrub_stamp":"2023-10-14T12:20:39.276444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:40.967083+0000","scrub_duration":0.0016520549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:29.788984+0000","last_change":"2023-10-14T12:20:29.789036+0000","last_active":"2023-10-14T12:20:29.788984+0000","last_peered":"2023-10-14T12:20:29.788984+0000","last_clean":"2023-10-14T12:20:29.788984+0000","last_became_active":"2023-10-14T12:19:43.379897+0000","last_became_peered":"2023-10-14T12:19:43.379897+0000","last_unstale":"2023-10-14T12:20:29.788984+0000","last_undegraded":"2023-10-14T12:20:29.788984+0000","last_fullsized":"2023-10-14T12:20:29.788984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:29.788879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:29.788879+0000","last_clean_scrub_stamp":"2023-10-14T12:20:29.788879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:53.905606+0000","scrub_duration":0.0020435869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:23.079067+0000","last_change":"2023-10-14T12:20:23.079118+0000","last_active":"2023-10-14T12:20:23.079067+0000","last_peered":"2023-10-14T12:20:23.079067+0000","last_clean":"2023-10-14T12:20:23.079067+0000","last_became_active":"2023-10-14T12:19:43.389526+0000","last_became_peered":"2023-10-14T12:19:43.389526+0000","last_unstale":"2023-10-14T12:20:23.079067+0000","last_undegraded":"2023-10-14T12:20:23.079067+0000","last_fullsized":"2023-10-14T12:20:23.079067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:23.078951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:23.078951+0000","last_clean_scrub_stamp":"2023-10-14T12:20:23.078951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:15.011954+0000","scrub_duration":0.0015491680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.178018+0000","last_change":"2023-10-14T12:20:15.178066+0000","last_active":"2023-10-14T12:20:15.178018+0000","last_peered":"2023-10-14T12:20:15.178018+0000","last_clean":"2023-10-14T12:20:15.178018+0000","last_became_active":"2023-10-14T12:19:43.393282+0000","last_became_peered":"2023-10-14T12:19:43.393282+0000","last_unstale":"2023-10-14T12:20:15.178018+0000","last_undegraded":"2023-10-14T12:20:15.178018+0000","last_fullsized":"2023-10-14T12:20:15.178018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.177907+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.177907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:13.789446+0000","scrub_duration":0.0021094970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.863385+0000","last_change":"2023-10-14T12:20:24.863447+0000","last_active":"2023-10-14T12:20:24.863385+0000","last_peered":"2023-10-14T12:20:24.863385+0000","last_clean":"2023-10-14T12:20:24.863385+0000","last_became_active":"2023-10-14T12:19:42.372473+0000","last_became_peered":"2023-10-14T12:19:42.372473+0000","last_unstale":"2023-10-14T12:20:24.863385+0000","last_undegraded":"2023-10-14T12:20:24.863385+0000","last_fullsized":"2023-10-14T12:20:24.863385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-10-14T12:20:24.863277+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-10-14T12:20:24.863277+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.863277+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:44.527722+0000","scrub_duration":0.0040846679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:37.696708+0000","last_change":"2023-10-14T12:20:37.696753+0000","last_active":"2023-10-14T12:20:37.696708+0000","last_peered":"2023-10-14T12:20:37.696708+0000","last_clean":"2023-10-14T12:20:37.696708+0000","last_became_active":"2023-10-14T12:19:43.389602+0000","last_became_peered":"2023-10-14T12:19:43.389602+0000","last_unstale":"2023-10-14T12:20:37.696708+0000","last_undegraded":"2023-10-14T12:20:37.696708+0000","last_fullsized":"2023-10-14T12:20:37.696708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:37.696599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:37.696599+0000","last_clean_scrub_stamp":"2023-10-14T12:20:37.696599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:27:26.431675+0000","scrub_duration":0.001573161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:05.072983+0000","last_change":"2023-10-14T12:20:05.073083+0000","last_active":"2023-10-14T12:20:05.072983+0000","last_peered":"2023-10-14T12:20:05.072983+0000","last_clean":"2023-10-14T12:20:05.072983+0000","last_became_active":"2023-10-14T12:19:42.374235+0000","last_became_peered":"2023-10-14T12:19:42.374235+0000","last_unstale":"2023-10-14T12:20:05.072983+0000","last_undegraded":"2023-10-14T12:20:05.072983+0000","last_fullsized":"2023-10-14T12:20:05.072983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:05.072872+0000","last_clean_scrub_stamp":"2023-10-14T12:20:05.072872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:01.324353+0000","scrub_duration":0.0018346199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:27.162635+0000","last_change":"2023-10-14T12:20:27.162691+0000","last_active":"2023-10-14T12:20:27.162635+0000","last_peered":"2023-10-14T12:20:27.162635+0000","last_clean":"2023-10-14T12:20:27.162635+0000","last_became_active":"2023-10-14T12:19:43.387661+0000","last_became_peered":"2023-10-14T12:19:43.387661+0000","last_unstale":"2023-10-14T12:20:27.162635+0000","last_undegraded":"2023-10-14T12:20:27.162635+0000","last_fullsized":"2023-10-14T12:20:27.162635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:27.162528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:27.162528+0000","last_clean_scrub_stamp":"2023-10-14T12:20:27.162528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:37.690610+0000","scrub_duration":0.001882274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.917181+0000","last_change":"2023-10-14T12:20:04.917281+0000","last_active":"2023-10-14T12:20:04.917181+0000","last_peered":"2023-10-14T12:20:04.917181+0000","last_clean":"2023-10-14T12:20:04.917181+0000","last_became_active":"2023-10-14T12:19:42.373935+0000","last_became_peered":"2023-10-14T12:19:42.373935+0000","last_unstale":"2023-10-14T12:20:04.917181+0000","last_undegraded":"2023-10-14T12:20:04.917181+0000","last_fullsized":"2023-10-14T12:20:04.917181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:04.917043+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.917043+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:22.944736+0000","scrub_duration":0.0021985300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.960780+0000","last_change":"2023-10-14T12:20:18.960862+0000","last_active":"2023-10-14T12:20:18.960780+0000","last_peered":"2023-10-14T12:20:18.960780+0000","last_clean":"2023-10-14T12:20:18.960780+0000","last_became_active":"2023-10-14T12:19:43.391039+0000","last_became_peered":"2023-10-14T12:19:43.391039+0000","last_unstale":"2023-10-14T12:20:18.960780+0000","last_undegraded":"2023-10-14T12:20:18.960780+0000","last_fullsized":"2023-10-14T12:20:18.960780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.960681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.960681+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.960681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:08:25.452010+0000","scrub_duration":0.001547671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:56.143539+0000","last_change":"2023-10-14T12:19:56.143579+0000","last_active":"2023-10-14T12:19:56.143539+0000","last_peered":"2023-10-14T12:19:56.143539+0000","last_clean":"2023-10-14T12:19:56.143539+0000","last_became_active":"2023-10-14T12:19:42.377282+0000","last_became_peered":"2023-10-14T12:19:42.377282+0000","last_unstale":"2023-10-14T12:19:56.143539+0000","last_undegraded":"2023-10-14T12:19:56.143539+0000","last_fullsized":"2023-10-14T12:19:56.143539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:56.143469+0000","last_clean_scrub_stamp":"2023-10-14T12:19:56.143469+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:45.317148+0000","scrub_duration":0.0014353720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.169240+0000","last_change":"2023-10-14T12:20:12.169285+0000","last_active":"2023-10-14T12:20:12.169240+0000","last_peered":"2023-10-14T12:20:12.169240+0000","last_clean":"2023-10-14T12:20:12.169240+0000","last_became_active":"2023-10-14T12:19:43.389132+0000","last_became_peered":"2023-10-14T12:19:43.389132+0000","last_unstale":"2023-10-14T12:20:12.169240+0000","last_undegraded":"2023-10-14T12:20:12.169240+0000","last_fullsized":"2023-10-14T12:20:12.169240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.169111+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.169111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:40.089199+0000","scrub_duration":0.001529844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.075374+0000","last_change":"2023-10-14T12:20:00.075474+0000","last_active":"2023-10-14T12:20:00.075374+0000","last_peered":"2023-10-14T12:20:00.075374+0000","last_clean":"2023-10-14T12:20:00.075374+0000","last_became_active":"2023-10-14T12:19:42.375365+0000","last_became_peered":"2023-10-14T12:19:42.375365+0000","last_unstale":"2023-10-14T12:20:00.075374+0000","last_undegraded":"2023-10-14T12:20:00.075374+0000","last_fullsized":"2023-10-14T12:20:00.075374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:00.075202+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.075202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:24.888838+0000","scrub_duration":0.0020269469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.582106+0000","last_change":"2023-10-14T12:20:07.582203+0000","last_active":"2023-10-14T12:20:07.582106+0000","last_peered":"2023-10-14T12:20:07.582106+0000","last_clean":"2023-10-14T12:20:07.582106+0000","last_became_active":"2023-10-14T12:19:43.390188+0000","last_became_peered":"2023-10-14T12:19:43.390188+0000","last_unstale":"2023-10-14T12:20:07.582106+0000","last_undegraded":"2023-10-14T12:20:07.582106+0000","last_fullsized":"2023-10-14T12:20:07.582106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:07.581991+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.581991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:25.609684+0000","scrub_duration":0.0024689830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.036968+0000","last_change":"2023-10-14T12:20:07.037030+0000","last_active":"2023-10-14T12:20:07.036968+0000","last_peered":"2023-10-14T12:20:07.036968+0000","last_clean":"2023-10-14T12:20:07.036968+0000","last_became_active":"2023-10-14T12:19:42.374714+0000","last_became_peered":"2023-10-14T12:19:42.374714+0000","last_unstale":"2023-10-14T12:20:07.036968+0000","last_undegraded":"2023-10-14T12:20:07.036968+0000","last_fullsized":"2023-10-14T12:20:07.036968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:07.036858+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.036858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:50:03.288339+0000","scrub_duration":0.0028120160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.180648+0000","last_change":"2023-10-14T12:20:24.180746+0000","last_active":"2023-10-14T12:20:24.180648+0000","last_peered":"2023-10-14T12:20:24.180648+0000","last_clean":"2023-10-14T12:20:24.180648+0000","last_became_active":"2023-10-14T12:19:43.384736+0000","last_became_peered":"2023-10-14T12:19:43.384736+0000","last_unstale":"2023-10-14T12:20:24.180648+0000","last_undegraded":"2023-10-14T12:20:24.180648+0000","last_fullsized":"2023-10-14T12:20:24.180648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.180507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.180507+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.180507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:52.100595+0000","scrub_duration":0.001566139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.918650+0000","last_change":"2023-10-14T12:20:02.918708+0000","last_active":"2023-10-14T12:20:02.918650+0000","last_peered":"2023-10-14T12:20:02.918650+0000","last_clean":"2023-10-14T12:20:02.918650+0000","last_became_active":"2023-10-14T12:19:42.373555+0000","last_became_peered":"2023-10-14T12:19:42.373555+0000","last_unstale":"2023-10-14T12:20:02.918650+0000","last_undegraded":"2023-10-14T12:20:02.918650+0000","last_fullsized":"2023-10-14T12:20:02.918650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.918526+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.918526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:31.370887+0000","scrub_duration":0.0015505899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:17.017122+0000","last_change":"2023-10-14T12:20:17.017174+0000","last_active":"2023-10-14T12:20:17.017122+0000","last_peered":"2023-10-14T12:20:17.017122+0000","last_clean":"2023-10-14T12:20:17.017122+0000","last_became_active":"2023-10-14T12:19:43.386686+0000","last_became_peered":"2023-10-14T12:19:43.386686+0000","last_unstale":"2023-10-14T12:20:17.017122+0000","last_undegraded":"2023-10-14T12:20:17.017122+0000","last_fullsized":"2023-10-14T12:20:17.017122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:17.016992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:17.016992+0000","last_clean_scrub_stamp":"2023-10-14T12:20:17.016992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:58.694705+0000","scrub_duration":0.0018999450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.087258+0000","last_change":"2023-10-14T12:20:02.087309+0000","last_active":"2023-10-14T12:20:02.087258+0000","last_peered":"2023-10-14T12:20:02.087258+0000","last_clean":"2023-10-14T12:20:02.087258+0000","last_became_active":"2023-10-14T12:19:42.371797+0000","last_became_peered":"2023-10-14T12:19:42.371797+0000","last_unstale":"2023-10-14T12:20:02.087258+0000","last_undegraded":"2023-10-14T12:20:02.087258+0000","last_fullsized":"2023-10-14T12:20:02.087258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.087127+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.087127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.572933+0000","scrub_duration":0.001469337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.549309+0000","last_change":"2023-10-14T12:20:13.549409+0000","last_active":"2023-10-14T12:20:13.549309+0000","last_peered":"2023-10-14T12:20:13.549309+0000","last_clean":"2023-10-14T12:20:13.549309+0000","last_became_active":"2023-10-14T12:19:43.382048+0000","last_became_peered":"2023-10-14T12:19:43.382048+0000","last_unstale":"2023-10-14T12:20:13.549309+0000","last_undegraded":"2023-10-14T12:20:13.549309+0000","last_fullsized":"2023-10-14T12:20:13.549309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.549155+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.549155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:30:06.035279+0000","scrub_duration":0.0019478570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.817693+0000","last_change":"2023-10-14T12:20:12.817784+0000","last_active":"2023-10-14T12:20:12.817693+0000","last_peered":"2023-10-14T12:20:12.817693+0000","last_clean":"2023-10-14T12:20:12.817693+0000","last_became_active":"2023-10-14T12:19:42.372096+0000","last_became_peered":"2023-10-14T12:19:42.372096+0000","last_unstale":"2023-10-14T12:20:12.817693+0000","last_undegraded":"2023-10-14T12:20:12.817693+0000","last_fullsized":"2023-10-14T12:20:12.817693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:12.817563+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.817563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:01:51.379754+0000","scrub_duration":0.002143697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:38.967774+0000","last_change":"2023-10-14T12:20:38.967826+0000","last_active":"2023-10-14T12:20:38.967774+0000","last_peered":"2023-10-14T12:20:38.967774+0000","last_clean":"2023-10-14T12:20:38.967774+0000","last_became_active":"2023-10-14T12:19:43.383253+0000","last_became_peered":"2023-10-14T12:19:43.383253+0000","last_unstale":"2023-10-14T12:20:38.967774+0000","last_undegraded":"2023-10-14T12:20:38.967774+0000","last_fullsized":"2023-10-14T12:20:38.967774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:38.967648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:38.967648+0000","last_clean_scrub_stamp":"2023-10-14T12:20:38.967648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:14.703557+0000","scrub_duration":0.00162258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.014408+0000","last_change":"2023-10-14T12:20:02.014482+0000","last_active":"2023-10-14T12:20:02.014408+0000","last_peered":"2023-10-14T12:20:02.014408+0000","last_clean":"2023-10-14T12:20:02.014408+0000","last_became_active":"2023-10-14T12:19:42.376145+0000","last_became_peered":"2023-10-14T12:19:42.376145+0000","last_unstale":"2023-10-14T12:20:02.014408+0000","last_undegraded":"2023-10-14T12:20:02.014408+0000","last_fullsized":"2023-10-14T12:20:02.014408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.014280+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.014280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:23:24.500085+0000","scrub_duration":0.0016626200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.875859+0000","last_change":"2023-10-14T12:20:22.875915+0000","last_active":"2023-10-14T12:20:22.875859+0000","last_peered":"2023-10-14T12:20:22.875859+0000","last_clean":"2023-10-14T12:20:22.875859+0000","last_became_active":"2023-10-14T12:19:43.381278+0000","last_became_peered":"2023-10-14T12:19:43.381278+0000","last_unstale":"2023-10-14T12:20:22.875859+0000","last_undegraded":"2023-10-14T12:20:22.875859+0000","last_fullsized":"2023-10-14T12:20:22.875859+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.875723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.875723+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.875723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:11.908494+0000","scrub_duration":0.002186679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.528241+0000","last_change":"2023-10-14T12:20:04.528351+0000","last_active":"2023-10-14T12:20:04.528241+0000","last_peered":"2023-10-14T12:20:04.528241+0000","last_clean":"2023-10-14T12:20:04.528241+0000","last_became_active":"2023-10-14T12:19:42.373521+0000","last_became_peered":"2023-10-14T12:19:42.373521+0000","last_unstale":"2023-10-14T12:20:04.528241+0000","last_undegraded":"2023-10-14T12:20:04.528241+0000","last_fullsized":"2023-10-14T12:20:04.528241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T12:20:04.528122+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.528122+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:18.750282+0000","scrub_duration":0.0023976879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.568245+0000","last_change":"2023-10-14T12:20:22.568321+0000","last_active":"2023-10-14T12:20:22.568245+0000","last_peered":"2023-10-14T12:20:22.568245+0000","last_clean":"2023-10-14T12:20:22.568245+0000","last_became_active":"2023-10-14T12:19:43.388838+0000","last_became_peered":"2023-10-14T12:19:43.388838+0000","last_unstale":"2023-10-14T12:20:22.568245+0000","last_undegraded":"2023-10-14T12:20:22.568245+0000","last_fullsized":"2023-10-14T12:20:22.568245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.568140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.568140+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.568140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:34.165608+0000","scrub_duration":0.0021438989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:07.846992+0000","last_change":"2023-10-14T12:20:07.847108+0000","last_active":"2023-10-14T12:20:07.846992+0000","last_peered":"2023-10-14T12:20:07.846992+0000","last_clean":"2023-10-14T12:20:07.846992+0000","last_became_active":"2023-10-14T12:19:42.370845+0000","last_became_peered":"2023-10-14T12:19:42.370845+0000","last_unstale":"2023-10-14T12:20:07.846992+0000","last_undegraded":"2023-10-14T12:20:07.846992+0000","last_fullsized":"2023-10-14T12:20:07.846992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T12:20:07.846867+0000","last_clean_scrub_stamp":"2023-10-14T12:20:07.846867+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:35.766956+0000","scrub_duration":0.002747167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.013554+0000","last_change":"2023-10-14T12:20:06.013605+0000","last_active":"2023-10-14T12:20:06.013554+0000","last_peered":"2023-10-14T12:20:06.013554+0000","last_clean":"2023-10-14T12:20:06.013554+0000","last_became_active":"2023-10-14T12:19:43.379898+0000","last_became_peered":"2023-10-14T12:19:43.379898+0000","last_unstale":"2023-10-14T12:20:06.013554+0000","last_undegraded":"2023-10-14T12:20:06.013554+0000","last_fullsized":"2023-10-14T12:20:06.013554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.013441+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.013441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:04.624980+0000","scrub_duration":0.002025139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:08.025935+0000","last_change":"2023-10-14T12:20:08.025994+0000","last_active":"2023-10-14T12:20:08.025935+0000","last_peered":"2023-10-14T12:20:08.025935+0000","last_clean":"2023-10-14T12:20:08.025935+0000","last_became_active":"2023-10-14T12:19:42.373462+0000","last_became_peered":"2023-10-14T12:19:42.373462+0000","last_unstale":"2023-10-14T12:20:08.025935+0000","last_undegraded":"2023-10-14T12:20:08.025935+0000","last_fullsized":"2023-10-14T12:20:08.025935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:08.025791+0000","last_clean_scrub_stamp":"2023-10-14T12:20:08.025791+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:03.994394+0000","scrub_duration":0.0024040939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:24.847004+0000","last_change":"2023-10-14T12:20:24.847078+0000","last_active":"2023-10-14T12:20:24.847004+0000","last_peered":"2023-10-14T12:20:24.847004+0000","last_clean":"2023-10-14T12:20:24.847004+0000","last_became_active":"2023-10-14T12:19:43.382930+0000","last_became_peered":"2023-10-14T12:19:43.382930+0000","last_unstale":"2023-10-14T12:20:24.847004+0000","last_undegraded":"2023-10-14T12:20:24.847004+0000","last_fullsized":"2023-10-14T12:20:24.847004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:24.846839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:24.846839+0000","last_clean_scrub_stamp":"2023-10-14T12:20:24.846839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:32.412890+0000","scrub_duration":0.0017280290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.970221+0000","last_change":"2023-10-14T12:20:01.970277+0000","last_active":"2023-10-14T12:20:01.970221+0000","last_peered":"2023-10-14T12:20:01.970221+0000","last_clean":"2023-10-14T12:20:01.970221+0000","last_became_active":"2023-10-14T12:19:42.373519+0000","last_became_peered":"2023-10-14T12:19:42.373519+0000","last_unstale":"2023-10-14T12:20:01.970221+0000","last_undegraded":"2023-10-14T12:20:01.970221+0000","last_fullsized":"2023-10-14T12:20:01.970221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:01.970091+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.970091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:17:36.729323+0000","scrub_duration":0.0019624059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:33.196839+0000","last_change":"2023-10-14T12:20:33.196904+0000","last_active":"2023-10-14T12:20:33.196839+0000","last_peered":"2023-10-14T12:20:33.196839+0000","last_clean":"2023-10-14T12:20:33.196839+0000","last_became_active":"2023-10-14T12:19:43.389169+0000","last_became_peered":"2023-10-14T12:19:43.389169+0000","last_unstale":"2023-10-14T12:20:33.196839+0000","last_undegraded":"2023-10-14T12:20:33.196839+0000","last_fullsized":"2023-10-14T12:20:33.196839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:33.196723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:33.196723+0000","last_clean_scrub_stamp":"2023-10-14T12:20:33.196723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:22.229493+0000","scrub_duration":0.0016797069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:16.786277+0000","last_change":"2023-10-14T12:20:16.786385+0000","last_active":"2023-10-14T12:20:16.786277+0000","last_peered":"2023-10-14T12:20:16.786277+0000","last_clean":"2023-10-14T12:20:16.786277+0000","last_became_active":"2023-10-14T12:19:42.372612+0000","last_became_peered":"2023-10-14T12:19:42.372612+0000","last_unstale":"2023-10-14T12:20:16.786277+0000","last_undegraded":"2023-10-14T12:20:16.786277+0000","last_fullsized":"2023-10-14T12:20:16.786277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:16.786137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:16.786137+0000","last_clean_scrub_stamp":"2023-10-14T12:20:16.786137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:03:47.081621+0000","scrub_duration":0.0022144949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:45.626909+0000","last_change":"2023-10-14T12:20:45.626958+0000","last_active":"2023-10-14T12:20:45.626909+0000","last_peered":"2023-10-14T12:20:45.626909+0000","last_clean":"2023-10-14T12:20:45.626909+0000","last_became_active":"2023-10-14T12:19:43.391305+0000","last_became_peered":"2023-10-14T12:19:43.391305+0000","last_unstale":"2023-10-14T12:20:45.626909+0000","last_undegraded":"2023-10-14T12:20:45.626909+0000","last_fullsized":"2023-10-14T12:20:45.626909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:45.626785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:45.626785+0000","last_clean_scrub_stamp":"2023-10-14T12:20:45.626785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:03.654478+0000","scrub_duration":0.0015257549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:00.941556+0000","last_change":"2023-10-14T12:20:00.941615+0000","last_active":"2023-10-14T12:20:00.941556+0000","last_peered":"2023-10-14T12:20:00.941556+0000","last_clean":"2023-10-14T12:20:00.941556+0000","last_became_active":"2023-10-14T12:19:42.370062+0000","last_became_peered":"2023-10-14T12:19:42.370062+0000","last_unstale":"2023-10-14T12:20:00.941556+0000","last_undegraded":"2023-10-14T12:20:00.941556+0000","last_fullsized":"2023-10-14T12:20:00.941556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T12:20:00.941417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:00.941417+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:15.163577+0000","scrub_duration":0.0026495780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:32.331437+0000","last_change":"2023-10-14T12:20:32.331481+0000","last_active":"2023-10-14T12:20:32.331437+0000","last_peered":"2023-10-14T12:20:32.331437+0000","last_clean":"2023-10-14T12:20:32.331437+0000","last_became_active":"2023-10-14T12:19:43.387990+0000","last_became_peered":"2023-10-14T12:19:43.387990+0000","last_unstale":"2023-10-14T12:20:32.331437+0000","last_undegraded":"2023-10-14T12:20:32.331437+0000","last_fullsized":"2023-10-14T12:20:32.331437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:32.331320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:32.331320+0000","last_clean_scrub_stamp":"2023-10-14T12:20:32.331320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:21.364091+0000","scrub_duration":0.0015082679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.923380+0000","last_change":"2023-10-14T12:20:02.923480+0000","last_active":"2023-10-14T12:20:02.923380+0000","last_peered":"2023-10-14T12:20:02.923380+0000","last_clean":"2023-10-14T12:20:02.923380+0000","last_became_active":"2023-10-14T12:19:42.376344+0000","last_became_peered":"2023-10-14T12:19:42.376344+0000","last_unstale":"2023-10-14T12:20:02.923380+0000","last_undegraded":"2023-10-14T12:20:02.923380+0000","last_fullsized":"2023-10-14T12:20:02.923380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T12:20:02.923263+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.923263+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:27.039989+0000","scrub_duration":0.002081308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.512160+0000","last_change":"2023-10-14T12:20:11.512210+0000","last_active":"2023-10-14T12:20:11.512160+0000","last_peered":"2023-10-14T12:20:11.512160+0000","last_clean":"2023-10-14T12:20:11.512160+0000","last_became_active":"2023-10-14T12:19:43.387839+0000","last_became_peered":"2023-10-14T12:19:43.387839+0000","last_unstale":"2023-10-14T12:20:11.512160+0000","last_undegraded":"2023-10-14T12:20:11.512160+0000","last_fullsized":"2023-10-14T12:20:11.512160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.512033+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.512033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:58:39.432121+0000","scrub_duration":0.001569207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:12.053293+0000","last_change":"2023-10-14T12:20:12.053387+0000","last_active":"2023-10-14T12:20:12.053293+0000","last_peered":"2023-10-14T12:20:12.053293+0000","last_clean":"2023-10-14T12:20:12.053293+0000","last_became_active":"2023-10-14T12:19:42.373569+0000","last_became_peered":"2023-10-14T12:19:42.373569+0000","last_unstale":"2023-10-14T12:20:12.053293+0000","last_undegraded":"2023-10-14T12:20:12.053293+0000","last_fullsized":"2023-10-14T12:20:12.053293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:12.053179+0000","last_clean_scrub_stamp":"2023-10-14T12:20:12.053179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:27:00.788255+0000","scrub_duration":0.001905143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:10.038313+0000","last_change":"2023-10-14T12:20:10.038364+0000","last_active":"2023-10-14T12:20:10.038313+0000","last_peered":"2023-10-14T12:20:10.038313+0000","last_clean":"2023-10-14T12:20:10.038313+0000","last_became_active":"2023-10-14T12:19:43.388008+0000","last_became_peered":"2023-10-14T12:19:43.388008+0000","last_unstale":"2023-10-14T12:20:10.038313+0000","last_undegraded":"2023-10-14T12:20:10.038313+0000","last_fullsized":"2023-10-14T12:20:10.038313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:10.038190+0000","last_clean_scrub_stamp":"2023-10-14T12:20:10.038190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:02.283009+0000","scrub_duration":0.0020200909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:17.073907+0000","last_change":"2023-10-14T12:20:17.074004+0000","last_active":"2023-10-14T12:20:17.073907+0000","last_peered":"2023-10-14T12:20:17.073907+0000","last_clean":"2023-10-14T12:20:17.073907+0000","last_became_active":"2023-10-14T12:19:42.370210+0000","last_became_peered":"2023-10-14T12:19:42.370210+0000","last_unstale":"2023-10-14T12:20:17.073907+0000","last_undegraded":"2023-10-14T12:20:17.073907+0000","last_fullsized":"2023-10-14T12:20:17.073907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-14T12:20:17.073763+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-14T12:20:17.073763+0000","last_clean_scrub_stamp":"2023-10-14T12:20:17.073763+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:31.295923+0000","scrub_duration":0.0037557010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.125144+0000","last_change":"2023-10-14T12:20:04.125193+0000","last_active":"2023-10-14T12:20:04.125144+0000","last_peered":"2023-10-14T12:20:04.125144+0000","last_clean":"2023-10-14T12:20:04.125144+0000","last_became_active":"2023-10-14T12:19:43.382295+0000","last_became_peered":"2023-10-14T12:19:43.382295+0000","last_unstale":"2023-10-14T12:20:04.125144+0000","last_undegraded":"2023-10-14T12:20:04.125144+0000","last_fullsized":"2023-10-14T12:20:04.125144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.125041+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.125041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:34:29.907915+0000","scrub_duration":0.0022271499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:18.070420+0000","last_change":"2023-10-14T12:20:18.070489+0000","last_active":"2023-10-14T12:20:18.070420+0000","last_peered":"2023-10-14T12:20:18.070420+0000","last_clean":"2023-10-14T12:20:18.070420+0000","last_became_active":"2023-10-14T12:19:42.374204+0000","last_became_peered":"2023-10-14T12:19:42.374204+0000","last_unstale":"2023-10-14T12:20:18.070420+0000","last_undegraded":"2023-10-14T12:20:18.070420+0000","last_fullsized":"2023-10-14T12:20:18.070420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:18.070307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:18.070307+0000","last_clean_scrub_stamp":"2023-10-14T12:20:18.070307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:10.315126+0000","scrub_duration":0.001942086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.172564+0000","last_change":"2023-10-14T12:20:06.172642+0000","last_active":"2023-10-14T12:20:06.172564+0000","last_peered":"2023-10-14T12:20:06.172564+0000","last_clean":"2023-10-14T12:20:06.172564+0000","last_became_active":"2023-10-14T12:19:43.388480+0000","last_became_peered":"2023-10-14T12:19:43.388480+0000","last_unstale":"2023-10-14T12:20:06.172564+0000","last_undegraded":"2023-10-14T12:20:06.172564+0000","last_fullsized":"2023-10-14T12:20:06.172564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.172417+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.172417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:47:16.064813+0000","scrub_duration":0.0020790610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.074695+0000","last_change":"2023-10-14T12:19:57.074734+0000","last_active":"2023-10-14T12:19:57.074695+0000","last_peered":"2023-10-14T12:19:57.074695+0000","last_clean":"2023-10-14T12:19:57.074695+0000","last_became_active":"2023-10-14T12:19:42.378310+0000","last_became_peered":"2023-10-14T12:19:42.378310+0000","last_unstale":"2023-10-14T12:19:57.074695+0000","last_undegraded":"2023-10-14T12:19:57.074695+0000","last_fullsized":"2023-10-14T12:19:57.074695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:19:57.074602+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.074602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:15.118672+0000","scrub_duration":0.0016862929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:14.067511+0000","last_change":"2023-10-14T12:20:14.067566+0000","last_active":"2023-10-14T12:20:14.067511+0000","last_peered":"2023-10-14T12:20:14.067511+0000","last_clean":"2023-10-14T12:20:14.067511+0000","last_became_active":"2023-10-14T12:19:43.389856+0000","last_became_peered":"2023-10-14T12:19:43.389856+0000","last_unstale":"2023-10-14T12:20:14.067511+0000","last_undegraded":"2023-10-14T12:20:14.067511+0000","last_fullsized":"2023-10-14T12:20:14.067511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:14.067382+0000","last_clean_scrub_stamp":"2023-10-14T12:20:14.067382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:22:05.800674+0000","scrub_duration":0.0016258220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.768858+0000","last_change":"2023-10-14T12:20:15.768905+0000","last_active":"2023-10-14T12:20:15.768858+0000","last_peered":"2023-10-14T12:20:15.768858+0000","last_clean":"2023-10-14T12:20:15.768858+0000","last_became_active":"2023-10-14T12:19:42.373660+0000","last_became_peered":"2023-10-14T12:19:42.373660+0000","last_unstale":"2023-10-14T12:20:15.768858+0000","last_undegraded":"2023-10-14T12:20:15.768858+0000","last_fullsized":"2023-10-14T12:20:15.768858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.768735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.768735+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.768735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:40.582371+0000","scrub_duration":0.001862566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:02.201319+0000","last_change":"2023-10-14T12:20:02.201368+0000","last_active":"2023-10-14T12:20:02.201319+0000","last_peered":"2023-10-14T12:20:02.201319+0000","last_clean":"2023-10-14T12:20:02.201319+0000","last_became_active":"2023-10-14T12:19:43.382212+0000","last_became_peered":"2023-10-14T12:19:43.382212+0000","last_unstale":"2023-10-14T12:20:02.201319+0000","last_undegraded":"2023-10-14T12:20:02.201319+0000","last_fullsized":"2023-10-14T12:20:02.201319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:02.201208+0000","last_clean_scrub_stamp":"2023-10-14T12:20:02.201208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:54.774214+0000","scrub_duration":0.001588955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:16.062592+0000","last_change":"2023-10-14T12:20:16.062632+0000","last_active":"2023-10-14T12:20:16.062592+0000","last_peered":"2023-10-14T12:20:16.062592+0000","last_clean":"2023-10-14T12:20:16.062592+0000","last_became_active":"2023-10-14T12:19:42.370180+0000","last_became_peered":"2023-10-14T12:19:42.370180+0000","last_unstale":"2023-10-14T12:20:16.062592+0000","last_undegraded":"2023-10-14T12:20:16.062592+0000","last_fullsized":"2023-10-14T12:20:16.062592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:16.062457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:16.062457+0000","last_clean_scrub_stamp":"2023-10-14T12:20:16.062457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:37.711611+0000","scrub_duration":0.00184312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:34.205648+0000","last_change":"2023-10-14T12:20:34.205693+0000","last_active":"2023-10-14T12:20:34.205648+0000","last_peered":"2023-10-14T12:20:34.205648+0000","last_clean":"2023-10-14T12:20:34.205648+0000","last_became_active":"2023-10-14T12:19:43.383166+0000","last_became_peered":"2023-10-14T12:19:43.383166+0000","last_unstale":"2023-10-14T12:20:34.205648+0000","last_undegraded":"2023-10-14T12:20:34.205648+0000","last_fullsized":"2023-10-14T12:20:34.205648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:34.205532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:34.205532+0000","last_clean_scrub_stamp":"2023-10-14T12:20:34.205532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:41.771583+0000","scrub_duration":0.0015735370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:58.463746+0000","last_change":"2023-10-14T12:19:58.463793+0000","last_active":"2023-10-14T12:19:58.463746+0000","last_peered":"2023-10-14T12:19:58.463746+0000","last_clean":"2023-10-14T12:19:58.463746+0000","last_became_active":"2023-10-14T12:19:42.377337+0000","last_became_peered":"2023-10-14T12:19:42.377337+0000","last_unstale":"2023-10-14T12:19:58.463746+0000","last_undegraded":"2023-10-14T12:19:58.463746+0000","last_fullsized":"2023-10-14T12:19:58.463746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:58.463596+0000","last_clean_scrub_stamp":"2023-10-14T12:19:58.463596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:47.198672+0000","scrub_duration":0.001612559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.156060+0000","last_change":"2023-10-14T12:20:03.156105+0000","last_active":"2023-10-14T12:20:03.156060+0000","last_peered":"2023-10-14T12:20:03.156060+0000","last_clean":"2023-10-14T12:20:03.156060+0000","last_became_active":"2023-10-14T12:19:43.388339+0000","last_became_peered":"2023-10-14T12:19:43.388339+0000","last_unstale":"2023-10-14T12:20:03.156060+0000","last_undegraded":"2023-10-14T12:20:03.156060+0000","last_fullsized":"2023-10-14T12:20:03.156060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:03.155968+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.155968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:17.386190+0000","scrub_duration":0.0016035590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:03.968254+0000","last_change":"2023-10-14T12:20:03.968370+0000","last_active":"2023-10-14T12:20:03.968254+0000","last_peered":"2023-10-14T12:20:03.968254+0000","last_clean":"2023-10-14T12:20:03.968254+0000","last_became_active":"2023-10-14T12:19:42.376728+0000","last_became_peered":"2023-10-14T12:19:42.376728+0000","last_unstale":"2023-10-14T12:20:03.968254+0000","last_undegraded":"2023-10-14T12:20:03.968254+0000","last_fullsized":"2023-10-14T12:20:03.968254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T12:20:03.968116+0000","last_clean_scrub_stamp":"2023-10-14T12:20:03.968116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:36.443571+0000","scrub_duration":0.0026487759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:15.570382+0000","last_change":"2023-10-14T12:20:15.570427+0000","last_active":"2023-10-14T12:20:15.570382+0000","last_peered":"2023-10-14T12:20:15.570382+0000","last_clean":"2023-10-14T12:20:15.570382+0000","last_became_active":"2023-10-14T12:19:43.388381+0000","last_became_peered":"2023-10-14T12:19:43.388381+0000","last_unstale":"2023-10-14T12:20:15.570382+0000","last_undegraded":"2023-10-14T12:20:15.570382+0000","last_fullsized":"2023-10-14T12:20:15.570382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:15.570262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:15.570262+0000","last_clean_scrub_stamp":"2023-10-14T12:20:15.570262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:26.098345+0000","scrub_duration":0.0020248649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.011017+0000","last_change":"2023-10-14T12:20:01.011121+0000","last_active":"2023-10-14T12:20:01.011017+0000","last_peered":"2023-10-14T12:20:01.011017+0000","last_clean":"2023-10-14T12:20:01.011017+0000","last_became_active":"2023-10-14T12:19:42.378326+0000","last_became_peered":"2023-10-14T12:19:42.378326+0000","last_unstale":"2023-10-14T12:20:01.011017+0000","last_undegraded":"2023-10-14T12:20:01.011017+0000","last_fullsized":"2023-10-14T12:20:01.011017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T12:20:01.010896+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.010896+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:52.744188+0000","scrub_duration":0.0018949170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:11.256992+0000","last_change":"2023-10-14T12:20:11.257086+0000","last_active":"2023-10-14T12:20:11.256992+0000","last_peered":"2023-10-14T12:20:11.256992+0000","last_clean":"2023-10-14T12:20:11.256992+0000","last_became_active":"2023-10-14T12:19:43.388794+0000","last_became_peered":"2023-10-14T12:19:43.388794+0000","last_unstale":"2023-10-14T12:20:11.256992+0000","last_undegraded":"2023-10-14T12:20:11.256992+0000","last_fullsized":"2023-10-14T12:20:11.256992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:11.256856+0000","last_clean_scrub_stamp":"2023-10-14T12:20:11.256856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:59.991932+0000","scrub_duration":0.001750627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:04.985436+0000","last_change":"2023-10-14T12:20:04.985491+0000","last_active":"2023-10-14T12:20:04.985436+0000","last_peered":"2023-10-14T12:20:04.985436+0000","last_clean":"2023-10-14T12:20:04.985436+0000","last_became_active":"2023-10-14T12:19:42.370888+0000","last_became_peered":"2023-10-14T12:19:42.370888+0000","last_unstale":"2023-10-14T12:20:04.985436+0000","last_undegraded":"2023-10-14T12:20:04.985436+0000","last_fullsized":"2023-10-14T12:20:04.985436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:04.985328+0000","last_clean_scrub_stamp":"2023-10-14T12:20:04.985328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:20.534941+0000","scrub_duration":0.0014889269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:43.659195+0000","last_change":"2023-10-14T12:20:43.659279+0000","last_active":"2023-10-14T12:20:43.659195+0000","last_peered":"2023-10-14T12:20:43.659195+0000","last_clean":"2023-10-14T12:20:43.659195+0000","last_became_active":"2023-10-14T12:19:43.389033+0000","last_became_peered":"2023-10-14T12:19:43.389033+0000","last_unstale":"2023-10-14T12:20:43.659195+0000","last_undegraded":"2023-10-14T12:20:43.659195+0000","last_fullsized":"2023-10-14T12:20:43.659195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:43.659066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:43.659066+0000","last_clean_scrub_stamp":"2023-10-14T12:20:43.659066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:35.903885+0000","scrub_duration":0.0023725920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:55.116402+0000","last_change":"2023-10-14T12:19:55.116473+0000","last_active":"2023-10-14T12:19:55.116402+0000","last_peered":"2023-10-14T12:19:55.116402+0000","last_clean":"2023-10-14T12:19:55.116402+0000","last_became_active":"2023-10-14T12:19:42.371574+0000","last_became_peered":"2023-10-14T12:19:42.371574+0000","last_unstale":"2023-10-14T12:19:55.116402+0000","last_undegraded":"2023-10-14T12:19:55.116402+0000","last_fullsized":"2023-10-14T12:19:55.116402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:55.116311+0000","last_clean_scrub_stamp":"2023-10-14T12:19:55.116311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:25.522965+0000","scrub_duration":0.0019265339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:13.175981+0000","last_change":"2023-10-14T12:20:13.176034+0000","last_active":"2023-10-14T12:20:13.175981+0000","last_peered":"2023-10-14T12:20:13.175981+0000","last_clean":"2023-10-14T12:20:13.175981+0000","last_became_active":"2023-10-14T12:19:43.388061+0000","last_became_peered":"2023-10-14T12:19:43.388061+0000","last_unstale":"2023-10-14T12:20:13.175981+0000","last_undegraded":"2023-10-14T12:20:13.175981+0000","last_fullsized":"2023-10-14T12:20:13.175981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:13.175828+0000","last_clean_scrub_stamp":"2023-10-14T12:20:13.175828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:34.824982+0000","scrub_duration":0.0020181909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:59.061518+0000","last_change":"2023-10-14T12:19:59.061565+0000","last_active":"2023-10-14T12:19:59.061518+0000","last_peered":"2023-10-14T12:19:59.061518+0000","last_clean":"2023-10-14T12:19:59.061518+0000","last_became_active":"2023-10-14T12:19:42.376485+0000","last_became_peered":"2023-10-14T12:19:42.376485+0000","last_unstale":"2023-10-14T12:19:59.061518+0000","last_undegraded":"2023-10-14T12:19:59.061518+0000","last_fullsized":"2023-10-14T12:19:59.061518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:59.061407+0000","last_clean_scrub_stamp":"2023-10-14T12:19:59.061407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:19.122096+0000","scrub_duration":0.0015051039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:51.782136+0000","last_change":"2023-10-14T12:20:51.782209+0000","last_active":"2023-10-14T12:20:51.782136+0000","last_peered":"2023-10-14T12:20:51.782136+0000","last_clean":"2023-10-14T12:20:51.782136+0000","last_became_active":"2023-10-14T12:19:43.381862+0000","last_became_peered":"2023-10-14T12:19:43.381862+0000","last_unstale":"2023-10-14T12:20:51.782136+0000","last_undegraded":"2023-10-14T12:20:51.782136+0000","last_fullsized":"2023-10-14T12:20:51.782136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:51.781951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:51.781951+0000","last_clean_scrub_stamp":"2023-10-14T12:20:51.781951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:25:53.539228+0000","scrub_duration":0.0018121000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:22.131386+0000","last_change":"2023-10-14T12:20:22.131442+0000","last_active":"2023-10-14T12:20:22.131386+0000","last_peered":"2023-10-14T12:20:22.131386+0000","last_clean":"2023-10-14T12:20:22.131386+0000","last_became_active":"2023-10-14T12:19:42.371358+0000","last_became_peered":"2023-10-14T12:19:42.371358+0000","last_unstale":"2023-10-14T12:20:22.131386+0000","last_undegraded":"2023-10-14T12:20:22.131386+0000","last_fullsized":"2023-10-14T12:20:22.131386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:22.131261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:22.131261+0000","last_clean_scrub_stamp":"2023-10-14T12:20:22.131261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:40.158954+0000","scrub_duration":0.0015560909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:31.304487+0000","last_change":"2023-10-14T12:20:31.304565+0000","last_active":"2023-10-14T12:20:31.304487+0000","last_peered":"2023-10-14T12:20:31.304487+0000","last_clean":"2023-10-14T12:20:31.304487+0000","last_became_active":"2023-10-14T12:19:43.390449+0000","last_became_peered":"2023-10-14T12:19:43.390449+0000","last_unstale":"2023-10-14T12:20:31.304487+0000","last_undegraded":"2023-10-14T12:20:31.304487+0000","last_fullsized":"2023-10-14T12:20:31.304487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:31.304373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:31.304373+0000","last_clean_scrub_stamp":"2023-10-14T12:20:31.304373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:47:57.856372+0000","scrub_duration":0.0020094499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:20.882534+0000","last_change":"2023-10-14T12:20:20.882578+0000","last_active":"2023-10-14T12:20:20.882534+0000","last_peered":"2023-10-14T12:20:20.882534+0000","last_clean":"2023-10-14T12:20:20.882534+0000","last_became_active":"2023-10-14T12:19:42.375273+0000","last_became_peered":"2023-10-14T12:19:42.375273+0000","last_unstale":"2023-10-14T12:20:20.882534+0000","last_undegraded":"2023-10-14T12:20:20.882534+0000","last_fullsized":"2023-10-14T12:20:20.882534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:20.882431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:20.882431+0000","last_clean_scrub_stamp":"2023-10-14T12:20:20.882431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:13.663721+0000","scrub_duration":0.0020522230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:06.117751+0000","last_change":"2023-10-14T12:20:06.117804+0000","last_active":"2023-10-14T12:20:06.117751+0000","last_peered":"2023-10-14T12:20:06.117751+0000","last_clean":"2023-10-14T12:20:06.117751+0000","last_became_active":"2023-10-14T12:19:43.385345+0000","last_became_peered":"2023-10-14T12:19:43.385345+0000","last_unstale":"2023-10-14T12:20:06.117751+0000","last_undegraded":"2023-10-14T12:20:06.117751+0000","last_fullsized":"2023-10-14T12:20:06.117751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:20:06.117644+0000","last_clean_scrub_stamp":"2023-10-14T12:20:06.117644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:32.686476+0000","scrub_duration":0.002186164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:19:57.913126+0000","last_change":"2023-10-14T12:19:57.913179+0000","last_active":"2023-10-14T12:19:57.913126+0000","last_peered":"2023-10-14T12:19:57.913126+0000","last_clean":"2023-10-14T12:19:57.913126+0000","last_became_active":"2023-10-14T12:19:42.371404+0000","last_became_peered":"2023-10-14T12:19:42.371404+0000","last_unstale":"2023-10-14T12:19:57.913126+0000","last_undegraded":"2023-10-14T12:19:57.913126+0000","last_fullsized":"2023-10-14T12:19:57.913126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:19:57.913003+0000","last_clean_scrub_stamp":"2023-10-14T12:19:57.913003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:42:13.246060+0000","scrub_duration":0.001600925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":186,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T12:20:01.132718+0000","last_change":"2023-10-14T12:20:01.132718+0000","last_active":"2023-10-14T12:20:01.132718+0000","last_peered":"2023-10-14T12:20:01.132718+0000","last_clean":"2023-10-14T12:20:01.132718+0000","last_became_active":"2023-10-14T12:18:42.954967+0000","last_became_peered":"2023-10-14T12:18:42.954967+0000","last_unstale":"2023-10-14T12:20:01.132718+0000","last_undegraded":"2023-10-14T12:20:01.132718+0000","last_fullsized":"2023-10-14T12:20:01.132718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T12:20:01.132516+0000","last_clean_scrub_stamp":"2023-10-14T12:20:01.132516+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:26:49.867592+0000","scrub_duration":0.0052765859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.42099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84799999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80200000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70199999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.752}]},{"osd":2,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.62},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57499999999999996,"15min":0.56999999999999995},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90100000000000002,"5min":1.056,"15min":1.056},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71099999999999997,"5min":1.411,"15min":1.411},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81499999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67900000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68500000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":1.45,"15min":1.45},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78800000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.74199999999999999,"5min":1.268,"15min":1.268},"last":0.76600000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":1.284,"15min":1.284},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77600000000000002,"5min":1.216,"15min":1.216},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.877,"15min":0.93500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":9.2170000000000005,"15min":9.2170000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.747}]},{"osd":3,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.74399999999999999,"5min":1.452,"15min":1.452},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.49299999999999999,"15min":0.50600000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64800000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.077,"15min":1.077},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 12:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":1.859,"15min":1.859},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78700000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.44}]},{"osd":2,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.32300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54200000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.441,"15min":0.42999999999999999},"min":{"1min":0.371,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.878},{"interface":"front","average":{"1min":0.621,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.60799999999999998,"15min":0.59499999999999997},"min":{"1min":0.57099999999999995,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77700000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.80600000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.54900000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.89500000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.628},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.498,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.94499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.33700000000000002},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.62}]},{"osd":2,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64200000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.76700000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.751}]},{"osd":6,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.76800000000000002,"15min":0.83799999999999997},"min":{"1min":0.248,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52800000000000002,"5min":10.282,"15min":10.282},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.81699999999999995,"15min":0.88100000000000001},"min":{"1min":0.34300000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61499999999999999,"5min":11.042,"15min":11.042},"last":0.378}]},{"osd":1,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.96699999999999997,"15min":1.0640000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52500000000000002,"5min":14.073,"15min":14.073},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.85899999999999999,"15min":0.92600000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.626,"5min":11.069000000000001,"15min":11.069000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.94199999999999995,"15min":1.022},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":10.385999999999999,"15min":10.385999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.91600000000000004,"15min":0.99299999999999999},"min":{"1min":0.317,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.78200000000000003,"5min":10.239000000000001,"15min":10.239000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.016,"15min":1.077},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":10.971,"15min":10.971},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":1.034,"15min":1.1080000000000001},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":10.497,"15min":10.497},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":1.5449999999999999,"15min":1.6950000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":20.931999999999999,"15min":20.931999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":1.087,"15min":1.157},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.96599999999999997,"5min":10.935,"15min":10.935},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":1.0649999999999999,"15min":1.135},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.94699999999999995,"5min":10.467000000000001,"15min":10.467000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.6140000000000001,"15min":1.7689999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88200000000000001,"5min":20.972000000000001,"15min":20.972000000000001},"last":0.623}]},{"osd":7,"last update":"Sat Oct 14 12:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":1.073,"15min":1.1419999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.997,"5min":11.013,"15min":11.013},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":1.087,"15min":1.155},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91400000000000003,"5min":10.435,"15min":10.435},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30499999999999999},"min":{"1min":0.23599999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.28199999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.378},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.497,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.307},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.32100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.374}]},{"osd":2,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.36199999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.60799999999999998,"5min":1.113,"15min":1.113},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.443,"15min":0.437},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.52900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61599999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.621},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":1.198,"15min":1.198},"last":0.622}]},{"osd":6,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84499999999999997,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.75,"5min":1.282,"15min":1.282},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.57499999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":1.3,"15min":1.3},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.46000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85399999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.626,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.314}]},{"osd":7,"last update":"Sat Oct 14 12:20:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.60499999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":0.78800000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.998,"15min":0.998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63}]},{"osd":7,"last update":"Sat Oct 14 12:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.76700000000000002,"5min":1.044,"15min":1.044},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:21:20.311 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T12:21:20.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.433+0000 7f0fd8877700 1 Processor -- start 2023-10-14T12:21:20.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.433+0000 7f0fd8877700 1 -- start start 2023-10-14T12:21:20.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd8877700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0fd406af50 0x7f0fd40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd8877700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40b2d60 con 0x7f0fd40cd950 2023-10-14T12:21:20.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd8877700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40cdd30 con 0x7f0fd415e2f0 2023-10-14T12:21:20.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd8877700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd41619a0 con 0x7f0fd406af50 2023-10-14T12:21:20.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0fd40cd950 0x7f0fd415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57436/0 (socket says 172.21.15.32:57436) 2023-10-14T12:21:20.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd259c700 1 -- 172.21.15.32:0/2354002949 learned_addr learned my addr 172.21.15.32:0/2354002949 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-14T12:21:20.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524967240 0 0) 0x7f0fd40b2d60 con 0x7f0fd40cd950 2023-10-14T12:21:20.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd2d9d700 1 --2- 172.21.15.32:0/2354002949 >> v2:172.21.15.92:3300/0 conn(0x7f0fd406af50 0x7f0fd40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fbc0035b0 con 0x7f0fd40cd950 2023-10-14T12:21:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597182686 0 0) 0x7f0fbc0035b0 con 0x7f0fd40cd950 2023-10-14T12:21:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 >> v2:172.21.15.92:3300/0 conn(0x7f0fd406af50 msgr2=0x7f0fd40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:21:20.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 --2- 172.21.15.32:0/2354002949 >> v2:172.21.15.92:3300/0 conn(0x7f0fd406af50 0x7f0fd40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 >> v1:172.21.15.92:6789/0 conn(0x7f0fd415e2f0 legacy=0x7f0fd406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd415e920 con 0x7f0fd40cd950 2023-10-14T12:21:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3816040912 0 0) 0x7f0fc4001670 con 0x7f0fd40cd950 2023-10-14T12:21:20.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 >> v1:172.21.15.32:6789/0 conn(0x7f0fd40cd950 legacy=0x7f0fd415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fbc003a00 0x7f0fbc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fbc004850 0x7f0fbc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc005210 0x7f0fbc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd41619a0 con 0x7f0fbc003a00 2023-10-14T12:21:20.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc00c0b0 con 0x7f0fbc004850 2023-10-14T12:21:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.434+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc00c270 con 0x7f0fbc005210 2023-10-14T12:21:20.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fbc003a00 0x7f0fbc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd1d9b700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fbc004850 0x7f0fbc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd2d9d700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc005210 0x7f0fbc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 -- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc005210 msgr2=0x7f0fbc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:21:20.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc005210 0x7f0fbc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 -- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fbc004850 msgr2=0x7f0fbc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:21:20.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fbc004850 0x7f0fbc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 -- 172.21.15.32:0/2354002949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0035b0 con 0x7f0fbc003a00 2023-10-14T12:21:20.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd2d9d700 1 -- 172.21.15.32:0/2354002949 reap_dead start 2023-10-14T12:21:20.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd259c700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fbc003a00 0x7f0fbc003e20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c2a0 tx=0x7f0fbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e86586f526f9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4007c10 con 0x7f0fbc003a00 2023-10-14T12:21:20.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400cdc0 con 0x7f0fbc003a00 2023-10-14T12:21:20.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.435+0000 7f0fd159a700 1 -- 172.21.15.32:0/2354002949 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4005ba0 con 0x7f0fbc003a00 2023-10-14T12:21:20.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 -- 172.21.15.32:0/2354002949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fbc003a00 msgr2=0x7f0fbc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fbc003a00 0x7f0fbc003e20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c2a0 tx=0x7f0fbc005880 comp rx=0 tx=0).stop 2023-10-14T12:21:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 -- 172.21.15.32:0/2354002949 shutdown_connections 2023-10-14T12:21:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 --2- 172.21.15.32:0/2354002949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fbc003a00 0x7f0fbc003e20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 -- 172.21.15.32:0/2354002949 >> 172.21.15.32:0/2354002949 conn(0x7f0fd406dae0 msgr2=0x7f0fd406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:21:20.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 -- 172.21.15.32:0/2354002949 shutdown_connections 2023-10-14T12:21:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.436+0000 7f0fd8877700 1 -- 172.21.15.32:0/2354002949 wait complete. 2023-10-14T12:21:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.438+0000 7f0fd8877700 1 Processor -- start 2023-10-14T12:21:20.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.438+0000 7f0fd8877700 1 -- start start 2023-10-14T12:21:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc003a00 0x7f0fd4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd41602d0 0x7f0fd4160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 0x7f0fd40c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4160c90 con 0x7f0fd40c5c80 2023-10-14T12:21:20.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c6fd0 con 0x7f0fd41602d0 2023-10-14T12:21:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4157fb0 con 0x7f0fbc003a00 2023-10-14T12:21:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 0x7f0fd40c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 0x7f0fd40c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40428/0 (socket says 172.21.15.32:40428) 2023-10-14T12:21:20.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 -- 172.21.15.32:0/3612842300 learned_addr learned my addr 172.21.15.32:0/3612842300 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:21:20.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd259c700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc003a00 0x7f0fd4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd1d9b700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd41602d0 0x7f0fd4160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 -- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc003a00 msgr2=0x7f0fd4157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc003a00 0x7f0fd4157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 -- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd41602d0 msgr2=0x7f0fd4160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd41602d0 0x7f0fd4160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 -- 172.21.15.32:0/3612842300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40c6a10 con 0x7f0fd40c5c80 2023-10-14T12:21:20.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd2d9d700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 0x7f0fd40c6100 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40cdfc0 tx=0x7f0fcc0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc00e070 con 0x7f0fd40c5c80 2023-10-14T12:21:20.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc003c30 con 0x7f0fd40c5c80 2023-10-14T12:21:20.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd40c6cf0 con 0x7f0fd40c5c80 2023-10-14T12:21:20.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc003e20 con 0x7f0fd40c5c80 2023-10-14T12:21:20.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.439+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd40b3490 con 0x7f0fd40c5c80 2023-10-14T12:21:20.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.440+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4067d20 con 0x7f0fd40c5c80 2023-10-14T12:21:20.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.441+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0fcc011a10 con 0x7f0fd40c5c80 2023-10-14T12:21:20.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.441+0000 7f0fc2ffd700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0fb406af00 0x7f0fb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.441+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f0fcc089b20 con 0x7f0fd40c5c80 2023-10-14T12:21:20.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.441+0000 7f0fd259c700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0fb406af00 0x7f0fb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.442+0000 7f0fd259c700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0fb406af00 0x7f0fb406d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4015040 tx=0x7f0fc4007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.446+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fcc054ba0 con 0x7f0fd40c5c80 2023-10-14T12:21:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.645+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0fd40b2100 con 0x7f0fd40c5c80 2023-10-14T12:21:20.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.648+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0fcc014350 con 0x7f0fd40c5c80 2023-10-14T12:21:20.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.648+0000 7f0fc2ffd700 1 -- 172.21.15.32:0/3612842300 <== mon.0 v2:172.21.15.32:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0fcc054ba0 con 0x7f0fd40c5c80 2023-10-14T12:21:20.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0fb406af00 msgr2=0x7f0fb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0fb406af00 0x7f0fb406d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4015040 tx=0x7f0fc4007000 comp rx=0 tx=0).stop 2023-10-14T12:21:20.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 msgr2=0x7f0fd40c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 0x7f0fd40c6100 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40cdfc0 tx=0x7f0fcc0114b0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 shutdown_connections 2023-10-14T12:21:20.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fd40c5c80 0x7f0fd40c6100 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0fbc003a00 0x7f0fd4157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f0fb406af00 0x7f0fb406d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 --2- 172.21.15.32:0/3612842300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fd41602d0 0x7f0fd4160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 >> 172.21.15.32:0/3612842300 conn(0x7f0fd406dae0 msgr2=0x7f0fd4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:21:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 shutdown_connections 2023-10-14T12:21:20.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.650+0000 7f0fd8877700 1 -- 172.21.15.32:0/3612842300 wait complete. 2023-10-14T12:21:20.665 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T12:21:20.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:21:20.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.789+0000 7f728c867700 1 Processor -- start 2023-10-14T12:21:20.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.789+0000 7f728c867700 1 -- start start 2023-10-14T12:21:20.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f728c867700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f728c867700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7288070770 0x7f72880cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f728c867700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7288070c00 con 0x7f728815dfd0 2023-10-14T12:21:20.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f728c867700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728806f710 con 0x7f7288070770 2023-10-14T12:21:20.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f728c867700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728806f9b0 con 0x7f728815dbf0 2023-10-14T12:21:20.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7288070770 0x7f72880cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7288070770 0x7f72880cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40434/0 (socket says 172.21.15.32:40434) 2023-10-14T12:21:20.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 -- 172.21.15.32:0/1351544338 learned_addr learned my addr 172.21.15.32:0/1351544338 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:21:20.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f728659c700 1 --2- 172.21.15.32:0/1351544338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 -- 172.21.15.32:0/1351544338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 msgr2=0x7f72880d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:21:20.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 --2- 172.21.15.32:0/1351544338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 -- 172.21.15.32:0/1351544338 >> v1:172.21.15.92:6789/0 conn(0x7f728815dfd0 legacy=0x7f72880b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 -- 172.21.15.32:0/1351544338 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728806fc90 con 0x7f7288070770 2023-10-14T12:21:20.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.790+0000 7f7286d9d700 1 --2- 172.21.15.32:0/1351544338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7288070770 0x7f72880cf520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7280009e50 tx=0x7f728000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537b59b0c08edc65 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728559a700 1 -- 172.21.15.32:0/1351544338 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000e070 con 0x7f7288070770 2023-10-14T12:21:20.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728559a700 1 -- 172.21.15.32:0/1351544338 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f728000b910 con 0x7f7288070770 2023-10-14T12:21:20.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728559a700 1 -- 172.21.15.32:0/1351544338 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000bce0 con 0x7f7288070770 2023-10-14T12:21:20.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 -- 172.21.15.32:0/1351544338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7288070770 msgr2=0x7f72880cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 --2- 172.21.15.32:0/1351544338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7288070770 0x7f72880cf520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7280009e50 tx=0x7f728000b330 comp rx=0 tx=0).stop 2023-10-14T12:21:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 -- 172.21.15.32:0/1351544338 shutdown_connections 2023-10-14T12:21:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 --2- 172.21.15.32:0/1351544338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7288070770 0x7f72880cf520 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 --2- 172.21.15.32:0/1351544338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 -- 172.21.15.32:0/1351544338 >> 172.21.15.32:0/1351544338 conn(0x7f72880d1620 msgr2=0x7f72880d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:21:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 -- 172.21.15.32:0/1351544338 shutdown_connections 2023-10-14T12:21:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.791+0000 7f728c867700 1 -- 172.21.15.32:0/1351544338 wait complete. 2023-10-14T12:21:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 Processor -- start 2023-10-14T12:21:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 -- start start 2023-10-14T12:21:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7288070770 0x7f728809e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 0x7f728815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c8790 con 0x7f728815dfd0 2023-10-14T12:21:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c8a30 con 0x7f7288070770 2023-10-14T12:21:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f728c867700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c8d10 con 0x7f728815dbf0 2023-10-14T12:21:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f7286d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 0x7f728815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f7286d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 0x7f728815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40440/0 (socket says 172.21.15.32:40440) 2023-10-14T12:21:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.793+0000 7f7286d9d700 1 -- 172.21.15.32:0/2999794954 learned_addr learned my addr 172.21.15.32:0/2999794954 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-14T12:21:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f728659c700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7288070770 0x7f728809e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7285d9b700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7286d9d700 1 -- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 msgr2=0x7f72880cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7286d9d700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7286d9d700 1 -- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7288070770 msgr2=0x7f728809e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7286d9d700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7288070770 0x7f728809e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7286d9d700 1 -- 172.21.15.32:0/2999794954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7280009b30 con 0x7f728815dfd0 2023-10-14T12:21:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7285d9b700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:21:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7286d9d700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 0x7f728815b730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f728806df80 tx=0x7f7280004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280004450 con 0x7f728815dfd0 2023-10-14T12:21:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f728000be90 con 0x7f728815dfd0 2023-10-14T12:21:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72880c8ff0 con 0x7f728815dfd0 2023-10-14T12:21:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280004830 con 0x7f728815dfd0 2023-10-14T12:21:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.794+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72880cc5b0 con 0x7f728815dfd0 2023-10-14T12:21:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.795+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72880cc770 con 0x7f728815dfd0 2023-10-14T12:21:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.796+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7280025450 con 0x7f728815dfd0 2023-10-14T12:21:20.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.796+0000 7f7276ffd700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f726806af00 0x7f726806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:21:20.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.796+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f728008b1a0 con 0x7f728815dfd0 2023-10-14T12:21:20.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.796+0000 7f728659c700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f726806af00 0x7f726806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:21:20.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.797+0000 7f728659c700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f726806af00 0x7f726806d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72880705b0 tx=0x7f7278009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:21:20.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:20.801+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72800562c0 con 0x7f728815dfd0 2023-10-14T12:21:21.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.044+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72880c94b0 con 0x7f728815dfd0 2023-10-14T12:21:21.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.044+0000 7f7276ffd700 1 -- 172.21.15.32:0/2999794954 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f72800598e0 con 0x7f728815dfd0 2023-10-14T12:21:21.047 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-14T12:21:21.048 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2134315383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2134315383},{"type":"v1","addr":"172.21.15.32:6835","nonce":2134315383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6836/2794986339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2794986339},{"type":"v1","addr":"172.21.15.92:6836","nonce":2794986339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/4144603594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6835","nonce":4144603594},{"type":"v1","addr":"172.21.15.92:6837","nonce":4144603594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:19:42.779342+0000","modified":"2023-10-14T12:19:45.809455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4915":{"gid":4915,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/2848056951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2848056951},{"type":"v1","addr":"172.21.15.32:6834","nonce":2848056951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:21:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f726806af00 msgr2=0x7f726806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:21.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f726806af00 0x7f726806d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72880705b0 tx=0x7f7278009210 comp rx=0 tx=0).stop 2023-10-14T12:21:21.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 msgr2=0x7f728815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:21:21.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 0x7f728815b730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f728806df80 tx=0x7f7280004ad0 comp rx=0 tx=0).stop 2023-10-14T12:21:21.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 shutdown_connections 2023-10-14T12:21:21.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f728815dfd0 0x7f728815b730 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:21.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:6832/2571467497,v1:172.21.15.92:6833/2571467497] conn(0x7f726806af00 0x7f726806d3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:21.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7288070770 0x7f728809e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:21.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 --2- 172.21.15.32:0/2999794954 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f728815dbf0 0x7f72880cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:21:21.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 >> 172.21.15.32:0/2999794954 conn(0x7f72880d1620 msgr2=0x7f728815cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:21:21.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 shutdown_connections 2023-10-14T12:21:21.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-14T12:21:21.047+0000 7f728c867700 1 -- 172.21.15.32:0/2999794954 wait complete. 2023-10-14T12:21:21.055 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 16 2023-10-14T12:21:21.061 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T12:21:21.062 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T12:21:21.062 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T12:21:21.063 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.071 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T12:21:21.072 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T12:21:21.073 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.122 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T12:21:21.123 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T12:21:21.123 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.134 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T12:21:21.135 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T12:21:21.136 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.185 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T12:21:21.186 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T12:21:21.186 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T12:21:21.187 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.221 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T12:21:21.222 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T12:21:21.223 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.293 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T12:21:21.294 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T12:21:21.295 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.359 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T12:21:21.360 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T12:21:21.360 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-14T12:21:21.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-14T12:21:21.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-14T12:21:21.437 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T12:21:21.438 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T12:21:21.438 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.475 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T12:21:21.476 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T12:21:21.476 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.551 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T12:21:21.552 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T12:21:21.552 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.632 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T12:21:21.633 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T12:21:21.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.704 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T12:21:21.705 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T12:21:21.706 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T12:21:21.706 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.729 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T12:21:21.730 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T12:21:21.730 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.773 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T12:21:21.774 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T12:21:21.775 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T12:21:21.775 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.785 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T12:21:21.786 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T12:21:21.787 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.826 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T12:21:21.827 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T12:21:21.827 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:21:21.877 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T12:21:21.878 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T12:21:21.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-14T12:21:21.917 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:21:21.918 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T12:21:22.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:21:22.182 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T12:21:22.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:21:22.257 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T12:21:22.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:21:22.346 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T12:21:22.416 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:21:22.416 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T12:21:22.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:21:22.630 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T12:21:22.730 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:21:22.731 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T12:21:22.815 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:21:22.815 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T12:21:22.912 INFO:tasks.ceph:Archiving mon data... 2023-10-14T12:21:22.913 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/data/mon.a.tgz 2023-10-14T12:21:22.914 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2023-10-14T12:21:22.933 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.GDrekZbuxa 2023-10-14T12:21:22.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GDrekZbuxa 2023-10-14T12:21:23.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.GDrekZbuxa 2023-10-14T12:21:23.154 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.GDrekZbuxa is 288KB 2023-10-14T12:21:23.249 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.GDrekZbuxa 2023-10-14T12:21:23.266 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/data/mon.b.tgz 2023-10-14T12:21:23.266 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-10-14T12:21:23.285 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.f2Nl5F1FN3 2023-10-14T12:21:23.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.f2Nl5F1FN3 2023-10-14T12:21:23.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.f2Nl5F1FN3 2023-10-14T12:21:23.545 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.f2Nl5F1FN3 is 386KB 2023-10-14T12:21:23.645 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.f2Nl5F1FN3 2023-10-14T12:21:23.662 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/data/mon.c.tgz 2023-10-14T12:21:23.663 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-10-14T12:21:23.718 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.79fjhh6kBD 2023-10-14T12:21:23.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.79fjhh6kBD 2023-10-14T12:21:23.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.79fjhh6kBD 2023-10-14T12:21:23.937 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.79fjhh6kBD is 386KB 2023-10-14T12:21:24.038 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.79fjhh6kBD 2023-10-14T12:21:24.055 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T12:21:24.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T12:21:24.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T12:21:24.120 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T12:21:24.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T12:21:24.131 DEBUG:teuthology.orchestra.run.smithi092:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T12:21:24.168 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T12:21:24.199 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T12:21:24.205 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T12:21:24.209 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/remote/smithi032/crash 2023-10-14T12:21:24.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T12:21:24.248 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/remote/smithi092/crash 2023-10-14T12:21:24.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T12:21:24.279 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T12:21:24.281 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:21:24.296 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:21:24.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T12:21:24.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T12:21:24.452 INFO:tasks.ceph:Compressing logs... 2023-10-14T12:21:24.452 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T12:21:24.467 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T12:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116807.log 2023-10-14T12:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111773.log 2023-10-14T12:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111290.log 2023-10-14T12:21:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117904.log 2023-10-14T12:21:24.497 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116807.log.gz 2023-10-14T12:21:24.497 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111773.log.gz 2023-10-14T12:21:24.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111285.log 2023-10-14T12:21:24.512 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111290.log.gz 2023-10-14T12:21:24.512 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114263.log 2023-10-14T12:21:24.513 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117904.log.gz 2023-10-14T12:21:24.513 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109958.log 2023-10-14T12:21:24.513 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111285.log.gz 2023-10-14T12:21:24.514 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119239.log 2023-10-14T12:21:24.514 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111957.log 2023-10-14T12:21:24.514 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114263.log.gz 2023-10-14T12:21:24.514 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109958.log.gz 2023-10-14T12:21:24.515 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109912.log 2023-10-14T12:21:24.515 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119101.log 2023-10-14T12:21:24.515 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119239.log.gz 2023-10-14T12:21:24.515 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109912.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111957.log.gz 2023-10-14T12:21:24.516 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114309.log 2023-10-14T12:21:24.516 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109912.log.gz 2023-10-14T12:21:24.516 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110188.log 2023-10-14T12:21:24.517 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119101.log: /var/log/ceph/ceph-client.admin.114309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114631.log 2023-10-14T12:21:24.517 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119101.log.gz 2023-10-14T12:21:24.517 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114309.log.gz 2023-10-14T12:21:24.517 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.110188.log: -- /var/log/ceph/ceph-client.admin.112141.log 2023-10-14T12:21:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114631.log: gzip -5 87.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.110188.log.gz/var/log/ceph/ceph-client.admin.119409.log 2023-10-14T12:21:24.518 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-14T12:21:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112141.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114631.log.gz 2023-10-14T12:21:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110528.log 2023-10-14T12:21:24.519 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112141.log.gz 2023-10-14T12:21:24.519 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113802.log 2023-10-14T12:21:24.519 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119409.log.gz/var/log/ceph/ceph-client.admin.110528.log: 2023-10-14T12:21:24.520 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111635.log 2023-10-14T12:21:24.520 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113802.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110528.log.gz 2023-10-14T12:21:24.520 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110532.log 2023-10-14T12:21:24.521 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113802.log.gz 2023-10-14T12:21:24.521 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111635.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T12:21:24.521 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111635.log.gz 2023-10-14T12:21:24.521 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114078.log 2023-10-14T12:21:24.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.2.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110532.log.gz 2023-10-14T12:21:24.522 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116486.log 2023-10-14T12:21:24.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116761.log 2023-10-14T12:21:24.523 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114078.log.gz 2023-10-14T12:21:24.523 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117318.log 2023-10-14T12:21:24.523 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116486.log: /var/log/ceph/ceph-client.admin.116761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117742.log 2023-10-14T12:21:24.523 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116486.log.gz 2023-10-14T12:21:24.524 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116761.log.gz 2023-10-14T12:21:24.524 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111497.log 2023-10-14T12:21:24.524 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111819.log 2023-10-14T12:21:24.524 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7%/var/log/ceph/ceph-client.admin.117742.log: -- replaced with /var/log/ceph/ceph-client.admin.117318.log.gz 2023-10-14T12:21:24.525 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111497.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117742.log.gz 2023-10-14T12:21:24.525 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110883.log 2023-10-14T12:21:24.525 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111497.log.gz 2023-10-14T12:21:24.526 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T12:21:24.526 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111819.log: /var/log/ceph/ceph-client.admin.110883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116210.log 2023-10-14T12:21:24.526 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111819.log.gz 2023-10-14T12:21:24.526 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110883.log.gz 2023-10-14T12:21:24.527 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110521.log 2023-10-14T12:21:24.527 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119476.log 2023-10-14T12:21:24.527 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110521.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116210.log.gz 2023-10-14T12:21:24.527 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119612.log 2023-10-14T12:21:24.528 INFO:teuthology.orchestra.run.smithi032.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T12:21:24.528 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110521.log.gz 2023-10-14T12:21:24.528 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113053.log 2023-10-14T12:21:24.529 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119612.log: gzip 88.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.119476.log.gz-- 2023-10-14T12:21:24.529 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113848.log 2023-10-14T12:21:24.529 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119612.log.gz/var/log/ceph/ceph-client.admin.113053.log: 2023-10-14T12:21:24.529 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119522.log 2023-10-14T12:21:24.530 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113848.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113053.log.gz 2023-10-14T12:21:24.530 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110529.log 2023-10-14T12:21:24.530 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113848.log.gz 2023-10-14T12:21:24.530 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115980.log 2023-10-14T12:21:24.531 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119522.log.gz/var/log/ceph/ceph-client.admin.110529.log: 2023-10-14T12:21:24.531 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116118.log 2023-10-14T12:21:24.531 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115980.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110529.log.gzgzip 2023-10-14T12:21:24.532 INFO:teuthology.orchestra.run.smithi032.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.116302.log 2023-10-14T12:21:24.532 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115980.log.gz 2023-10-14T12:21:24.532 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114585.log 2023-10-14T12:21:24.532 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116118.log.gz 2023-10-14T12:21:24.533 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115842.log 2023-10-14T12:21:24.533 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114585.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116302.log.gz 2023-10-14T12:21:24.533 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115750.log 2023-10-14T12:21:24.533 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115842.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114585.log.gz 2023-10-14T12:21:24.534 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109819.log 2023-10-14T12:21:24.534 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115842.log.gz 2023-10-14T12:21:24.534 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112341.log 2023-10-14T12:21:24.535 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104157.log 2023-10-14T12:21:24.535 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109819.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115750.log.gz 2023-10-14T12:21:24.535 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117650.log 2023-10-14T12:21:24.535 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109819.log.gz 2023-10-14T12:21:24.536 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104157.log: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.112341.log.gz--verbose 2023-10-14T12:21:24.536 INFO:teuthology.orchestra.run.smithi032.stderr:-- /var/log/ceph/ceph-client.admin.114677.log 2023-10-14T12:21:24.536 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117650.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104157.log.gz 2023-10-14T12:21:24.536 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117558.log 2023-10-14T12:21:24.537 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117650.log.gz 2023-10-14T12:21:24.537 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114677.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T12:21:24.537 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114677.log.gz 2023-10-14T12:21:24.538 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118482.log 2023-10-14T12:21:24.538 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117558.log.gz 2023-10-14T12:21:24.538 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114355.log 2023-10-14T12:21:24.538 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117512.log 2023-10-14T12:21:24.539 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118482.log.gz 2023-10-14T12:21:24.539 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118344.log 2023-10-14T12:21:24.539 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114355.log.gz 2023-10-14T12:21:24.540 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.117512.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.114032.log 2023-10-14T12:21:24.540 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110898.log 2023-10-14T12:21:24.540 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117512.log.gz 2023-10-14T12:21:24.540 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118344.log.gz 2023-10-14T12:21:24.549 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104102.log 2023-10-14T12:21:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104149.log 2023-10-14T12:21:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104102.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T12:21:24.550 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104149.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104102.log.gz 2023-10-14T12:21:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104284.log 2023-10-14T12:21:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.5.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104149.log.gz 2023-10-14T12:21:24.551 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110558.log 2023-10-14T12:21:24.552 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104284.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T12:21:24.552 INFO:teuthology.orchestra.run.smithi092.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104284.log.gz 2023-10-14T12:21:24.552 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.1.110558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110558.log.gz 2023-10-14T12:21:24.553 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T12:21:24.553 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104194.log 2023-10-14T12:21:24.553 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T12:21:24.553 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104194.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T12:21:24.554 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.d.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104194.log.gz 2023-10-14T12:21:24.554 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.audit.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T12:21:24.554 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T12:21:24.555 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104239.log 2023-10-14T12:21:24.555 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104057.log 2023-10-14T12:21:24.555 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104239.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104239.log.gz 2023-10-14T12:21:24.555 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104057.log.gz 2023-10-14T12:21:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T12:21:24.556 INFO:teuthology.orchestra.run.smithi092.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T12:21:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104011.log 2023-10-14T12:21:24.556 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.104011.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104011.log.gz 2023-10-14T12:21:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T12:21:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110566.log 2023-10-14T12:21:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.110566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110566.log.gz 2023-10-14T12:21:24.557 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T12:21:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T12:21:24.558 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104337.log 2023-10-14T12:21:24.559 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.104337.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104337.log.gz 2023-10-14T12:21:24.572 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T12:21:24.573 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T12:21:24.584 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111173.log 2023-10-14T12:21:24.585 INFO:teuthology.orchestra.run.smithi092.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T12:21:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.3.111173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111173.log.gz 2023-10-14T12:21:24.585 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111177.log 2023-10-14T12:21:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.3.111177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111177.log.gz 2023-10-14T12:21:24.586 INFO:teuthology.orchestra.run.smithi092.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T12:21:24.591 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112831.log 2023-10-14T12:21:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T12:21:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110898.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114032.log.gz 2023-10-14T12:21:24.592 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.112831.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110898.log.gz 2023-10-14T12:21:24.593 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109256.log 2023-10-14T12:21:24.593 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112831.log.gz 2023-10-14T12:21:24.593 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117834.log 2023-10-14T12:21:24.593 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.109256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117372.log 2023-10-14T12:21:24.594 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109256.log.gz 2023-10-14T12:21:24.594 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110531.log 2023-10-14T12:21:24.594 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118963.log 2023-10-14T12:21:24.594 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117372.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T12:21:24.595 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117604.log 2023-10-14T12:21:24.595 INFO:teuthology.orchestra.run.smithi032.stderr: 90.9% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117834.log.gz 2023-10-14T12:21:24.595 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117372.log.gz 2023-10-14T12:21:24.596 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118963.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110531.log.gz 2023-10-14T12:21:24.596 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116026.log 2023-10-14T12:21:24.596 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118963.log.gz 2023-10-14T12:21:24.596 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109771.log 2023-10-14T12:21:24.597 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115796.log 2023-10-14T12:21:24.597 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116026.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117604.log.gz 2023-10-14T12:21:24.597 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109771.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116026.log.gz 2023-10-14T12:21:24.597 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T12:21:24.598 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117418.log 2023-10-14T12:21:24.598 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4%/var/log/ceph/ceph-client.admin.115796.log: -- replaced with /var/log/ceph/ceph-client.admin.109771.log.gz 2023-10-14T12:21:24.598 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.3.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115796.log.gz 2023-10-14T12:21:24.599 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111282.log 2023-10-14T12:21:24.599 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109450.log 2023-10-14T12:21:24.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117418.log: /var/log/ceph/ceph-client.admin.111282.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117418.log.gz 2023-10-14T12:21:24.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111282.log.gz 2023-10-14T12:21:24.600 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118574.log 2023-10-14T12:21:24.600 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109450.log.gz 2023-10-14T12:21:24.600 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114769.log 2023-10-14T12:21:24.600 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114493.log 2023-10-14T12:21:24.601 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118574.log: /var/log/ceph/ceph-client.admin.114769.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118574.log.gz 2023-10-14T12:21:24.601 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114493.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114769.log.gz 2023-10-14T12:21:24.601 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114493.log.gz 2023-10-14T12:21:24.602 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112823.log 2023-10-14T12:21:24.602 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114125.log 2023-10-14T12:21:24.602 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.112823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114539.log 2023-10-14T12:21:24.602 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112823.log.gz 2023-10-14T12:21:24.603 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119334.log 2023-10-14T12:21:24.603 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114539.log: gzip -5 --verbose 87.5%-- /var/log/ceph/ceph-client.admin.115080.log -- replaced with /var/log/ceph/ceph-client.admin.114125.log.gz 2023-10-14T12:21:24.603 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-14T12:21:24.603 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114539.log.gz 2023-10-14T12:21:24.604 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109365.log 2023-10-14T12:21:24.604 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5%/var/log/ceph/ceph-client.admin.115080.log: -- replaced with /var/log/ceph/ceph-client.admin.119334.log.gz 2023-10-14T12:21:24.604 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113488.log 2023-10-14T12:21:24.604 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109365.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115080.log.gz 2023-10-14T12:21:24.605 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111681.log 2023-10-14T12:21:24.605 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.2.113488.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109365.log.gz 2023-10-14T12:21:24.605 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115308.log 2023-10-14T12:21:24.606 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113488.log.gz 2023-10-14T12:21:24.606 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114217.log 2023-10-14T12:21:24.606 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6%/var/log/ceph/ceph-client.admin.115308.log: -- replaced with /var/log/ceph/ceph-client.admin.111681.log.gz 2023-10-14T12:21:24.606 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114217.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115308.log.gz 2023-10-14T12:21:24.607 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114217.log.gz 2023-10-14T12:21:24.607 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115934.log 2023-10-14T12:21:24.607 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111865.log 2023-10-14T12:21:24.608 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116164.log 2023-10-14T12:21:24.608 INFO:teuthology.orchestra.run.smithi032.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.115934.log.gz 2023-10-14T12:21:24.608 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111865.log: /var/log/ceph/ceph-client.admin.116164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111865.log.gz 2023-10-14T12:21:24.608 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116164.log.gz 2023-10-14T12:21:24.609 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112049.log 2023-10-14T12:21:24.609 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109677.log 2023-10-14T12:21:24.609 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113484.log 2023-10-14T12:21:24.609 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113986.log 2023-10-14T12:21:24.610 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112049.log.gz 2023-10-14T12:21:24.610 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109677.log.gz 2023-10-14T12:21:24.610 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.2.113484.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T12:21:24.611 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113484.log.gz 2023-10-14T12:21:24.611 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111281.log /var/log/ceph/ceph-client.admin.113986.log: 2023-10-14T12:21:24.611 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.0.118137.log 2023-10-14T12:21:24.611 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113986.log.gz 2023-10-14T12:21:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116676.log 2023-10-14T12:21:24.612 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111281.log.gz 2023-10-14T12:21:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.118137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118137.log.gz 2023-10-14T12:21:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113710.log 2023-10-14T12:21:24.613 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116676.log.gz 2023-10-14T12:21:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113710.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113710.log.gz 2023-10-14T12:21:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115034.log 2023-10-14T12:21:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117270.log 2023-10-14T12:21:24.614 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115034.log: /var/log/ceph/ceph-client.admin.117270.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115034.log.gz 2023-10-14T12:21:24.614 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117270.log.gz 2023-10-14T12:21:24.614 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116394.log 2023-10-14T12:21:24.615 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117084.log 2023-10-14T12:21:24.615 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115354.log 2023-10-14T12:21:24.615 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117084.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116394.log.gz 2023-10-14T12:21:24.615 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115354.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117084.log.gz 2023-10-14T12:21:24.616 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115354.log.gz 2023-10-14T12:21:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112095.log 2023-10-14T12:21:24.616 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T12:21:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114896.log 2023-10-14T12:21:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114723.log 2023-10-14T12:21:24.617 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112095.log.gz 2023-10-14T12:21:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115888.log 2023-10-14T12:21:24.618 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117464.log 2023-10-14T12:21:24.618 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114723.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114896.log.gz 2023-10-14T12:21:24.618 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111283.log 2023-10-14T12:21:24.618 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114723.log.gz 2023-10-14T12:21:24.619 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117464.log: gzip -5 89.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.115888.log.gz/var/log/ceph/ceph-client.admin.119147.log 2023-10-14T12:21:24.619 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-14T12:21:24.619 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111283.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117464.log.gz 2023-10-14T12:21:24.619 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111283.log.gz 2023-10-14T12:21:24.620 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119147.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T12:21:24.620 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119147.log.gz 2023-10-14T12:21:24.620 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104295.log 2023-10-14T12:21:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110050.log 2023-10-14T12:21:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104295.log: 88.3%/var/log/ceph/ceph-client.admin.110050.log: -- replaced with /var/log/ceph/ceph-client.admin.104295.log.gz 2023-10-14T12:21:24.621 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T12:21:24.621 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110050.log.gz 2023-10-14T12:21:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110326.log 2023-10-14T12:21:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115216.log 2023-10-14T12:21:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113940.log 2023-10-14T12:21:24.623 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7%/var/log/ceph/ceph-client.admin.115216.log: -- replaced with /var/log/ceph/ceph-client.admin.110326.log.gz 2023-10-14T12:21:24.623 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115216.log.gz 2023-10-14T12:21:24.623 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109723.log 2023-10-14T12:21:24.623 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113940.log.gz 2023-10-14T12:21:24.624 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115170.log 2023-10-14T12:21:24.624 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103849.log 2023-10-14T12:21:24.624 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109723.log.gz 2023-10-14T12:21:24.624 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115616.log 2023-10-14T12:21:24.625 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.103849.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115170.log.gz 2023-10-14T12:21:24.625 INFO:teuthology.orchestra.run.smithi032.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.103849.log.gz 2023-10-14T12:21:24.625 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115616.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115616.log.gz 2023-10-14T12:21:24.625 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111727.log 2023-10-14T12:21:24.626 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116348.log 2023-10-14T12:21:24.626 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118436.log 2023-10-14T12:21:24.626 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111727.log.gz 2023-10-14T12:21:24.627 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116348.log.gz 2023-10-14T12:21:24.627 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118436.log.gz 2023-10-14T12:21:24.627 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119566.log 2023-10-14T12:21:24.627 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119285.log 2023-10-14T12:21:24.628 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111589.log 2023-10-14T12:21:24.628 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119566.log.gz 2023-10-14T12:21:24.628 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119285.log: /var/log/ceph/ceph-client.admin.111589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119285.log.gz 2023-10-14T12:21:24.629 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111589.log.gz 2023-10-14T12:21:24.629 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117696.log 2023-10-14T12:21:24.629 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119193.log 2023-10-14T12:21:24.629 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117222.log 2023-10-14T12:21:24.630 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117696.log.gz 2023-10-14T12:21:24.630 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119193.log: /var/log/ceph/ceph-client.admin.117222.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119193.log.gz 2023-10-14T12:21:24.630 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117222.log.gz 2023-10-14T12:21:24.630 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116992.log 2023-10-14T12:21:24.631 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114988.log 2023-10-14T12:21:24.631 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118733.log 2023-10-14T12:21:24.631 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116992.log.gz 2023-10-14T12:21:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110527.log 2023-10-14T12:21:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118666.log 2023-10-14T12:21:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118733.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114988.log.gz 2023-10-14T12:21:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110527.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118733.log.gz 2023-10-14T12:21:24.633 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118666.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110527.log.gz 2023-10-14T12:21:24.633 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118666.log.gz 2023-10-14T12:21:24.633 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115549.log 2023-10-14T12:21:24.633 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110096.log 2023-10-14T12:21:24.634 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114171.log 2023-10-14T12:21:24.634 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115549.log.gz 2023-10-14T12:21:24.634 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110893.log 2023-10-14T12:21:24.635 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118390.log 2023-10-14T12:21:24.635 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114171.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110096.log.gz 2023-10-14T12:21:24.635 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110893.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114171.log.gz 2023-10-14T12:21:24.635 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118390.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110893.log.gz 2023-10-14T12:21:24.636 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116586.log 2023-10-14T12:21:24.636 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118390.log.gz 2023-10-14T12:21:24.636 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111129.log 2023-10-14T12:21:24.636 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109577.log 2023-10-14T12:21:24.637 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116586.log.gz 2023-10-14T12:21:24.637 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118825.log 2023-10-14T12:21:24.637 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T12:21:24.638 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111129.log.gz 2023-10-14T12:21:24.638 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118825.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109577.log.gz 2023-10-14T12:21:24.638 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.1.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118825.log.gz 2023-10-14T12:21:24.638 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110234.log 2023-10-14T12:21:24.639 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110280.log 2023-10-14T12:21:24.639 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110234.log: /var/log/ceph/ceph-client.admin.110280.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.110234.log.gz 2023-10-14T12:21:24.639 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110280.log.gz 2023-10-14T12:21:24.639 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113756.log 2023-10-14T12:21:24.640 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111543.log 2023-10-14T12:21:24.640 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109631.log 2023-10-14T12:21:24.640 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111543.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.113756.log.gz 2023-10-14T12:21:24.641 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109631.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111543.log.gz 2023-10-14T12:21:24.641 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109631.log.gz 2023-10-14T12:21:24.641 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110896.log 2023-10-14T12:21:24.641 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112003.log 2023-10-14T12:21:24.642 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110896.log: /var/log/ceph/ceph-client.admin.112003.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110896.log.gz 2023-10-14T12:21:24.642 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112003.log.gz 2023-10-14T12:21:24.642 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119009.log 2023-10-14T12:21:24.643 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117130.log 2023-10-14T12:21:24.643 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118141.log 2023-10-14T12:21:24.643 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117130.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119009.log.gz 2023-10-14T12:21:24.643 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.118141.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117130.log.gz 2023-10-14T12:21:24.644 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118141.log.gz 2023-10-14T12:21:24.644 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116900.log 2023-10-14T12:21:24.644 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97564.log 2023-10-14T12:21:24.644 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114942.log 2023-10-14T12:21:24.645 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.97564.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116900.log.gz 2023-10-14T12:21:24.645 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97564.log.gz 2023-10-14T12:21:24.645 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114942.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114942.log.gz 2023-10-14T12:21:24.646 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114447.log 2023-10-14T12:21:24.646 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110899.log 2023-10-14T12:21:24.646 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118779.log 2023-10-14T12:21:24.646 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110899.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114447.log.gz 2023-10-14T12:21:24.647 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118779.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110899.log.gz 2023-10-14T12:21:24.647 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118528.log 2023-10-14T12:21:24.647 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118779.log.gz 2023-10-14T12:21:24.647 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110142.log 2023-10-14T12:21:24.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116540.log 2023-10-14T12:21:24.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110142.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118528.log.gz 2023-10-14T12:21:24.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116540.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110142.log.gz 2023-10-14T12:21:24.649 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116540.log.gz 2023-10-14T12:21:24.649 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110901.log 2023-10-14T12:21:24.649 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114401.log 2023-10-14T12:21:24.649 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117176.log 2023-10-14T12:21:24.650 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.114401.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110901.log.gz 2023-10-14T12:21:24.650 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117176.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114401.log.gz 2023-10-14T12:21:24.650 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117176.log.gz 2023-10-14T12:21:24.651 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116440.log 2023-10-14T12:21:24.651 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116256.log 2023-10-14T12:21:24.651 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116440.log: /var/log/ceph/ceph-client.admin.116256.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116440.log.gz 2023-10-14T12:21:24.651 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116256.log.gz 2023-10-14T12:21:24.652 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115503.log 2023-10-14T12:21:24.652 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111287.log 2023-10-14T12:21:24.652 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110004.log 2023-10-14T12:21:24.652 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111287.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.115503.log.gz 2023-10-14T12:21:24.653 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111287.log.gz 2023-10-14T12:21:24.653 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110004.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110004.log.gz 2023-10-14T12:21:24.653 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113894.log 2023-10-14T12:21:24.654 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116072.log 2023-10-14T12:21:24.654 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119055.log 2023-10-14T12:21:24.654 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116072.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113894.log.gz 2023-10-14T12:21:24.654 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116072.log.gz 2023-10-14T12:21:24.655 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119055.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.119055.log.gz--verbose 2023-10-14T12:21:24.655 INFO:teuthology.orchestra.run.smithi032.stderr:-- /var/log/ceph/ceph-client.admin.110533.log 2023-10-14T12:21:24.655 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115262.log 2023-10-14T12:21:24.655 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117788.log 2023-10-14T12:21:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115262.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110533.log.gz 2023-10-14T12:21:24.656 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117788.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115262.log.gz 2023-10-14T12:21:24.656 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117788.log.gz 2023-10-14T12:21:24.657 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116946.log 2023-10-14T12:21:24.657 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118620.log 2023-10-14T12:21:24.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111289.log 2023-10-14T12:21:24.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118620.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116946.log.gz 2023-10-14T12:21:24.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111289.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118620.log.gz 2023-10-14T12:21:24.658 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111289.log.gz 2023-10-14T12:21:24.658 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115457.log 2023-10-14T12:21:24.659 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118871.log 2023-10-14T12:21:24.659 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.115457.log: /var/log/ceph/ceph-client.admin.118871.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115457.log.gz 2023-10-14T12:21:24.659 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118871.log.gz 2023-10-14T12:21:24.659 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109866.log 2023-10-14T12:21:24.660 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117038.log 2023-10-14T12:21:24.660 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109866.log: /var/log/ceph/ceph-client.admin.117038.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109866.log.gz 2023-10-14T12:21:24.660 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117038.log.gz 2023-10-14T12:21:24.660 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110900.log 2023-10-14T12:21:24.661 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115662.log 2023-10-14T12:21:24.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110900.log: /var/log/ceph/ceph-client.admin.115662.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110900.log.gz 2023-10-14T12:21:24.661 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115662.log.gz 2023-10-14T12:21:24.661 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116853.log 2023-10-14T12:21:24.662 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118917.log 2023-10-14T12:21:24.662 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.116853.log: /var/log/ceph/ceph-client.admin.118917.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116853.log.gz 2023-10-14T12:21:24.662 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118917.log.gz 2023-10-14T12:21:24.663 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T12:21:24.663 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112187.log 2023-10-14T12:21:24.663 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.112187.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.112187.log.gz 2023-10-14T12:21:24.663 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109504.log 2023-10-14T12:21:24.664 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T12:21:24.664 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109504.log: /var/log/ceph/ceph-mgr.y.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109504.log.gz 2023-10-14T12:21:24.664 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111911.log 2023-10-14T12:21:24.664 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111911.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111911.log.gz 2023-10-14T12:21:24.665 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110891.log 2023-10-14T12:21:24.665 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110891.log: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T12:21:24.665 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110891.log.gz 2023-10-14T12:21:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110523.log 2023-10-14T12:21:24.666 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110523.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110523.log.gz 2023-10-14T12:21:24.667 INFO:teuthology.orchestra.run.smithi092.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T12:21:24.668 INFO:teuthology.orchestra.run.smithi092.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T12:21:24.668 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T12:21:24.668 INFO:teuthology.orchestra.run.smithi092.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T12:21:24.668 INFO:teuthology.orchestra.run.smithi092.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T12:21:24.669 INFO:teuthology.orchestra.run.smithi032.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T12:21:24.669 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T12:21:24.669 INFO:teuthology.orchestra.run.smithi032.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T12:21:24.670 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T12:21:24.702 INFO:teuthology.orchestra.run.smithi092.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T12:21:24.704 INFO:teuthology.orchestra.run.smithi092.stderr: 2023-10-14T12:21:24.706 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m0.197s 2023-10-14T12:21:24.708 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m0.869s 2023-10-14T12:21:24.709 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.058s 2023-10-14T12:21:24.769 INFO:teuthology.orchestra.run.smithi032.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T12:21:24.770 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-14T12:21:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m0.288s 2023-10-14T12:21:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m0.739s 2023-10-14T12:21:24.771 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m0.152s 2023-10-14T12:21:24.772 INFO:tasks.ceph:Archiving logs... 2023-10-14T12:21:24.773 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/remote/smithi032/log 2023-10-14T12:21:24.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T12:21:25.086 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/remote/smithi092/log 2023-10-14T12:21:25.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T12:21:25.239 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T12:21:25.254 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T12:21:25.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T12:21:25.257 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T12:21:25.353 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T12:21:25.363 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T12:21:25.363 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:21:25.366 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:21:25.380 INFO:teuthology.orchestra.run.smithi032.stderr:bash: ntpq: command not found 2023-10-14T12:21:25.382 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-10-14T12:21:25.386 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:21:25.386 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2023-10-14T12:21:25.386 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 +1314us[+1314us] +/- 84ms 2023-10-14T12:21:25.387 INFO:teuthology.orchestra.run.smithi032.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -902us[ -918us] +/- 67ms 2023-10-14T12:21:25.387 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -172us[ -188us] +/- 85ms 2023-10-14T12:21:25.387 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:21:25.389 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:21:25.389 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-14T12:21:25.390 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 +1314us[+1321us] +/- 84ms 2023-10-14T12:21:25.390 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -913us[ -905us] +/- 68ms 2023-10-14T12:21:25.390 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -160us[ -153us] +/- 85ms 2023-10-14T12:21:25.391 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:21:25.391 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T12:21:25.401 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T12:21:25.402 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T12:21:25.420 DEBUG:teuthology.orchestra.run.smithi032:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T12:21:25.531 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T12:21:25.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:21:25.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:25.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:21:25.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:25.693 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T12:21:25.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T12:21:25.744 INFO:teuthology.task.internal:Duration was 912.431115 seconds 2023-10-14T12:21:25.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T12:21:25.779 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T12:21:25.779 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T12:21:25.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T12:21:25.830 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:21:25.831 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:21:26.303 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T12:21:26.304 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2023-10-14T12:21:26.304 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T12:21:26.328 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T12:21:26.329 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T12:21:26.352 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T12:21:26.352 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T12:21:26.371 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T12:21:26.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-14T12:21:26.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-14T12:21:26.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-14T12:21:26.434 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T12:21:26.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T12:21:26.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T12:21:26.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T12:21:26.559 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T12:21:26.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T12:21:26.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T12:21:26.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T12:21:26.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:21:26.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:21:26.654 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2023-10-14T12:21:26.680 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-10-14T12:21:26.694 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:21:26.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:26.727 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:21:26.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:26.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T12:21:26.761 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T12:21:26.761 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/remote/smithi032 2023-10-14T12:21:26.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T12:21:26.807 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304/remote/smithi092 2023-10-14T12:21:26.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T12:21:26.845 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T12:21:26.845 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T12:21:26.848 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T12:21:26.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T12:21:26.908 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T12:21:26.910 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T12:21:26.930 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T12:21:26.931 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T12:21:26.934 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T12:21:26.949 INFO:teuthology.orchestra.run.smithi032.stdout: 262307 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 14 12:21 /home/ubuntu/cephtest 2023-10-14T12:21:26.950 INFO:teuthology.orchestra.run.smithi032.stdout: 393242 4 d--------- 2 ubuntu ubuntu 4096 Oct 14 12:19 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:21:26.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:26.952 INFO:teuthology.orchestra.run.smithi032.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-14T12:21:26.953 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-14T12:21:26.954 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T12:21:26.962 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T12:21:26.973 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T12:21:26.999 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi032 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T12:21:27.000 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T12:21:27.007 INFO:teuthology.orchestra.run.smithi092.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 12:21 /home/ubuntu/cephtest 2023-10-14T12:21:27.039 DEBUG:teuthology.nuke:shortname: smithi032 2023-10-14T12:21:27.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:21:27.063 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-14T12:21:27.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:21:27.067 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:00:42.514040', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:21:27.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425304', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:00:42.512854', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:21:27.120 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-14T12:21:27.121 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:21:27.143 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-14T12:21:27.144 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:21:27.156 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-14T12:21:27.157 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:27.169 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-14T12:21:27.170 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:27.185 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-14T12:21:27.193 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-14T12:21:31.187 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:31.196 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:31.298 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-14T12:21:31.306 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-14T12:21:35.303 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:35.311 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:35.416 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-14T12:21:35.421 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-14T12:21:35.517 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-14T12:21:39.422 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:39.533 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-14T12:21:39.634 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-14T12:21:39.739 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 912.4311146736145 failure_reason: 'Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7f2543c12d144660ba7715f058268767 status: fail success: false 2023-10-14T12:21:39.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:21:39.828 INFO:teuthology.run:FAIL